2.11.1

useautumn/autumn2.11.1Oct 13, 2022by vladmandic

AI Summary

A feature-rich release introducing new webcam and video processing methods, a new body segmentation model (RVM), and new demos, while redesigning the segmentation handling.

Key Highlights

New methods `human.webcam.*` for stream control and `human.video()` for continuous detection.
New RVM model for high-quality real-time body segmentation.
Redesigned `human.segmentation`.
New demos for webcam, video, and BabylonJS VRM.

Breaking Changes

Redesigned `human.segmentation`.

New Features

Webcam stream control methods.
Continuous video detection method.
RVM body segmentation model.
New demos.

Full Release Notes

TL;DR: Several new methods and models, but only breaking change is how `human.segmentation` is handled

- New methods [`human.webcam.*`](https://vladmandic.github.io/human/typedoc/classes/WebCam.html)  
  Enables built-in configuration and control of **WebCam** streams  
- New method [`human.video()`](https://vladmandic.github.io/human/typedoc/classes/Human.html#video)  
  Runs continous detection of an input **video**  
  instead of processing each frame manually using `human.detect()`  
- New demo for **webcam** and **video** methods [*Live*](https://vladmandic.github.io/human/demo/video/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/video/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- Redesigned [`human.segmentation`](https://vladmandic.github.io/human/typedoc/classes/Human.html#segmentation)  
  *Breaking changes*  
- New model `rvm` for high-quality body segmentation in real-time  
  *Not part of default deployment, download from [human-models](https://github.com/vladmandic/human-models/tree/main/models)*  
- New demo for **segmentation** methods [*Live*](https://vladmandic.github.io/human/demo/segmentation/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/segmentation/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- New advanced demo using **BabylonJS and VRM** [*Live*](https://vladmandic.github.io/human-bjs-vrm) | [*Code*](https://github.com/vladmandic/human-bjs-vrm)
- Update **TypeDoc** generation [*Link*](https://vladmandic.github.io/human/typedoc)  
- Update **TypeDefs** bundle generation [*Link*](https://github.com/vladmandic/human/blob/main/types/human.d.ts)  
  No external dependencies  
- Fix model caching when using web workers  
- Fix `face.rotation` when using interpolation  
- Improve NodeJS resolver when using ESM  
- Update demo `demo/typescript`  
- Update demo `demo/faceid`  
- Update demo `demo/nodejs/process-folder.js`  
  and re-process `/samples` [*Link*](https://vladmandic.github.io/human/samples)