2.11.1

vladmandic/human2.11.1Oct 13, 2022by vladmandic

AI Summary

New webcam and video methods for continuous detection, redesigned segmentation with breaking changes, and new RVM body segmentation model.

Key Highlights

New human.webcam.* methods for built-in webcam control
New human.video() method for continuous video detection
Redesigned human.segmentation with breaking changes
New RVM model for real-time body segmentation
New demos for webcam, video, and segmentation methods

Breaking Changes

Redesigned human.segmentation handling

New Features

human.webcam.* methods for webcam stream configuration and control
human.video() for continuous video detection
RVM body segmentation model
human.webcam.enumerate() for video source selection

Full Release Notes

TL;DR: Several new methods and models, but only breaking change is how `human.segmentation` is handled

- New methods [`human.webcam.*`](https://vladmandic.github.io/human/typedoc/classes/WebCam.html)  
  Enables built-in configuration and control of **WebCam** streams  
- New method [`human.video()`](https://vladmandic.github.io/human/typedoc/classes/Human.html#video)  
  Runs continous detection of an input **video**  
  instead of processing each frame manually using `human.detect()`  
- New demo for **webcam** and **video** methods [*Live*](https://vladmandic.github.io/human/demo/video/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/video/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- Redesigned [`human.segmentation`](https://vladmandic.github.io/human/typedoc/classes/Human.html#segmentation)  
  *Breaking changes*  
- New model `rvm` for high-quality body segmentation in real-time  
  *Not part of default deployment, download from [human-models](https://github.com/vladmandic/human-models/tree/main/models)*  
- New demo for **segmentation** methods [*Live*](https://vladmandic.github.io/human/demo/segmentation/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/segmentation/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- New advanced demo using **BabylonJS and VRM** [*Live*](https://vladmandic.github.io/human-bjs-vrm) | [*Code*](https://github.com/vladmandic/human-bjs-vrm)
- Update **TypeDoc** generation [*Link*](https://vladmandic.github.io/human/typedoc)  
- Update **TypeDefs** bundle generation [*Link*](https://github.com/vladmandic/human/blob/main/types/human.d.ts)  
  No external dependencies  
- Fix model caching when using web workers  
- Fix `face.rotation` when using interpolation  
- Improve NodeJS resolver when using ESM  
- Update demo `demo/typescript`  
- Update demo `demo/faceid`  
- Update demo `demo/nodejs/process-folder.js`  
  and re-process `/samples` [*Link*](https://vladmandic.github.io/human/samples)