2.11.1

LaurenzV/hayro2.11.1Oct 13, 2022by vladmandic

AI Summary

Introduced continuous video detection, webcam controls, and a new high-quality body segmentation model, alongside a redesign of the segmentation API.

Key Highlights

New `human.webcam` methods for stream configuration
New `human.video()` method for continuous detection
New RVM model for high-quality body segmentation
New BabylonJS VRM demo
Redesigned `human.segmentation` handling

Breaking Changes

Redesigned `human.segmentation` handling

New Features

New webcam methods for built-in configuration
New video method for continuous detection
New RVM model for body segmentation
New segmentation and VRM demos
Updated TypeDoc and TypeDefs
Fixed model caching in web workers

Full Release Notes

TL;DR: Several new methods and models, but only breaking change is how `human.segmentation` is handled

- New methods [`human.webcam.*`](https://vladmandic.github.io/human/typedoc/classes/WebCam.html)  
  Enables built-in configuration and control of **WebCam** streams  
- New method [`human.video()`](https://vladmandic.github.io/human/typedoc/classes/Human.html#video)  
  Runs continous detection of an input **video**  
  instead of processing each frame manually using `human.detect()`  
- New demo for **webcam** and **video** methods [*Live*](https://vladmandic.github.io/human/demo/video/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/video/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- Redesigned [`human.segmentation`](https://vladmandic.github.io/human/typedoc/classes/Human.html#segmentation)  
  *Breaking changes*  
- New model `rvm` for high-quality body segmentation in real-time  
  *Not part of default deployment, download from [human-models](https://github.com/vladmandic/human-models/tree/main/models)*  
- New demo for **segmentation** methods [*Live*](https://vladmandic.github.io/human/demo/segmentation/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/segmentation/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- New advanced demo using **BabylonJS and VRM** [*Live*](https://vladmandic.github.io/human-bjs-vrm) | [*Code*](https://github.com/vladmandic/human-bjs-vrm)
- Update **TypeDoc** generation [*Link*](https://vladmandic.github.io/human/typedoc)  
- Update **TypeDefs** bundle generation [*Link*](https://github.com/vladmandic/human/blob/main/types/human.d.ts)  
  No external dependencies  
- Fix model caching when using web workers  
- Fix `face.rotation` when using interpolation  
- Improve NodeJS resolver when using ESM  
- Update demo `demo/typescript`  
- Update demo `demo/faceid`  
- Update demo `demo/nodejs/process-folder.js`  
  and re-process `/samples` [*Link*](https://vladmandic.github.io/human/samples)