2.11.1

nari-labs/dia2.11.1Oct 13, 2022by vladmandic

AI Summary

Human v2.11.1 adds new webcam and video methods for continuous detection, introduces the RVM segmentation model, and redesigns segmentation handling.

Key Highlights

New methods `human.webcam.*` for built-in webcam configuration and control
New method `human.video()` for continuous detection instead of manual frame processing
New model `rvm` for high-quality body segmentation in real-time
New advanced demo using BabylonJS and VRM

Breaking Changes

Redesigned `human.segmentation`

New Features

New webcam and video demos
New RVM segmentation model
Updated TypeDoc and TypeDefs generation
Fix model caching when using web workers
Improve NodeJS resolver when using ESM

Full Release Notes

TL;DR: Several new methods and models, but only breaking change is how `human.segmentation` is handled

- New methods [`human.webcam.*`](https://vladmandic.github.io/human/typedoc/classes/WebCam.html)  
  Enables built-in configuration and control of **WebCam** streams  
- New method [`human.video()`](https://vladmandic.github.io/human/typedoc/classes/Human.html#video)  
  Runs continous detection of an input **video**  
  instead of processing each frame manually using `human.detect()`  
- New demo for **webcam** and **video** methods [*Live*](https://vladmandic.github.io/human/demo/video/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/video/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- Redesigned [`human.segmentation`](https://vladmandic.github.io/human/typedoc/classes/Human.html#segmentation)  
  *Breaking changes*  
- New model `rvm` for high-quality body segmentation in real-time  
  *Not part of default deployment, download from [human-models](https://github.com/vladmandic/human-models/tree/main/models)*  
- New demo for **segmentation** methods [*Live*](https://vladmandic.github.io/human/demo/segmentation/index.html) | [*Code*](https://github.com/vladmandic/human/blob/main/demo/segmentation/index.html)  
  *Full HTML and JavaScript code in less than a screen*  
- New advanced demo using **BabylonJS and VRM** [*Live*](https://vladmandic.github.io/human-bjs-vrm) | [*Code*](https://github.com/vladmandic/human-bjs-vrm)
- Update **TypeDoc** generation [*Link*](https://vladmandic.github.io/human/typedoc)  
- Update **TypeDefs** bundle generation [*Link*](https://github.com/vladmandic/human/blob/main/types/human.d.ts)  
  No external dependencies  
- Fix model caching when using web workers  
- Fix `face.rotation` when using interpolation  
- Improve NodeJS resolver when using ESM  
- Update demo `demo/typescript`  
- Update demo `demo/faceid`  
- Update demo `demo/nodejs/process-folder.js`  
  and re-process `/samples` [*Link*](https://vladmandic.github.io/human/samples)