v2.7.1

vladmandic/humanv2.7.1May 9, 2022by vladmandic

AI Summary

Introduces MediaPipe FaceMesh-with-Attention, a model pre-compile phase, 4K support, and new ElectronJS demos.

Key Highlights

  • Add MediaPipe FaceMesh-with-Attention model
  • Add model pre-compile phase to warmup method (~30% speed-up)
  • Changed default face crop from 120% to 140%
  • Add highlights to attention keypoints
  • Add ElectronJS demo and enhanced 3D demos

New Features

  • FaceMesh-with-Attention model
  • Model pre-compile phase
  • Face crop adjustment
  • Attention keypoints highlighting
  • ElectronJS demo support
  • 4K input support

Full Release Notes

- Add **MediaPipe FaceMesh-with-Attention** model  
  model is available in `@vladmandic/human-models` repository  
  to enable, set `config.face.attention = true`  
  model replaces **iris**, **eyes** and **lips** keypoints with high-detailed ones  
- Add model **pre-compile** phase to `warmup` method
  result is speed-up to first inference by around ~30% for browser environments
- Changed default face crop from 120% to 140%  
  to better utilize caching between frames and face mesh mapping  
- Refactor **draw** methods into separate modules and fix coloring function  
- Add highlights to attention keypoints  
  enabled when both points and attention draw are enabled:  
  `human.draw.options.drawAttention = true` and `human.draw.options.drawPoints = true`
- Add **ElectronJS** demo:  
  see <https://github.com/vladmandic/human-electron>  
- Enhanced **3D** demos:  
  see <https://github.com/vladmandic/human-motion>
- Support for **4K** input
- Update **TFJS** to 3.16.0
- Update build platform and dependencies