v1.0.4

virattt/dexterv1.0.4Jul 17, 2026by virattt

AI Summary

This update enhances the evaluation framework by adding advanced scoring mechanisms (partial credit) and reproducible sampling capabilities, while also fixing inaccuracies in finance evaluation.

Key Highlights

Added rubric-based partial-credit scoring and contradiction detection.
Added reproducible sampling, quick runs, and configurable models.
Improved eval reporting with metadata, latency, and failure metrics.

New Features

Rubric-based partial-credit scoring
Reproducible sampling
Configurable models, concurrency, and timeouts
Improved eval reporting

Full Release Notes

### Changes

- Add rubric-based partial-credit scoring and contradiction detection
- Add reproducible sampling, quick runs, configurable models, concurrency, and timeouts
- Improve eval reporting with metadata, latency, and failure metrics

### Fixes

- Fix inaccurate finance evaluation answers and rubric criteria