v1.0.4
Laxcorp-Research/project-ravenv1.0.4Jul 17, 2026by virattt
AI Summary
This release focuses on evaluation enhancements, adding rubric-based partial-credit scoring, contradiction detection, and reproducible sampling. It also improves reporting with metadata and fixes inaccuracies in finance evaluation.
Key Highlights
- Rubric-based partial-credit scoring and contradiction detection
- Reproducible sampling, quick runs, and configurable models
- Improved eval reporting with metadata and latency metrics
- Fixed inaccurate finance evaluation answers
New Features
- Rubric-based partial-credit scoring
- Contradiction detection
- Reproducible sampling
- Configurable models
- Concurrency support
- Timeouts support
- Metadata in eval reporting
Full Release Notes
### Changes - Add rubric-based partial-credit scoring and contradiction detection - Add reproducible sampling, quick runs, configurable models, concurrency, and timeouts - Improve eval reporting with metadata, latency, and failure metrics ### Fixes - Fix inaccurate finance evaluation answers and rubric criteria