v0.1.68

## What's new



## Commits

d2755ad Bump version to v0.1.68 for release
db9972c Readme updates
c97ce8b Lints
08806fd Fixups
10b5e9e Includes
63aee2c Code cleanup, version bump, remove unused permutation test
5de52e7 Update README.md
66f9b46 Merge branch 'main' of github.com:allenai/olmocr
7f4edb2 pareto plot
c970851 Merge branch 'main' of https://github.com/allenai/olmocr
bb3fe14 Pareto plot for paper
f0768bb Merge branch 'main' of https://github.com/allenai/olmocr
c4a0fb9 Adding back in proper CI estimation
d17210f Lint fix
ffee4c9 Big bug fix, moving the prompt to match how training was done, 2.3 point boost on olmocr-bench
28966b9 Adding CDF plots
2e8753a Docling runner based on CLI, but its too slow to use. Pii rule fixes
74ef2b6 Fixes for some pii taggers
b3b405d dedupe script
e06fd62 Adjusting tagging pipelien v2
1538163 Merge branch 'main' of https://github.com/allenai/olmocr
623c66c Fixing up tagging pipeline
1854ae1 A bit more work on tagging
72bcfd8 doing some extra pii tagging steps
9871e06 Merge branch 'main' of https://github.com/allenai/olmocr
424052d Outputting some nice reference docs to check pii
d18f3f7 More pii tag checking
80645c8 Hypothesis checker
3aba3a5 Comitting script to get stats on PII tagging
6f62e05 Merge pull request #188 from allenai/amanr/miners
9e5965a Some PII filter
ef083bf Stats fix
d671be6 Working on some dataset filtering
da21074 More nits
88270e9 More work on qwen25 finetune
a2ec95e Testing out to see where we stand on qwen2.5
97e4992 Merge branch 'main' of https://github.com/allenai/olmocr
dcbe654 Report for benchmarking
791983c Tweaking some more pii detection
5cc0848 Rich tagger with bigger model
4ed00d0 Fixes for rich tagging
472ee10 Lints
8ef7e56 Trying a new rich tagging pipeline for PII
0a320e9 Some helper scripts for Aman
1067f80 Update README.md
4e9e13e Option in benchmark to output tests which fail on all models for debugging
e51362b Showing benchmark scores per category, speed improvements
f880847 Adding some small changes to the tagging pipeline
66d293c Decent resume/cv tagging
1f66b96 Adding openai dependecy for benchmarking
689bcd9 Merge branch 'main' of https://github.com/allenai/olmocr
8ec7dbe Script updates
83002a0 Reinit credentials
2d5e183 Small corrections
df71dc3 Small fix for cluster usage
67a01cf FIxups for tagging pipeline
c326fae Refactoring tagging bigly
811d267 Merge branch 'main' of https://github.com/allenai/olmocr into main
479b2c1 Working on a tagger
717ed81 Cleanup
97ae48c Making some more progress
7d8e9d1 Fixing up tagging pipeline
12100b4 Adding some manual structure to be filled in
ee8c506 Example of a basic empty pipeline that I'm hoping to extend for tagging
582518f Merge pull request #181 from mhamada-ai2/patch-1
887efac Merge branch 'main' of https://github.com/allenai/olmocr
246490f Lint fixes
967210f Adjustments to task
3dffeea Saving prolific PID
b20a488 README for benchmark
b897bf1 Merge branch 'main' of https://github.com/allenai/olmocr
f0992b9 Better staggering of downloads
858cf69 Bumping version
10cb6aa Updating pipeline to take cloud storage model names and paths, as well as local directory
e361713 Update README.md
ac8c536 Update README.md
df65757 Update README.md
ca6e142 Adding some extra unit tests on some math cases I wasn't sure of
7a638c7 Adding some more options to prompt chatgpt
eabbe27 Lint fixes
7f82260 Merge pull request #173 from allenai/amanr/olmocr-bench-old_scans
e16f66d Working on annotation for dolma docs release
9a67f50 Doing some work on annotations again...
1d0c560 Upping version to fix issue with work queue and delimited paths
786b14a Final adjustments
4d8a8af Adjusting prolific script
dc2512c Adjusted annotation script
ee41449 Instructions updated in annotation tool
5ebec46 Merge branch 'main' of https://github.com/allenai/olmocr
0b5cd40 Staggering model downloads in big sharded jobs
3f34969 Rendering math in review app
590a92e Ruff fix
4e990e2 Merge branch 'main' of https://github.com/allenai/olmocr
a13a501 Formatting, fixes to annotation tool
a74800f New flowchart based annotation tool
cdc7fae Adjusting annotation script
2f74a2a Prompt6 for qwen2.7 vl
8c287a0 Basic prompt edits
ecbd3a2 Merge branch 'main' of https://github.com/allenai/olmocr into main
474e0ef Lint fixes, adjusting qwen2.5 vl prompt
aa5cb95 Typos fixed up
141fc69 Vllm based qwen2.5 evals
9d8a4cf Merge branch 'main' of https://github.com/allenai/olmocr into main
f5641c6 Convert script updated a bit
ae4fda7 Bugfixes
aa58370 Merge branch 'main' of https://github.com/allenai/olmocr into main
613a4f3 Adding additional runners and updating convert script
b607aec Lints
95b03a1 Fixing gemini conver script to use new API
3d19250 Removing progress bar in annotation UI
caf21b9 Lints
f1188dc Merge branch 'main' of https://github.com/allenai/olmocr
a0f8b02 Reporting results
cc7b113 Editing
9338f53 Saving pdf paths
61624a3 Fixed
d299119 Links updated
a113fd3 Review app
e8c14fc Saving prolific codes
cd9e370 Tinyhosting automatically
02cd002 Step by step annotation
6a0dbfc Adjusting buttons
d4d87f7 Force flag for review app, tests fixed for difference comparison in tables
e856e9d Test mining not including line numbers
2614fc9 Merge branch 'main' of https://github.com/allenai/olmocr
a96f154 Hopefuly avoiding comparison issues now
b8b780f More mining of synthetic tests code
360b1be Better filtering of tests
6d3a7d6 Adding autorender if katex into synthetic pipeline
4604b59 SYnth mining
69b0222 Improving miner script
841ce72 Miner improvements
9737649 More tests
748ab95 Miner unit tests for duplicate absent tests
594f473 Synth miner coming together more
fb8b23d SMall adjustments to synthetic data pipeline
678c000 Nicer claude prompt for synth data gen
5c98a47 Mining upgrades
a34b158 Lints
83ae610 Scan dolma docs improvements for PII review
bc78e0d Adding feedback
213252f A few improvements to the dolma doc viewer script
3ca39ab Merge branch 'main' of https://github.com/allenai/olmocr
9b119c8 First attempt at mining actual test cases
abcf7f0 Lints
cd5a93d Rendering pdfs with playwright and chromium
9749e95 Merge branch 'main' of https://github.com/allenai/olmocr
731aa73 Better synth miner script
42be0cc Too much debug spew
d45c032 Better equation rendering checker with more tests.
b8e3034 Trying a change to the render script
2141f18 Adding a katex test case that should be fixed
4d6a97f Style fix, a few notes
c36d8fd Merge branch 'main' of https://github.com/allenai/olmocr into main
223d05a Adding basic prompt template
2417e61 Mediod
03285d9 Merge branch 'main' of https://github.com/allenai/olmocr
1f77aab Some early code for mining html templates of pages, pick mediod code
58276b0 Mining reading order checkpoint, convert script to use images
f79bd0d Cleanup review app
063d4f5 Review page
449900a Tests
9e3b554 More html table parsing goodness
2944d3b More fixes
16ab1a4 Progress on more complicated header and footers
1e13dde Sorting results
c25e9cb Addxing some fixes
3005ebd Normalization
8ec1ebe Normalization
cb4dfeb Fix
a4605e4 Fixing normalizing during table cell comparison
1797911 Lints
b307f5a More robust markdown parsing
5344457 Tests
cac5ef1 Tests for the tests
196654e Merge branch 'main' of https://github.com/allenai/olmocr
0a3a5ef Lints
0afacd6 Less duped tests
9855f70 Some work on table dataset
bc41ba9 Merge branch 'main' of https://github.com/allenai/olmocr
ad82e55 Adding url reference for tests, some mining and cleanup scripts
3c22cf3 Lints
da05b4c Merge branch 'main' of https://github.com/allenai/olmocr
d620722 Review app is much nicer now
5ec9647 Keyboard shorcuts
9df5102 review document
7f921f4 review app
89b628d Slighty better
9344107 pdf viewr
4939e41 Flask based review app first attempt
93450c3 Table miner
b472845 Table miners
aee030c Fixing sample dataset, outputting some reports for debugging. Math is good enough for now