Starstruk Logo MarkStarstruk

v1.0.0

datalab-to/markerv1.0.0Nov 27, 2024by VikParuchuri

AI Summary

Marker v1.0 is a complete rewrite from scratch, introducing a new layout model that doubles performance and a modular architecture for easier customization.

Key Highlights

  • 2x faster due to a new layout model
  • Modular architecture with overridable processors and renderers
  • Consistent internal schema for blocks and pages
  • JSON chunk and markdown output support
  • High output quality and extensive unit testing

New Features

  • Modular architecture with processors and renderers
  • JSON chunk output
  • Markdown output
  • API server file upload support
  • Output images

Full Release Notes

This is the release of marker v1, a complete rewrite from scratch.

- 2x faster due to a new layout model
- Consistent internal schema for blocks and pages
- Modular architecture with processors and renderers that can easily be overridden
- JSON chunk and markdown output
- Lots of units tests
- Much higher output quality

## What's Changed
* feat: API server file upload support by @tjbck in https://github.com/VikParuchuri/marker/pull/332
* Upgrade line joining by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/344
* Surya Layout model and batch multiplier updates by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/335
* Initial document skeleton by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/345
* Add PDF Provider by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/346
* Add Layout Merging by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/348
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/349
* Layout Merging fixes and tests by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/350
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/351
* Decouple Span from Line by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/352
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/353
* Add simple line and span renderer, add blocktype class by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/357
* Add markdown renderer, swap how ids are named by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/358
* Fix markdown output by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/359
* Add OCR Builder by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/356
* Output images, clean up other output formats by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/362
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/364
* Cleanup and speed up tests by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/363
* Add CI tests by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/366
* Add debug utils, fix output quality issues by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/367
* Allow Overriding Node Classes by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/368
* Reorganize tests by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/369
* Minor debugging and misc fixes by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/370
* Chunk JSON output by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/371
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/372
* Add code processor, fix issues with structure by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/375
* Add Line merging across Pages and Columns by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/373
* PDF Converter Initialization refactor + Tests by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/379
* Wire up convert_single by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/380
* Fix tests by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/381
* Add Docstrings for Processors, Builders and Converters and `-l` to list them from the `convert.py` CLI + Misc Fixes by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/382
* Fix broken text by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/383
* Fix marker app by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/384
* Fix marker server by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/385
* Misc Bugfixes by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/386
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/387
* Update tests by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/388
* Additional Fixes by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/390
* Vik v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/391
* Marker v2 by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/392
* Improve comparison performance by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/394
* Dev by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/395

## New Contributors
* @tjbck made their first contribution in https://github.com/VikParuchuri/marker/pull/332

**Full Changelog**: https://github.com/VikParuchuri/marker/compare/v0.3.10...v1.0.0