v1.5.0
datalab-to/markerv1.5.0Feb 13, 2025by VikParuchuri
AI Summary
Adds inline math support, enables local LLMs via Ollama, and speeds up LLM calls through batching.
Key Highlights
- Inline math support
- Local LLM support (Ollama)
- Batch LLM calls
- Biology PDF improvements
New Features
- Inline math support
- Local LLM integration
- Batch LLM inference
Full Release Notes
## Inline math Marker will handle inline math if `--use_llm` is set. This makes reading scientific papers a lot nicer! The feature has been optimized for speed. <img width="1213" alt="image" src="https://github.com/user-attachments/assets/87690700-159f-4e68-893a-e7525b9b3c9d" /> ## Local LLMs We now support Ollama - when you're passing the `--use_llm` flag, you can select the Ollama inference service like this: ```shell marker_single FILEPATH --use_llm --llm_service marker.services.ollama.OllamaService ``` You can set the options `--ollama_base_url` and `--ollama_model`. By default, it will use `llama3.2-vision`. ## Batch LLM calls LLM calls are now batched across processors for a significant speedup if you're passing `--use_llm`. ## Misc fixes - Biology PDFs now work a lot better - leading line numbers are stripped - Improved OCR heuristics - Updated the examples ## What's Changed * Batch together llm inference requests by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/536 * Add another heuristic to clean up line numbers by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/538 * Add Inline Math Support by @tarun-menta in https://github.com/VikParuchuri/marker/pull/517 * Factor out llm services, enable local models by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/544 * Improve LLM speed; handle inline math; allow local models by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/537 **Full Changelog**: https://github.com/VikParuchuri/marker/compare/v1.4.0...v1.5.0