v1.5.0

datalab-to/markerv1.5.0Feb 13, 2025by VikParuchuri

AI Summary

Adds inline math support, enables local LLMs via Ollama, and speeds up LLM calls through batching.

Key Highlights

  • Inline math support
  • Local LLM support (Ollama)
  • Batch LLM calls
  • Biology PDF improvements

New Features

  • Inline math support
  • Local LLM integration
  • Batch LLM inference

Full Release Notes

## Inline math

Marker will handle inline math if `--use_llm` is set.  This makes reading scientific papers a lot nicer!  The feature has been optimized for speed.

<img width="1213" alt="image" src="https://github.com/user-attachments/assets/87690700-159f-4e68-893a-e7525b9b3c9d" />

## Local LLMs

We now support Ollama - when you're passing the `--use_llm` flag, you can select the Ollama inference service like this:

```shell
marker_single FILEPATH --use_llm --llm_service marker.services.ollama.OllamaService
```

You can set the options `--ollama_base_url` and `--ollama_model`.  By default, it will use `llama3.2-vision`.

## Batch LLM calls

LLM calls are now batched across processors for a significant speedup if you're passing `--use_llm`.

## Misc fixes

- Biology PDFs now work a lot better - leading line numbers are stripped
- Improved OCR heuristics
- Updated the examples

## What's Changed
* Batch together llm inference requests by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/536
* Add another heuristic to clean up line numbers by @iammosespaulr in https://github.com/VikParuchuri/marker/pull/538
* Add Inline Math Support by @tarun-menta in https://github.com/VikParuchuri/marker/pull/517
* Factor out llm services, enable local models by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/544
* Improve LLM speed; handle inline math; allow local models by @VikParuchuri in https://github.com/VikParuchuri/marker/pull/537

**Full Changelog**: https://github.com/VikParuchuri/marker/compare/v1.4.0...v1.5.0