paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

Starred 11 months ago

MIT

Created:10/24/2023

Updated:last Saturday at 7:19 AM

Last push:today at 1:10 AM

Topics (12)

AI Analysis

Loading AI analysis...

Stars

Starred by users

469

Forks

Repository forks

Watchers

Watching this repo

469

Open Issues

Needs attention

Pull Requests

Open

VisibilityPublic

CreatedOct 24, 2023

Size~

0 releases totalView all