Open-source rAG, document parsing & vector search

MarkItDown

microsoft/markitdown

Microsoft’s Python tool to convert PDFs, Word, PowerPoint, Excel and more to Markdown for LLMs.

pip install 'markitdown[all]'

RAGFlow

infiniflow/ragflow

RAG engine with deep document understanding and agent workflows; self-host to build chat-over-docs apps.

git clone https://github.com/infiniflow/ragflow.git

Crawl4AI

unclecode/crawl4ai

Open-source crawler/scraper that turns websites into clean, LLM-ready Markdown.

pip install -U crawl4ai

MinerU

opendatalab/MinerU

Converts complex PDFs and Office docs into LLM-ready Markdown/JSON, strong on tables and formulas.

uv pip install -U "mineru>=4.0,<5"

Docling

docling-project/docling

Converts PDFs, Office docs and more into structured Markdown/JSON ready for RAG and agents.

pip install docling

Meilisearch

meilisearch/meilisearch

Fast search engine API with typo tolerance and AI-powered hybrid (keyword + vector) search.

Install: curl/docker install per docs.

Milvus

milvus-io/milvus

Cloud-native vector database for large-scale similarity search.

pip install -U pymilvus

GraphRAG

microsoft/graphrag

Microsoft’s graph-based RAG pipeline that builds a knowledge graph from your data for better answers.

Install: pip install graphrag (PyPI package per docs).

ScrapeGraphAI

ScrapeGraphAI/Scrapegraph-ai

Python scraping library that uses LLM pipelines to extract structured data from websites and docs.

pip install scrapegraphai

kotaemon

Cinnamon/kotaemon

Clean, self-hostable RAG UI for chatting with your documents using local or cloud models.

docker run <...> ghcr.io/cinnamon/kotaemon:main-lite

pgvector

pgvector/pgvector

Postgres extension for vector similarity search, used by Supabase, Neon and most Postgres hosts.

brew install pgvector

Jina Reader

jina-ai/reader

Turn any URL into LLM-friendly text with the r.jina.ai prefix; self-hostable OSS version.

docker run --rm -p 3000:8081 ghcr.io/jina-ai/reader:oss

LanceDB

lancedb/lancedb

Embedded (serverless) vector/multimodal database you can run in-process for RAG and search.

Install: pip install lancedb / npm install @lancedb/lancedb (per README "How to Install").