RAG

RAG starts from scratch every time. Karpathy proposes having the LLM maintain a wiki directly so knowledge accumulates. DataNexus’s ontology catalog needs the same principle to avoid abandonment.

An open-source platform that connects documents scattered across Notion, GitHub, and S3, then queries them with a local LLM. Runs entirely on-premise without external APIs.

Parsing raw legal XML means broken table structures and half a day lost on preprocessing. Beopmang is an API that delivers pre-cleaned JSON, solving that problem upfront.

A self-hosted RAG platform that runs on Ollama to unify team documents scattered across Notion, GitHub, and S3. Natural language search works even in air-gapped environments without external APIs.

Tried extracting web data for a RAG pipeline with defuddle and found results vary wildly by site structure. On sites where semantic HTML has collapsed, body text and ads mix together, and in dynamic rendering environments the content itself vanishes.

Letting an agent handle planning end-to-end causes it to loop and stall in production. The OpenAI guide addresses this with explicit workflow control.

Examining key features of a Python-based document conversion tool released by a global IT company, and proposing efficient approaches to handling data in LLM pipelines.