We built what Andrej Karpathy described, and solved the hard part. OpenKB is an open-source CLI that compiles raw documents into a structured, interlinked wiki, powered by PageIndex for long PDFs.
PageIndex File System is a file-level tree layer that sits above your documents and scales the same PageIndex tree search from a single document to millions of documents in one index. It synthesizes a semantic hierarchy with virtual nodes when no usable folder structure exists, builds the tree on demand for each query, and adapts how it searches each node to stay efficient at scale.
PageIndex Flash runs entirely on your own machine and is designed for text-based PDFs. It builds a hierarchical tree index from a PDF's own layout, indexing a 1,000-page document in minutes for about a dollar. PageIndex Flash is available now in the PageIndex SDK, with your own LLM and API key, page-level citations, no chunking and no vector database.