Progressive Distillation
Incrementally compress knowledge from a series of teachers
May 31, 20265 min read

Search for a command to run...
Incrementally compress knowledge from a series of teachers

Learn about the txtai agent toolkit

Integrate skill.md files with your agent

Identify a list of strong engineering colleges

Integrate OpenCode with the txtai ecosystem

Finetune tiny LLMs to enable inference using less resources

Context retrieval via Web, SQL and other sources

Build a vector database using txtai's low-level APIs

Deep graph search powered RAG
