CompileAI news intelligence platform

Compile is a news reader I built end to end. A self-healing Crawl4AI pipeline ingests 500+ articles a day, generating extraction schemas on the fly for layouts it has not seen before. Articles land in Supabase for relational data and Pinecone for embeddings, behind a real-time API that the frontend and downstream jobs read from.

A semantic clustering step groups related coverage into a single story and summarizes each one with Gemini 2.5, so you read one well-sourced piece instead of twelve near-duplicates. The Next.js frontend has a "For You" feed driven by embeddings of what you actually read, semantic search across the corpus, and controls to rewrite any story to the tone and length you want.