Compile – AI-News Intelligence Platform

Architected a comprehensive AI-powered news intelligence platform that revolutionizes how users consume and interact with news content. The system features a self-healing Crawl4AI agent that automatically generates schemas for unseen article layouts, enabling robust scraping of 500+ news pieces daily. Data is intelligently stored in Supabase for relational information and Pinecone for vector embeddings, with a real-time API exposing the content to downstream applications. The platform includes a sophisticated semantic-clustering algorithm that groups related articles into coherent "stories" and generates comprehensive summaries using Google's Gemini-2.5 language model. The React + Next.js frontend provides users with complete control over their news experience, allowing them to customize topics, adjust story rendering preferences, and rewrite articles to match their preferred tone and length. Key features include embedding-driven "For-You" feeds that learn from user behavior, semantic search capabilities for finding relevant content, and intelligent recommendation systems. The entire platform is designed with scalability in mind, handling high-volume news ingestion while maintaining real-time responsiveness for user interactions.