Products & Features
Core engines and capabilities powering major platforms. Ranked by impact and shipped surface area.
Conversational AI
OpenAIChatGPT System
RLHF-tuned conversational agent pipeline serving 100M+ users. Uses PPO and massive cluster orchestration.
LLMRLHF
6 Pubs
RecSys Platform
ByteDanceTikTok Monolith
Real-time recommendation engine with online training and collisionless embedding tables.
RecSysOnline Learning
4 Pubs
Information Retrieval
GoogleGoogle Search Core
The core ranking and retrieval system integrating BERT/MUM and neural matching.
IRNLP
15 Pubs
Model Serving
MetaLlama Inference Stack
Optimized serving stack for open weights models including quantization and speculative decoding.
InferenceQuantization
3 Pubs
Agent System
MicrosoftCopilot Orchestrator
Grounding engine connecting LLMs to Microsoft 365 graph data and enterprise security boundaries.
RAGAgents
8 Pubs
Compute Engine
NVIDIACUDA Graph
Task graph execution engine to reduce CPU launch overhead for high-performance inference.
HPCRuntime
12 Pubs