machine-learning

2 posts

▸ Feeding the Beast: Building Data Pipelines for an 8B Parameter Model

September 12, 2024 · 11 min read · machine-learning, data-engineering, pipelines, llm, infrastructure

I joined a tiger team to build the company's first large-scale internal language model. My job? Build the data pipelines that could feed an 8 billion parameter model. Here's what happens when data engineering meets cutting-edge AI.

▸ When Your Deployment Rolls Itself Back: Building Autonomous Anomaly Detection

March 22, 2019 · 7 min read · anomaly-detection, machine-learning, deployment, reliability, observability

What happens when you give your deployment system the power to say 'no'? I built an auto-rollback service that detects anomalies in real-time and reverses bad deployments. Here's why accuracy is harder than you think.