Engineering Manager, Inference Routing and Performance
Anthropic
San Francisco, CA | New York City, NY | Seattle, WA3d ago
About the role
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Every request that hits Claude — from claude.ai, the API, our cloud partners, or internal research — passes through a routing decision. Not a generic load balancer round-robin, but a decision that accounts for what's already cached where, which accelerator the request runs best on, and what else is in
More at Anthropic
- Staff Software Engineer, iOSSan Francisco, CA, New York City, NY, Seattle, WA
- Staff Software Engineer, AndroidSan Francisco, CA | New York City, NY | Seattle, WA
- Technical Program Manager, LaunchesSan Francisco, CA | New York City, NY
- Product Management, Human Data PlatformSan Francisco, CA | New York City, NY
- Staff Infrastructure Engineer, Cluster InfrastructureSan Francisco, CA | New York City, NY | Seattle, WA
- Senior Manager, Infrastructure AccountingSan Francisco, CA | Seattle, WA