"llm-d v1.0: State-of-the-art inference, ready for Day 2"
Chris Aniszczyk
@cra
Building a Better World Through Open Collaboration / @CloudNativeFdn @linuxfoundation / Always Paying it Forward
- "Nebius Joins the PyTorch Foundation as a Platinum Member"
- open innovation makes us all better in the end🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more
- We still want to find a way to bring the community together. If you planned to be in California for the Grace Hopper Celebration, I invite you to join us this year for GitHub Universe, Oct 28-29. 🌉 We've set aside 75 complimentary passes for folks with cancelled registrations.
