eWeek

This $800M Startup Makes ChatGPT 24x Faster

Back to overview

vLLM, an AI optimization technology, enables ChatGPT to run 24 times faster while reducing costs. The startup behind this breakthrough has launched with an $800M valuation to commercialize the technology. vLLM improves AI inference efficiency on major platforms, promising significant performance gains for large-scale AI deployments.