InfoQ AI/ML

Google brengt AlloyDB AI-functies uit met lokale proxy-modellen

Back to overview
AISummary generated by AI from the original source

Google has released AlloyDB AI functions with a proxy model system that replaces external language model calls by running lightweight local inference directly within the database. This approach achieves significantly faster query processing, with benchmarks showing up to 2,400 times higher throughput compared to traditional methods.