Paul Krill
Editor at Large

Google unveils PaliGemma, announces Gemma 2

news
May 14, 20242 mins

PaliGemma is an open vision-language model designed for tasks such as image captioning, visual question answering, and object detection.

Objects, geometric shapes, OOP
Credit: Anna Martyanova/Shutterstock

Google has expanded on its Gemma family of AI models, introducing the PaliGemma vision-language model (VLM) and announcing Gemma 2, the next generation of Gemma models based on a new architecture. The company also released the LLM Comparator in open source, an addition to its Responsible Generative AI Toolkit.

Google announced the new products on May 14. The company described PaliGemma as a powerful open VLM inspired by the Pali-3 vision-language models, intended to be smaller, faster, and stronger. Built on components from the SigLIP vision model, PaliGemma is designed for a range of vision-language tasks including image and video captioning, visual question answering, understanding text in images, object detection, and object segmentation. PaliGemma can be found on GitHub, Hugging Face, Kaggle, and Vertex AI.

Gemma 2, due to be formally launched in coming weeks, features a new architecture designed for “breakthrough performance and efficiency,” Google said. At 27 billion parameters, Gemma 2 offers performance comparable to Llama 3B at less than half the size, Google said. An efficient design reduces deployment expenses, with Gemma 2 fitting on less than half the compute of comparable models. For fine-tuning, Gemma 2 can work with solutions ranging from Google Cloud to tools such as Axolotl.

Google also added to its Responsible Generative AI Toolkit by releasing the LLM Comparator in open source. Designed to assist developers with conducting model evaluations, the LLM Comparator is an interactive data visualization tool that allows users to perform side-by-side evaluations of model responses to assess their quality and safety.

Paul Krill

Paul Krill is editor at large at InfoWorld. Paul has been covering computer technology as a news and feature reporter for more than 35 years, including 30 years at InfoWorld. He has specialized in coverage of software development tools and technologies since the 1990s, and he continues to lead InfoWorld’s news coverage of software development platforms including Java and .NET and programming languages including JavaScript, TypeScript, PHP, Python, Ruby, Rust, and Go. Long trusted as a reporter who prioritizes accuracy, integrity, and the best interests of readers, Paul is sought out by technology companies and industry organizations who want to reach InfoWorld’s audience of software developers and other information technology professionals. Paul has won a “Best Technology News Coverage” award from IDG.

More from this author