Skip to content
Let's talk

Futurum Research

Insight · Analyst Insight

AI Platforms4 min read

Google Addressing Gemini AI Model Tuning and Guardrail Issues

Vice President & Research Director, Enterprise Software & Digital Workflows

The short answer

Keith Kirkpatrick, Research Director at The Futurum Group, covers Google’s challenge with implementing generative AI guardrails and discusses how the company can rebound with a solid, enterprise-grade offering.

Futurum's Keith Kirkpatrick,

Cite this

Keith Kirkpatrick, The Futurum Group, "Google Addressing Gemini AI Model Tuning and Guardrail Issues," February 29, 2024. https://trial.futurumgroup.com/insights/google-addressing-gemini-ai-model-tuning-and-guardrail-issues/

Google Addressing Gemini AI Model Tuning and Guardrail Issues

Introduction

Google announced it is working on addressing the functionality of its Gemini AI service, in response to significant user and media backlash due to the tool generating embarrassing, inaccurate, and offensive results to user prompts. According to an internal memo that was first reported by Semafor and has since been confirmed as accurate by Google, the company is working “around the clock” to address these issues.

The headlines around Google’s Gemini AI service were hard to miss, as the media quickly picked up the most shocking examples of responses to generative AI prompts gone wrong. I will not repeat the examples here, but suffice to say, the responses to prompts were offensive, inaccurate, and appeared to be the result of tuning designed to reflect a certain worldview. However, Google should be commended for taking swift action to shut down the service once the problems were identified and for taking responsibility for the content that was generated.

Google CEO Sundar Pichai’s acknowledgment that “I know that some of its responses have offended our users and shown bias—to be clear, that’s completely unacceptable and we got it wrong,” is refreshing in its candor. And while there may be a continued short-term reputational impact, it is clear that Pichai is focused on addressing this issue as quickly as possible and restoring trust with its customers and users.

Deploying Effective AI Guardrails Is Challenging

Google, like many of its competitors, is trying to implement technological advances across its products very quickly. In fact, it was barely 12 months ago that the general public became aware of generative AI technology, and here we are, with most major vendors having released generative AI assistants into their enterprise-focused product lines.

It is not surprising that a generative AI tool might return offensive or inaccurate responses to user prompts. After all, models must be properly guardrailed against such behavior. However, the implementation of proper guardrails is challenging, particularly because of the current focus on ensuring that models are properly tuned and trained to eliminate historical biases. As I see it, Google tried to implement guardrails against incorporating bias but did not effectively test them to ensure that the model did not overcorrect, thereby introducing inaccuracies.

Google Likely Will Rebound from This Misstep

Google has taken a beating in the press around the issues with Gemini but should be commended for acting quickly to suspend the service and redoubling its efforts to fix the problems. The company would be wise to ensure that its teams implementing guardrails not only focus on eliminating historical biases but also work to ensure internal controls and processes are implemented with review teams to be sure a wide spectrum of inputs and viewpoints are considered (particularly around sensitive topics and prompts). This approach will ensure the models are fine-tuned to reflect a neutral assessment of historical people, events, and actions.

As enterprise-focused tools such as Gemini for Google Workspace continue to be rolled out, enterprise buyers can be confident that Google is clearly focused on prioritizing model tuning and training issues, which are key to reducing or eliminating hallucinations. I expect the company has quickly learned from this situation, and hopefully it will serve as a cautionary tale for other generative AI-focused companies as they look to roll out more advanced features and functions.

Disclosure: The Futurum Group is a research and advisory firm that engages or has engaged in research, analysis, and advisory services with many technology companies, including those mentioned in this article. The author does not hold any equity positions with any company mentioned in this article.

Analysis and opinions expressed herein are specific to the analyst individually and data and other information that might have been provided for validation, not those of The Futurum Group as a whole.

Other Insights from The Futurum Group:

Google Cloud Widens Gemini Model Access for Vertex AI Users

Google Gemini Advanced: Google’s Counter to Copilot? | The AI Moment – Episode 15

Google Gemini Aims to Redefine Digital Frontiers

Published by Futurum.

About the author

Keith Kirkpatrick

Vice President & Research Director, Enterprise Software & Digital Workflows

Keith Kirkpatrick is VP & Research Director, Enterprise Software & Digital Workflows with The Futurum Group. His coverage area encompasses enterprise applications, platforms, and tools, and the technologies and tools that underpin them, including artificial intelligence, automation, and integration technologies. He has more than 25 years of experience in research, marketing, and consulting-based fields, and is frequently sought out by the vendor community and trade media for his insights and commentary.

Coverage on Google
  • Analyst Insights390
  • Research Reports8
  • Documents6
All Google coverage
See the full picture in the platform

Vendor scoring, the benchmark data behind these findings, and the analyst team that produced them.

Open the platform (opens in a new tab)Become a client
The Weekly

Subscribe to The Weekly

The week's market signals, one email, no filler. Unsubscribe any time.