AI

Google's Gemini firestorm shows the risks of the company's race to catch up with its AI rivals

Sundar Pichai
Sundar Pichai is under pressure. Justin Sullivan/Getty Images
Read in app

Google hasn't managed to put out its Gemini fire quite yet.

The company has been defending itself against fierce backlash sparked by its AI chatbot's image-generating feature. The feature, which was creating historically inaccurate images of people of color, was later paused by the company and senior execs apologized for the incident.

The product has landed Google at the center of what was described in some circles as a "woke" culture war. Critics have seized on the controversial model as evidence that Google's products are being overly influenced by its left-leaning employees.

Senior exec's apology efforts appear to have done little to little to calm the critics, many of whom have questioned how the product managed to ship with such glaring issues.

Google's place amid an escalating AI arms race with fellow Big Tech companies could have sparked the internal urgency, Andrés Gvirtz, a lecturer at King's Business School, told Business Insider.

"We see a general trend, where companies are rushing towards incorporating and building AI solutions," he said, adding that this pressure to bring products to market could lead to corners being cut.

"Engineers I am talking with are well aware that this gold rush to integrate AI into existing software stacks is fraught with new legal and commercial risks, but have limited agency on deciding when a new feature gets shipped," he said.

Rushed engineers

One of the company's cofounders, Sergey Brin, addressed the complaints on Saturday, claiming the model's left-leaning bias was not the company's intention and that execs were working to fix the issues.

CEO Sundar Pichai also apologized for the incident and promised "structural changes" in a memo to employees, although there are rumblings that some would rather he step aside.

Brin said the strange images were likely down to a lack of thorough testing, something The Verge's Alex Heath blamed on employees feeling rushed to ship the product.

Heath pointed to the photo generation used in the Gemini app, which was powered by an older text-to-image model and included in Gemini to get the feature out faster, as an example of Google's haste.

The Verge also reported that there was a lack of alignment between the research team building the underlying models and the team putting them into products.

Google's 'Gemini era' is all about GPT-4

Pichai claimed late last year Google was entering its "Gemini era."

The model is widely seen as the company's answer to OpenAI's GPT-4, a product heavily backed by Microsoft and already powering many of the company's AI products.

Google has been keen not to appear to be falling behind its old rival, following Microsoft with similar product launches, including AI-powered search and workplace assistants.

Gemini's image generation slip-up is not the first time Google has been publicly embarrassed by its AI.

Last year, Google's Bard, an AI-powered chatbot widely seen as the company's response to ChatGPT, made an error during its first live demo. The mistake inadvertently highlighted the danger of replacing search engines with chatbots and sent Google parent Alphabet's shares tumbling.

Microsoft and OpenAI's tech has also had similar slip-ups. A few days after Bard's blunder, Microsoft's AI-powered Bing started delivering "unhinged responses" to users, including confessions of love and angry arguments.

But Google has tried hard to position itself as the responsible guardian of AI. In an op-ed in the Financial Times last year, Pichai said the "race to build AI responsibly" mattered even more than the need to ship user products.

For Google, the main problem with the Gemini controversy is its brand perception, Gvirtz said.

"Most people perceived Google as "neutral" before and never really asked themselves what their search engine provider stands for," he said.

Sandra Wachter, a professor at Oxford Internet Institute, told Business Insider: "I think it is important to move away from the 'move fast and break things' mantra and focus on 'move at a responsible speed and fix things.' Tech should be used to solve a problem, and not just a way of beating others to the market."

Companies do not exist in a vacuum and their actions have consequences for individuals and society, Wachter said.

"The world is not a sandbox or a big field experiment, and so we have to be careful what products are opened up for the market and when," she added.

Representatives for Google did not immediately respond to a request for comment from BI.

Read next

Beatrice Nolan was a tech reporter on the business news team in the UK. She joined Insider in January 2022 as a fellow on Business Insider's careers desk. Beatrice covered tech and the future of work, with a focus on artificial intelligence. Some of her stories and early experiments with ChatGPT are widely cited. Beatrice has also discussed her work covering AI trends on panels and radio shows, including NPR.She was based in Business Insider's London office and graduated from the University of  York with a bachelor's degree in English.Featured Articles:Artists say AI image generators are copying their style to make thousands of new images — and it's completely out of their control.ChatGPT was a black swan eventFinland is the world's happiest country, but Finns say we're confusing happiness for something elseThe world is splitting between those who use ChatGPT to get better, smarter, richer — and everyone elseThis man used AI to write and illustrate a children's book in one weekend. He wasn't prepared for the backlash.ChatGPT has only been around for 2 months and is causing untold chaosTwo professors who say they caught students cheating on essays with ChatGPT explain why AI plagiarism can be hard to proveChatGPT wrote college application essays. Admissions professionals said they passed for essays written by students but wouldn't have a chance at any top colleges.College professors are considering creative ways to stop students from using AI to cheatChatGPT wrote my cover letters. Here's how recruiters responded.