SAN FRANCISCO — In March, two Google employees, whose jobs are to review the company’s artificial intelligence products, tried to stop Google from launching an AI chatbot. They believed it generated inaccurate and dangerous statements.
Ten months earlier, similar concerns were raised at Microsoft by ethicists and other employees. They wrote in several documents that the AI technology behind a planned chatbot could flood Facebook groups with disinformation, degrade critical thinking and erode the factual foundation of modern society.
The companies released their chatbots anyway. Microsoft was first, with a splashy event in February to reveal an AI chatbot woven into its Bing search engine. Google followed about six weeks later with its own chatbot, Bard.
The aggressive moves by the normally risk-averse companies were driven by a race to control what could be the tech industry’s next big thing: generative AI, the powerful new technology that fuels those chatbots.
That competition took on a frantic tone in November when OpenAI, a San Francisco startup working with Microsoft, released ChatGPT, a chatbot that has captured the public imagination and now has an estimated 100 million monthly users.
The surprising success of ChatGPT has led to a willingness at Microsoft and Google to take greater risks with their ethical guidelines set up over the years to ensure their technology does not cause societal problems, according to 15 current and former employees and internal documents from the companies.
The urgency to build with the new AI was crystallized in an internal email sent last month by Sam Schillace, a technology executive at Microsoft. He wrote in the email, which was viewed by The New York Times, that it was an “absolutely fatal error in this moment to worry about things that can be fixed later.”
When the tech industry is suddenly shifting toward a new kind of technology, the first company to introduce a product “is the long-term winner just because they got started first,” he wrote. “Sometimes the difference is measured in weeks.”
Last week, tension between the industry’s worriers and risk-takers played out publicly as more than 1,000 researchers and industry leaders, including Elon Musk and Apple’s co-founder Steve Wozniak, called for a six-month pause in the development of powerful AI technology. In a public letter, they said it presented “profound risks to society and humanity.”
Regulators are already threatening to intervene. The European Union proposed legislation to regulate AI, and Italy temporarily banned ChatGPT last week. In the United States, President Joe Biden on Tuesday became the latest official to question the safety of AI.
“Tech companies have a responsibility to make sure their products are safe before making them public,” he said at the White House. When asked if AI was dangerous, he said, “It remains to be seen. Could be.”
The issues being raised now were once the kinds of concerns that prompted some companies to sit on new technology. They had learned that prematurely releasing AI could be embarrassing. Five years ago, for example, Microsoft quickly pulled a chatbot called Tay after users nudged it to generate racist responses.
Researchers say Microsoft and Google are taking risks by releasing technology that even its developers don’t entirely understand. But the companies said that they had limited the scope of the initial release of their new chatbots and that they had built sophisticated filtering systems to weed out hate speech and content that could cause obvious harm.
Natasha Crampton, Microsoft’s chief responsible AI officer, said in an interview that six years of work around AI and ethics at Microsoft had allowed the company to “move nimbly and thoughtfully.” She added that “our commitment to responsible AI remains steadfast.”
Google released Bard after years of internal dissent over whether generative AI’s benefits outweighed the risks. It announced Meena, a similar chatbot, in 2020. But that system was deemed too risky to release, three people with knowledge of the process said. Those concerns were reported earlier by The Wall Street Journal.
Later in 2020, Google blocked its top ethical AI researchers, Timnit Gebru and Margaret Mitchell, from publishing a paper warning that so-called large language models used in the new AI systems, which are trained to recognize patterns from vast amounts of data, could spew abusive or discriminatory language. The researchers were pushed out after Gebru criticized the company’s diversity efforts and Mitchell was accused of violating its code of conduct after she saved some work emails to a personal Google Drive account.
Mitchell said she had tried to help Google release products responsibly and avoid regulation, but instead, “they really shot themselves in the foot.”
Brian Gabriel, a Google spokesperson, said in a statement that “we continue to make responsible AI a top priority, using our AI principles and internal governance structures to responsibly share AI advances with our users.”
Concerns over larger models persisted. In January 2022, Google refused to allow another researcher, El Mahdi El Mhamdi, to publish a critical paper.
El Mhamdi, a part-time employee and university professor, used mathematical theorems to warn that the biggest AI models are more vulnerable to cybersecurity attacks and present unusual privacy risks because they’ve probably had access to private data stored in various locations around the internet.
Although an executive presentation later warned of similar AI privacy violations, Google reviewers asked El Mhamdi for substantial changes. He refused and released the paper through École Polytechnique.
He resigned from Google this year, citing in part “research censorship.” He said modern AI’s risks “highly exceeded” the benefits. “It’s premature deployment,” he added.
After ChatGPT’s release, Kent Walker, Google’s top lawyer, met with research and safety executives on the company’s powerful Advanced Technology Review Council. He told them that Sundar Pichai, Google’s CEO, was pushing hard to release Google’s AI.
Jen Gennai, the director of Google’s Responsible Innovation group, attended that meeting. She recalled what Walker had said to her own staff.
The meeting was “Kent talking at the ATRC execs, telling them, ‘This is the company priority,’” Gennai said in a recording that was reviewed by the Times. “‘What are your concerns? Let’s get in line.’”
Walker told attendees to fast-track AI projects, though some executives said they would maintain safety standards, Gennai said.
Her team had already documented concerns with chatbots: They could produce false information, hurt users who become emotionally attached to them and enable “tech-facilitated violence” through mass harassment online.
In March, two reviewers from Gennai’s team submitted their risk evaluation of Bard. They recommended blocking its imminent release, two people familiar with the process said. Despite safeguards, they believed the chatbot was not ready.
Gennai changed that document. She took out the recommendation and downplayed the severity of Bard’s risks, the people said.
Gennai said in an email to the Times that because Bard was an experiment, reviewers were not supposed to weigh in on whether to proceed. She said she “corrected inaccurate assumptions, and actually added more risks and harms that needed consideration.”
Google said it had released Bard as a limited experiment because of those debates, and Gennai said continuing training, guardrails and disclaimers made the chatbot safer.
Google released Bard to some users March 21. The company said it would soon integrate generative AI into its search engine.
Satya Nadella, Microsoft’s CEO, made a bet on generative AI in 2019 when Microsoft invested $1 billion in OpenAI. After deciding the technology was ready over the summer, Nadella pushed every Microsoft product team to adopt AI.
Microsoft had policies developed by its Office of Responsible AI, a team run by Crampton, but the guidelines were not consistently enforced or followed, said five current and former employees.
Despite having a “transparency” principle, ethics experts working on the chatbot were not given answers about what data OpenAI used to develop its systems, according to three people involved in the work. Some argued that integrating chatbots into a search engine was a particularly bad idea, given how it sometimes served up untrue details, a person with direct knowledge of the conversations said.
Crampton said experts across Microsoft worked on Bing, and key people had access to the training data. The company worked to make the chatbot more accurate by linking it to Bing search results, she added.
In the fall, Microsoft started breaking up what had been one of its largest technology ethics teams. The group, Ethics and Society, trained and consulted company product leaders to design and build responsibly. In October, most of its members were spun off to other groups, according to four people familiar with the team.
The remaining few joined daily meetings with the Bing team, racing to launch the chatbot. John Montgomery, an AI executive, told them in a December email that their work remained vital and that more teams “will also need our help.”
After the AI-powered Bing was introduced, the ethics team documented lingering concerns. Users could become too dependent on the tool. Inaccurate answers could mislead users. People could believe the chatbot, which uses an “I” and emojis, was human.
In mid-March, the team was laid off, an action that was first reported by the tech newsletter Platformer. But Crampton said hundreds of employees were still working on ethics efforts.
Microsoft has released new products every week, a frantic pace to fulfill plans that Nadella set in motion in the summer when he previewed OpenAI’s newest model.
He asked the chatbot to translate Persian poet Rumi into Urdu and then English. “It worked like a charm,” he said in a February interview. “Then I said, ‘God, this thing.’”
This article originally appeared in The New York Times.
Get more business news by signing up for our Economy Now newsletter.
Stay connected with us on social media platform for instant update click here to join our Twitter, & Facebook
We are now on Telegram. Click here to join our channel (@TechiUpdate) and stay updated with the latest Technology headlines.
For all the latest Business News Click Here
