-8.8 C
Ottawa
Thursday, December 26, 2024

Google asks employees to rewrite Bard’s bad responses, says the A.I. ‘learns best by example’

Date:

Google CEO Sundar Pichai

Thank you for reading this post, don't forget to subscribe!

Getty Images

Google execs understand that the company’s artificial intelligence search tool Bard isn’t always accurate in how it responds to queries. At least some of the onus is falling on employees to fix the wrong answers.

Prabhakar Raghavan, Google’s vice president for search, asked staffers in an email on Wednesday to help the company make sure its new ChatGPT competitor gets answers right. The email, which CNBC viewed, included a link to a do’s and don’ts page with instructions on how employees should fix responses as they test Bard internally.

Staffers are encouraged to rewrite answers on topics they understand well.

“Bard learns best by example, so taking the time to rewrite a response thoughtfully will go a long way in helping us to improve the mode,” the document says.

Also on Wednesday, as CNBC reported earlier, CEO Sundar Pichai asked employees to spend two to four hours of their time on Bard, acknowledging that “this will be a long journey for everyone, across the field.” 

Raghavan echoed that sentiment.

“This is exciting technology but still in its early days,” Raghavan wrote. “We feel a great responsibility to get it right, and your participation in the dogfood will help accelerate the model’s training and test its load capacity (Not to mention, trying out Bard is actually quite fun!).”

Google unveiled its conversation technology last week, but a series of missteps around the announcement pushed the stock price down nearly 9%. Employees criticized Pichai for the mishaps, describing the rollout internally as “rushed,” “botched” and “comically short sighted.”

Read more about tech and crypto from CNBC Pro

To try and clean up the AI’s mistakes, company leaders are leaning on the knowledge of humans. At the top of the do’s and don’ts section, Google provides guidance for what to consider “before teaching Bard.”

Under do’s, Google instructs employees to keep responses “polite, casual and approachable.” It also says they should be “in first person,” and maintain an “unopinionated, neutral tone.”

For don’ts, employees are told not to stereotype and to “avoid making presumptions based on race, nationality, gender, age, religion, sexual orientation, political ideology, location, or similar categories.”

Also, “don’t describe Bard as a person, imply emotion, or claim to have human-like experiences,” the document says.

Google then says “keep it safe,” and instructs employees to give a “thumbs down” to answers that offer “legal, medical, financial advice” or are hateful and abusive.

“Don’t try to re-write it; our team will take it from there,” the document says.

To incentivize people in his organization to test Bard and provide feedback, Raghavan said contributors will earn a “Moma badge,” which appears on internal employee profiles. He said Google will invite the top 10 rewrite contributors from the Knowledge and Information organization, which Raghavan oversees, to a listening session. There they can “share their feedback live” to Raghavan and people working on Bard.

“A wholehearted thank you to the teams working hard on this behind the scenes,” Raghavan wrote.

Google didn’t immediately respond to a request for comment.

WATCH: AI race expected to bring flurry of M&A

A.I. race expected to bring flurry of M&A: Trachet CEO

know more

Popular

More like this
Related

Japan stocks rise as government reportedly set to propose record budget

Tokyo, JapanJackyenjoyphotography | Moment | Getty ImagesAsia-Pacific stocks were...

Asia’s year in review: Who had it good — and who had it bad — in 2024

This aerial picture shows flooded streets and buildings in...

Nvidia sees ‘remarkable’ influx of retail investor dollars as traders flock to AI darling

Jensen Huang, CEO of Nvidia, arrives for the Inaugural...

Alberta Premier Danielle Smith to attend inauguration of Donald Trump

CalgaryThe move comes in the wake of threats from Trump,...