Results of a Marketing A/B Test of Google vs Bard (AI)

Real Estate Attorney with

I recently performed a study on AI vs. Google for marketing information, Since I am on the board of MIT in Computer Science, such things interest me!!  I chose Bard because it is Google. Important to compare Apples to Apples. 

The goal was to obtain research for a new medical/legal project.

I performed a query on Bard. The results were interesting because i knew that they were incorrect. Also interesting is that Bard has a disclaimer. Google searches do not. The Google search provided correct information. 

Both searches required the same amount of time and both returned the same volume of information. However, it is VERY concerning that the Bard search provided inaccurate information. Given that this is a medical/legal project, it is of paramount importance that the results be accurate since medicine is teh most heavily regulated industry in the United States.

The other interesting aspect of the A/B test was that the results were different even though products from the same company (Google) were utilized. 

The lesson learned careful with technology...all technology!!

Comments (10)

Charles Ross - eXp Realty LLC
eXp Realty LLC Salina Group - Salina, KS
Love To Help People

Excellent information. Thank you for sharing. Have a wonderful day and a blessed week.

May 01, 2023 01:13 AM
Kat Palmiotti
406-270-3667,, Broker/REALTOR® - Kalispell, MT
Helping your Montana dreams take root

I agree about the need to be very careful with trusting the results of any of these AI tools.

May 01, 2023 05:46 AM
Kathleen Daniels, Probate & Trust Specialist
KD Realty - 408.972.1822 - San Jose, CA
Probate Real Estate Services

I have heard from many people that BARD is biased. I am not surprised that it gave misinformation.  

May 01, 2023 01:12 PM
Paddy Deighan MBA JD PhD - Vail, CO
Paddy Deighan J.D. Ph.D

Kathleen, all AI is biased . It maintains any bias that the programmer may have  

May 01, 2023 01:38 PM
Marte Cliff
Marte Cliff Copywriting - Priest River, ID
Your real estate writer

Interesting, and i definitely agree with your conclusion: Be careful!

May 01, 2023 08:20 PM
Brian DeYoung
also affiliated with Berkshire Hathaway Home Services Heritage Realty - Ithaca, NY
The Realtor with personal investment background

AI is coming, it is here. And the sources any of  you buy leads from can afford to program it so they can sell you more leads. Love it or hate it, educate others on the dangers. 

They will get to buyers and sellers  before you, because they can buy the clues in the publics email.

And make more calls than any of us.


May 01, 2023 09:43 PM
Jan Green - Scottsdale, AZ
Value Added Service, 602-620-2699 - Scottsdale, AZ
HomeSmart Elite Group, REALTOR®, EcoBroker, GREEN

Wow!  A very important distinction between the searches.  Makes me a bit nervous!

May 01, 2023 09:56 PM
Mary Hutchison, SRES, ABR
Better Homes and Gardens Real Estate-Kansas City Homes - Kansas City, MO
Experienced Agent in Kansas City Metro area

Have to admit, I'm very frightened of what AI will do after living through the social media revolution.  Some of it will be very helpful, much of it will be used for evil and misleading purposes.

May 02, 2023 08:39 AM
Lyn Sims
Schaumburg, IL
Real Estate Broker Retired

Nice of you to share your findings on the A/B test. Most people are also finding incorrect or conflicting info on their searches.

May 02, 2023 09:04 AM
Diana Dahlberg
1 Month Realty - Pleasant Prairie, WI
Real Estate in Kenosha, WI since 1994 262-308-3563

Thanks for your post ... I agree, we must be careful with all technology.  

May 03, 2023 08:58 AM