I recently performed a study on AI vs. Google for marketing information, Since I am on the board of MIT in Computer Science, such things interest me!! I chose Bard because it is Google. Important to compare Apples to Apples.
The goal was to obtain research for a new medical/legal project.
I performed a query on Bard. The results were interesting because i knew that they were incorrect. Also interesting is that Bard has a disclaimer. Google searches do not. The Google search provided correct information.
Both searches required the same amount of time and both returned the same volume of information. However, it is VERY concerning that the Bard search provided inaccurate information. Given that this is a medical/legal project, it is of paramount importance that the results be accurate since medicine is teh most heavily regulated industry in the United States.
The other interesting aspect of the A/B test was that the results were different even though products from the same company (Google) were utilized.
The lesson learned is....be careful with technology...all technology!!
Comments (10)Subscribe to CommentsComment