If you've used Google recently, you've noticed the AI overview popping up at the top of your searches.
The quick and convenient answers to your search queries offer to save you the time of scrolling through search results and clicking links to find the answer yourself.
How much can you really trust those AI summaries?
From just $107.88 $24.99 for Kiplinger Personal Finance
Be a smarter, better informed investor.
Sign up for Kiplinger’s Free Newsletters
Profit and prosper with the best of expert advice on investing, taxes, retirement, personal finance and more - straight to your e-mail.
Profit and prosper with the best of expert advice - straight to your e-mail.
According to a new study by Choice Mutual, not too much — at least, not when it comes to important financial topics.
"AI Overviews offer convenience, but their current accuracy for complex topics like life insurance and Medicare is unreliable," said Choice Mutual CEO Anthony Martin in an article on the study's results.
More than half the AI-generated responses to life insurance queries were deemed inaccurate by experts on the subject. While Medicare-related responses were accurate more often, the few times they weren't involved potentially harmful errors.
Here's a closer look at what the study found and why you shouldn't rely on AI no matter how convenient it is, along with some tips on how to use AI without getting duped by misleading information.
Google’s AI overview made mistakes that could cost you money
The Choice Mutual analysis included 1,000 common queries, 500 each on life insurance and Medicare. The AI overview (AIO) for each query was manually reviewed by experts on each topic to evaluate the accuracy of the AI-generated response.
Overall, the study found that 57% of AI responses on life insurance contained errors.
While Google's AI got more right when it came to Medicare, the 13% of responses that were wrong contained inaccurate information that could cost you if you took it at face value.
On life insurance, for example, the search term "life insurance for seniors over 85 no medical exam" returned an AI-generated response that included information about guaranteed issue life insurance — a type of life insurance policy that offers coverage regardless of health conditions.
However, the study's experts noted that this type of life insurance isn't offered to people over the age of 85.
In evaluating AIO's responses about Medicare, it was accurate more often. But the 13% of results that contained errors were dangerously inaccurate. For example, when searching "is it mandatory to sign up for Medicare at age 65," the AIO stated that you can delay enrollment without penalty if you still have health insurance through your (or your spouse's) employer.
While that's partly true, it only applies to large employers with more than 20 employees. If you work for a smaller company or are self-employed, you could face penalties for delaying Medicare enrollment. Taking Google's AI overview at face value could lead to financial losses.
Why even intelligent people can be fooled by AI
In addition to reaffirming the importance of fact checking AI, what this study also shows is how easy it can be for an AI response to fool even an intelligent user.
These responses look thorough, containing specific details and precise terminology that can make the answers feel complete if you don't happen to have industry expertise or firsthand knowledge of the topic you're searching.
In many cases, it's not immediately clear which aspects of a response might be wrong or warrant further research. According to Martin, this "directly contributes to consumers making poor insurance decisions based on the false information provided by Google’s AI answers."
One reason AI has taken off in the past couple of years has to do with large language models (LLMs), such as Google's Gemini, which powers the AI overviews you now see at the top of search pages. LLMs have a knack for sounding coherent and intelligent, even though it's technically just stringing words together based on mathematical probability.
There's no analytical thought or reasoning behind it. It's easy for us to assume there is because the words it's strung together do form complete, natural-sounding sentences.
However, when it comes to topics you're less familiar with or where the errors AI is making aren't as obvious, it's easy to be duped by the human-like prose it generates.
When it comes to such topics as life insurance or Medicare, many people searching Google for answers to their questions aren't experts on these topics. Moreover, insurance of any kind is a complex issue with lots of nuance that's easy for an LLM to brush over or miss entirely.
Tips for fact-checking AI
The biggest takeaway from the Choice Mutual study is that you shouldn't rely solely on AI to answer important questions.
"There are many nuances between various types of life and Medicare plans, so you want to turn to a veteran agent who has deep experience in working with these plans," said Martin.
You need real human expertise when it comes to questions that could impact your finances or health.
Here are a few tips for using AI without letting it mislead you:
- Ask follow-up questions. Break down the AI response into key points, then do a new search on the key points that matter to you. In that Medicare response mentioned above, for example, you might use that AI overview as a starting point, then Google employer coverage requirements for more in-depth (and credible) information on the subject.
- Check its sources. When you ask for sources, LLMs typically just provide links to pages for further reading, not necessarily the pages they actually referenced in generating the response. You can use these as your next step in the fact-checking process.
- Make sure more than one source can confirm the information. If you find a medical study confirming that coffee is good for you, for example, go back to your search and look for additional study results to make sure that wasn't a one-off before you start gulping down coffee by the gallon.
- For critical life decisions, find a human expert you can turn to with your questions. That might be a financial adviser, an insurance agent, a representative at your bank, your doctor or anyone else with verifiable credentials that you can trust.
Related content
-
A Comfortable Retirement is About More Than MoneyWhen it comes to a happy retirement, money can’t buy these things.
-
Four Ways a Massive Emergency Fund Can Hurt You More Than It HelpsSaving too much could mean you're missing opportunities to put your money to work. Redirect some of that money toward paying off debt, building retirement funds, fulfilling a dream or investing in higher-growth options.
-
Noctourism: The New Travel Trend For Your Next Trip"Noctourism" is a new trend of building travel and vacations around events and plans that take place at night. Take a look at some inspiring noctourism ideas.
-
Eight Tricks to Shop for Glasses if You're Over 50Shopping for glasses often gets trickier — and more expensive — as you age. If you've over 50, take these steps when you set out to buy a new pair.
-
My First $1 Million: Electric Utility Executive, 56, South CarolinaEver wonder how someone who's made a million dollars or more did it? Kiplinger's My First $1 Million series uncovers the answers.
-
How to Turn Amazon Prime Day Into a Travel WindfallDuring Amazon's Prime Big Deal Days sale, skip the fluff — here’s how to extract real travel value via gear, services and strategic credit cards.
-
Need a Reason to Retire Early? Consider These Eye-Opening StatsThe majority of people retire early, leaving the workforce before reaching their Full Retirement Age (FRA). Maybe you should, too.
-
Seven Things You Should Do Before 2026 Because of One Big Beautiful Bill ChangesThe new law ushers in significant changes for most taxpayers. Make these moves now to take advantage of them.
