• Discounts and special offers
  • Subscriber-only articles and interviews
  • Breaking news and trending topics

Already a subscriber?

By signing up, you accept Moneywise's Terms of Use, Subscription Agreement, and Privacy Policy.

Not interested ?

Top Stories
Confused man looking at his phone while holding a credit card. shutterstock.com

Should you trust a chatbot for credit card advice? New study finds AI leans on a handful of sites — and often picks the priciest cards

Despite warnings against relying on AI for financial (and other) advice, a growing number of Americans are comfortably turning to chatbots to tell them what to do with their assets.

Yet another analysis has shown the bias large language models tend to have, serving as another reminder to always apply a reasonable level of skepticism to their guidance, which can and often does come from a narrow group of sources.

Advertisement

The study, conducted by New York-based AI communications firm 5W and titled the Credit Cards AI Visibility Index, tested out prompts that consumers might use when researching which credit card is best suited to their money goals. And, in response to thousands of queries, it found that the most-utilized AI platforms drew from a very high concentration of websites — and often recommended some of the most expensive options as a result.

Read the best of Moneywise in 5 minutes or less.

By signing up, you accept Moneywise Terms of Use, Subscription Agreement, and Privacy Policy.

Blatant provider advertising isn’t vastly skewing recommendations — but other forms of marketing might be

As the company noted, credit cards are the most aggressively promoted financial products in the country, soaking up $20 billion of bank marketing budgets each year. However, the investigation found that “when American consumers ask AI engines which card to apply for, the answer is not supplied by the issuers” — so, answers were not heavily influenced by direct advertising — the same small pool of resources was used again and again to inform the suggestions the chatbots provided.

The bulk of citations in AI responses (60-65%) came from a small collection of sites, including The Points Guy, NerdWallet, Bankrate, CardRatings, WalletHub and Forbes Advisor.

While ChatGPT and others treated these sites as “default sources of truth” on the subject, 5W says, it’s not because they are inherently the most reliable, but because of factors like the volume of posts they have about credit cards, how often they publish new posts and the style their posts take (such as comparing different credit cards side by side).

The study also points out that many of these sites earn commission when readers sign up for a credit card, and they might choose to highlight more expensive cards as a result. Most sites that engage in affiliate marketing, including Moneywise, have policies that state commissions do not affect cards reviews and rankings.

Must Read

Join 250,000+ readers and get Moneywise’s best stories and exclusive interviews first — clear insights curated and delivered weekly. Subscribe now.

AI very likely to mention premium-fee cards and cite social media content

The data also showed that AI pointed to the priciest consumer cards more often than low or no-fee options; premium cards with fees over $400 per year were mentioned 5.7 times more than the alternatives.

Also interesting is that the second-largest bulk of citations came from the social media platform Reddit — an authentic source for testimonies, but not exactly an expert, nonpartisan or balanced one.

Further down the list of relevance, review aggregator sites comprised 8-12% of AI citations, while credit card issuers themselves made up 6%. Trusted regulatory bodies like Consumer Reports and the Federal Trade Commission made up only 2-3% of citations.

While the research is meant to help credit card companies better allocate their advertising efforts for such products, the results are also very informative for the consumer who assumes their favorite AI LLM can provide them with a truthful, well-informed and objective reply.

You May Also Like

Share this:
Becky Robertson Sr. Staff Reporter

Becky Robertson is a senior staff reporter at Moneywise and a lifelong writer. Along with more than a decade covering news at outlets like blogTO and Quill & Quire, she's attended writing residencies around the world. With 33 countries visited, she finds travel to be among her greatest inspirations.

more from Becky Robertson

Explore the latest

Disclaimer

The content provided on Moneywise is information to help users become financially literate. It is neither investment, tax nor legal advice, is not intended to be relied upon as a forecast, research or investment advice, and is not a recommendation, offer or solicitation to buy or sell any securities, enter into any loan, mortgage or insurance agreements or to adopt any investment strategy. Tax, investment and all other decisions should be made, as appropriate, only with guidance from a qualified professional. We make no representation or warranty of any kind, either express or implied, with respect to the data provided, the timeliness thereof, the results to be obtained by the use thereof or any other matter. Advertisers are not responsible for the content of this site, including any editorials or reviews that may appear on this site. For complete and current information on any advertiser product, please visit their website.

†Terms and Conditions apply.

Sign up free.

Join 250,000+ readers by activating your free account. Get our newsletter, a Warren Buffett investing guide, and commenting access on stories.

By signing up, you accept Moneywise Terms of Use, Subscription Agreement, and Privacy Policy.

Already signed up?