• Discounts and special offers
  • Subscriber-only articles and interviews
  • Breaking news and trending topics

Already a subscriber?

By signing up, you accept Moneywise's Terms of Use, Subscription Agreement, and Privacy Policy.

Not interested ?

1. Risk to data privacy and security

AI tools like ChatGPT have been trained on extensive amounts of data. In order to keep learning, these tools need more and more data to train on, some of which can be derived from the inputs of its users.

This means professionals who use AI tools may be at risk of exposing sensitive company data, private information, regulated content or data that could breach a non-disclosure agreement to whoever runs these AI programs.

It’s one of the reasons Apple, for example, has restricted its employees from using ChatGPT and other AI tools such as GitHub Copilot, according to the Wall Street Journal, citing an internal document. ChatGPT was created by Microsoft-backed OpenAI, and Microsoft owns AI-based coding program GitHub Copilot.

Don't miss

2. Potential for bias in AI decision making

It’s possible for human biases to be baked into AI models, especially if the underlying training data is biased. These tools were created by humans, after all.

One example of this came to light in 2018 when Reuters revealed that Amazon had scrapped a secret AI recruiting tool that was found to be biased heavily in favor of hiring men over women to fill tech jobs. The company’s AI model was apparently trained to vet applicants based on patterns in resumes submitted to the company over a decade-long period. Most resumes came from men — a reflection of the male-dominated tech industry — which led to Amazon’s system teaching itself male candidates were preferable.

There have been a number of instances of human bias on display in AI, and with that in mind professionals should be cautious about using AI platforms that are not transparent about where the training data was sourced from or how the models are structured.

3. Hallucinations problem

Large Language Models, the breakthrough technology powering AI platforms like ChatGPT, are designed to predict the next word or phrase after a series of words in context. These systems, however, are typically geared toward mimicking natural language and are not necessarily designed to be accurate, which at times has resulted in questionable content. Just ask our two lawyer friends at the beginning of this article.

This issue is so common that AI researchers have even coined a term for it: AI hallucinations. The problem has also created legal trouble for OpenAI. The firm was hit with a defamation lawsuit from a Georgia radio host who says the ChatGPT platform falsely claimed he embezzled money.

What to read next

About the Author

Vishesh Raisinghani

Vishesh Raisinghani

Freelance Writer

Vishesh Raisinghani is a freelance contributor at MoneyWise. He has been writing about financial markets and economics since 2014 - having covered family offices, private equity, real estate, cryptocurrencies, and tech stocks over that period. His work has appeared in Seeking Alpha, Motley Fool Canada, Motley Fool UK, Mergers & Acquisitions, National Post, Financial Post, and Yahoo Canada.

What to Read Next

Disclaimer

The content provided on Moneywise is information to help users become financially literate. It is neither tax nor legal advice, is not intended to be relied upon as a forecast, research or investment advice, and is not a recommendation, offer or solicitation to buy or sell any securities or to adopt any investment strategy. Tax, investment and all other decisions should be made, as appropriate, only with guidance from a qualified professional. We make no representation or warranty of any kind, either express or implied, with respect to the data provided, the timeliness thereof, the results to be obtained by the use thereof or any other matter.