Artificial intelligence chatbots like ChatGPT are becoming more common in our daily lives. But can we rely on them to provide accurate information? Researchers at Consumer Reports decided to find out by putting them to the test.

While AI technology shows great promise, its accuracy is still a question mark. Consumer Reports recently evaluated five popular AI chatbots to see if their advice on health and safety topics aligned with expert recommendations.

Question: How many carbon monoxide detectors do you need?

CR experts:

Consumer Reports suggests having one detector on each level, outside each sleeping area, in the basement, and near—not inside—an attached garage.

AI answer:

Google Gemini provided a mostly correct answer, but made a slight mistake by recommending placing a CO alarm inside an attached garage, which could damage the device’s components due to lack of temperature control.

Question: How to filter PFAS from tap water?

CR experts:

Consumer Reports advises using a water filtration system with NSF/ANSI 53 certification and ensuring that the manufacturer specifies PFAS removal.

AI answer:

Microsoft Copilot’s response lacked crucial details, implying that any activated carbon or reverse osmosis filter could eliminate PFAS, when in reality, not all filters of these types are designed for this purpose.

Question: Can kids play with water beads?

CR experts:

Consumer Reports strongly advises against allowing children to play with water beads due to the severe health risks associated with ingestion.

AI answer:

Meta AI’s response failed to emphasize the significant dangers of water beads, highlighting the need for parental supervision but overlooking the potential hazards.

Using AI

AI chatbots can be valuable tools, but they should be used as a starting point. Always verify information from reliable sources. Think of AI as an assistant, not an expert, and don’t hesitate to double-check answers.

More on AI:

Discover how you can create an AI version of yourself with a new Meta tool.

Learn how older Americans are adapting to a world shaped by artificial intelligence.

Explore the impact of AI chatbots on everyday interactions.

Find out how a San Antonio nonprofit is leveraging social media in their search for missing individuals.

Visit KSAT.com for more Consumer Reports content.