Josh Zumbrun / Wall Street Journal:
ChatGPT testing shows the chatbot struggles with basic arithmetic questions, confidently offering entertaining but wrong answers, an inherent problem with LLMs  —  ‘Large language models’ supply grammatically correct answers but struggle with calculations  —  Cheating With ChatGPT: Can an AI Chatbot Pass AP Lit?

Source From techmeme