Once I reach the second step where I want the solution of the math problem, very often, if not most of the time, it turns out that no one knows how to solve the math problem in the model.
Apple just exposed major cracks in AI's capabilities. See why LLMs still can't handle complex reasoning and what it means for your decision-making processes.
At this point, you might as well close down the AI chatbot and take out your calculator ... step in AI capability — symbol manipulation, through the use of abstract knowledge used in algebra ...