Why Does ChatGPT Think It Can Do Math