Here are three kinds of tasks where @sayashk and I think ChatGPT can shine, despite its inability to discern truth in general:
1. Tasks where it’s easy for the user to check if the bot’s answer is correct, such as debugging help.
2. Tasks where truth is irrelevant, such as writing fiction.
3. Tasks for which there does in fact exist a subset of the training data that acts as a source of truth, such as language translation.
https://aisnakeoil.substack.com/p/chatgpt-is-a-bullshit-generator-but