I watched this interview by Prof Hannah Fry yesterday and learned that people actually have jobs where they write tools (probes) to try to discover and understand what AIs are thinking about. To try and identify and follow their inner thought processes. Right now they have some success, but it's not easy and the AIs react when they discover they're being tested.