I'm super super lucky with my GP. She seems to have an eidetic memory or something; she will say things like "I wouldn't normally recommend X but given your history of Y and that you're taking Z, I think it's appropriate".
(this is not calling you a liar; I've had waaaay too much healthcare in my life, and the majority are definitely the sort you describe. And I guess GPs are a different kind of thing in terms of having a long-term relationship with their patients.)