While I spent an hour trying various non-working phone numbers and unsuccessfully trying to get Kaiser appointment services to reach my oncologist, I tried to message him through the KP app. It turns out that because he is a visiting fellow and not staff, this wasn't possible.
I eventually got through to the oncology department and had the appointment switched over.
24/