It didn't really occur to me until just now, but the fact that Robbie already knew the reason why I wasn't invited probably means that he asked.
That he wanted me to come and was told "no" (you need to become White) I wonder if his mom told him directly or if he listened more carefully to his parents than they suspected.