One would think security notices a person that keeps hanging around the location they're protecting. It's not like this guy had a dozen different cars, etc.

The only possible non-insider explanation would be if he had some wantage point a bit further away and he was observing from there with binoculars. In that case why was such an obvious perch not checked by security?