Or the Secret Service were shoo'ing them from a space they probably weren't permitted to be in to begin with, and it became push-comes-to-shove in lieu of possible escalating radio chatter about a suspicious person.
I believe it was less than a minute before the incident, is when a law enforcement officer climbed the ladder to the roof the shooter was at, had the rifle turned on them, and supposedly the officer ducked back down and could have radio'ed it in. I believe it was shortly after being discovered that the assailant suddenly rushed into committing their act.
Meanwhile, from the perspective of the agent behind the stage, it was probably getting into a "shit is getting really weird" situation, and probably then started enforcing control of the spaces where even the press shouldn't be lingering, especially if someone were to quickly weasel their way over the back fence, between the blob of press, and pull some unknown stunt. If the space behind the stage is clear, then it's easier to body someone to the ground if they leap the partition. While if it happens from the front, then everyone can see it and react faster.
I'm aware there were reports and indicators possibly up to even 30 minutes in advance of the incident, but meanwhile everyone else enforcing security only have the understanding solely from the location they're posted, and from potentially vague/cryptic details exchanged over radio. Only the sniper team on the top of the barn were those with a far more holistic vantage point of the situation, while the rest of the security were probably posted primarily around the stage and literally 'playing it by ear', with some of the reports seeming unusually surreal to be believed.
When you do security for an event and have to work with people that are terrible at describing something or bad at clearly enunciating their words (or the fact of some digital modes butcher the quality of the audio significantly, especially with the vocoder used in P25), it's another thing that can just add to the mess of inaction.
And to clarify: I'm not saying the security failure was excusable in any way; I'm just trying to give some first-person-like perspective to possibly contextualize it.