The could go outside. The FBI didn't exist, but The U.S. Marshal's go back to founding. They could enforce federal law nation wide, but the scope of they're powers was limited by the local jurisdiction. They had the same power and authority as the local sheriff.