@jeffowski Something similar could be said of many freedoms, such as free speech, which does not (or ought not) allow dangerous speech, incitement of violence, or libel.
In short, as a friend once said, your right to swing your fist ends at the tip of my nose.