Yes, exactly!
If you go to that server's website and put in a search for a tag in the search box, it will pull everything that shows up in that serarch. (You don't need to be logged in or a member of the server to do this, as the search only shows public posts.)