I am not a lawyer, but it's my understanding that the legal position depends on where you live. In some countries you may be responsible for everything they post.
It's probably better to start with a single person server to get used to the idea, then see how you feel. Some people open it just to friends, and others open it just to small numbers of strangers. Whatever you do, moderation will always be easier on smaller servers.