The flaw in your logic is "what about dumb people?". Those ridgid rules aren't for people like yourself. You will torture yourself thinking of your misdeads and how they affect etc. You can correct your actions when given more information as to why things are done. The dumb ones need guardrails to keep them on the path. We are hubris to think we don't need religion.