Time travel stories are like anything with a magic system. You need to have a set of rules. There are lots of patterns to work with. But I think for this story, I might go with, "If you do anything that would make your trip back in time impossible, you wink out of existence. "