I think there is a difference between "being a bigot" and carrying out a bigoted act.
If a person who is constantly evil, happens to do a single isolated good act, would you say their a good person? No.
So someone who might be bigoted towards bigots in isolation, but is not generally bigoted towards people or groups as a pattern, then they would not be a bigot, by the same logic.