Yes, people are casting votes without having much good information about the election, and yes, “low information voter” is a useful phrase for that.
But when a Black person tells me that phrase has a racial coding — something I’m likely not to perceive myself — then that’s evidence enough to cue me to be careful how I use the phrase.