You don't protect civil rights by sacrificing them. Civil rights organizations like ACLU are strongly against this ban for that reason. The precedent it would set (beyond the immediate impact of rendering absolutely protected speech by millions inaccessible) would soon be weaponized against the most vulnerable.
Free speech doesn't exist in a vacuum, but it still matters.