“The connection between libertarianism and race dates back to 1964. After he had the Republican presidential nomination, Barry Goldwater (himself no racist) voted against the Civil Rights Act on libertarian grounds: In a speech co-authored by future Supreme Court Chief Justice William Rehnquist, he said that “the freedom to associate means the same thing as the freedom not to associate.” In so doing, he transformed the Republican coalition. Eisenhower had gotten about 40 percent of the Black vote in 1956; Nixon in 1960, about a third; Goldwater, 6 percent. Goldwater was the first Republican ever to win in Georgia and the first since Reconstruction to carry Alabama, Mississippi and South Carolina. Richard Nixon’s eagerness to woo the voters who had supported George Wallace in 1968 consolidated the racial polarization of American politics.”
https://thehill.com/opinion/civil-rights/3680007-the-libertarian-party-is-collapsing-heres-why/