Conservatism is less racist than progressivism. The progressives were the eugenicists like HG Wells, quote:

‘We want fewer and better children … and we cannot make the social life and the world-peace we are determined to make, with the ill-bred, ill-trained swarms of inferior citizens that you inflict on us.”

That ghastly message appeared in the introduction to Margaret Sanger’s 1922 book, The Pivot of Civilization.