Even if bigotry were genetically determined (which I don’t believe for a second), it still wouldn’t be wrong to be prejudiced against bigots. It would be an immutable characteristic, true, but unlike skin color or sexual orientation that characteristic would actually define moral qualities of a person.