The fact that cantor deleted the tweet shows he knew it could be taken racially. And yeah, “spade” was used as a derogatory term for blacks but the phrase predates that connotation. However, the phrase really is a “if it talks like a duck and walks like a duck” type of phrase.