Colbert really did make him squirm a bit here. Almost thought he dropped his character for a few moments.