I always thought that these rights exist by mutual consent: if we wish to exercise them ourselves, we cannot deny them to others.
Which makes it an important bit of strategy to make people feel cowed and unwilling to assert their own rights voluntarily before then seeking to actively take them away from others who might try to defend them.