The government, as a group representing its citizens (theoretically), has the right to collectivize.

You have the right to be an individual but that does not supercede the right of everyone else to work together.