"The point to remember is that what the government gives it must first take away."