Philosophically that's supposed to be true. In practice, not so much.
For example, in NJ, if you're found in possession of a firearm, you are assumed to be in violation of this state's gun control laws unless you can prove that you acquired the gun in accordance with State laws.
