It can be (and has been for some laws) done. In the past, it's been done by including "sunset provisions" in the law itself, where the law must be periodically confirmed by a new vote or it automatically ceases to have force of law.

It would also be legally possible to create a law that places sunset provisions on all subsequent laws. I have been in favor of this approach for a very long time. Practically, it's not going to happen, though.