Ask HN: How do you go about managing your beta tests?

Say you've got a new version of your app coming out, but before you release you want to run a beta test to make sure there are no last minute bugs or usability problems.

What tools do you use? Are there any you'd recommend?