While the CPAN process is quick and easy to publish modules and get code from the web, it still lacks an "uninstall" function. There are a number of ad-hoc tools that (attempt to) uninstall CPAN modules, but the package manager itself has only the install action [0].
Using the system package manager has worked much better for me.
[0]: http://stackoverflow.com/questions/2626449/how-can-i-de-inst...