Yes uninstalling the application is not enough. Even if you uninstall a certain program there are still some files that will remain on your computer, those leftovers can sometimes cause problems when you install any newer or older version of that application. what you can do is to find and manually delete or the remaining files on your computer especially on your registry.
There is an easy way to do this. download uninstaller programs. Google it you will find lots of them, some are free but most are paid programs. It can help you clean all leftovers including registry entries when you uninstall any program.
I recommend
Your Uninstaller but if you are looking for free but reliable apps you can try these two programs.
Free Uninstaller Download
Download Revo Uninstaller Freeware - Free and Full Download