Problem

I was trying to learn how to create a custom Project Template and now I can't get rid of it!

Solution

Make sure all the .zip files for your Project Template have been deleted and run

devenv /setup

Explanation

Running devenv /setup will force Visual Studio to reset all the Project Templates and also get rid of old ones.