If you ever need to completely remove Xcode due to application issues or future upgrades, you can run a single command from Terminal to remove it.
sudo /Developer/Library/uninstall-devtools --mode=all
Of course, /Developer is dependant on where you installed Xcode to.