My Documents:
find the Default.rdp file and delete it. You will need to have your settings adjusted to display hidden files (Tools>Folder Options>View Tab>check Show hidden files and folders)

Registry:
Start>Run>Regedit>OK
HKEY_CURRENT_USER\Software\Microsoft\Terminal Server Client\Default