As you suspect the problem is in your home folder
It's in either of .gconf, .gconfd or one of the .gnome folders
If you don't find it post back
I have changed too much so I can't get the original panel back.
Remove the panel (right click >>) and then add a new panel and add what you want there