I recently received an email and someone is claiming that I have 2000 links to his site. I have no URL links as such because I have searched the forums, so I understand what's left is that people might have dropped image links which are not showing up on the search function?

Ask if he is using google webmaster tools and if so, ask him to download the table for your links. It will give you the url's so you can find them.