Spiders are considered guests. So if you change the view permissions for guests to 0 in the subject forums they can't crawl them.
I know you said it is a non public forum but it sounds like you may be allowing them to view but not post. Try logging out and see if you can view the post as a guest.
Blue Man Group There is no such thing as stupid questions. Just stupid answers