Spiders can only see items that a non-logged-in user can see. So if you log out and then start browsing your site, thats what a spider will see.
If a page that is linked in another section of your forum (or on another website) is linked to a "restricted area," the item displayed to them is "Sorry, you are not logged in or you don't have permission for that." for forums, or "You do not have access to the [AREA NAME]" for sections such as Search, User List, Calendar, etc...They are offered a log in prompt, but for anything other than a stock forum feature, there is no hint given to them about what the page is about or what content is on the page. Except obviously, whatever subject name is in the URL address if you are using "Spider-friendly URLs."
You can test this for yourself. Log in to your website with your account. Open two browser windows and load the same "Restricted" page on both. Then log out in window-1, and press refresh in window-2. What you see in window-2, is exactly what the spider sees.
Last edited by isaac; 05/06/2017 5:59 PM.
