Online
spiders or 'bots', 'crawl' or 'spider' the internet looking for links.
When they find a link, they follow it to wherever it goes and then (depending on their programming) either follow the links on the new page - or return to the previous page and look for other links to follow.
It's one of the ways the search engines keep track of things.