.Google.com's Gary Illyes exposes Googlebot collects web links rather than "following" them, opposing formal paperwork.Googlebot picks up links rather than following all of them in real-time.Gary Illyes discussed this details in Google.com's 'Look Off The Document' podcast.Google's documents negates the real spider actions.