.Google's Gary Illyes discloses Googlebot gathers hyperlinks rather than "observing" all of them, negating official documents.Googlebot gathers hyperlinks as opposed to observing all of them in real-time.Gary Illyes discussed this information in Google's 'Search Off The Document' podcast.Google's information contradicts the actual crawler habits.