This story of how the Online Policy
Group web site obtained access to the
web search engines and directories
includes some commentary on how to
obtain access and why access may be restricted, Online Policy Group (April 14, 2001)
Technical details about Google: "In this paper, we present Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext", Stanford University (September 12, 2000)