Internet Guide Logo

Internet Guide (iG) - Established: 2002

bullet News

bullet 1st of October, 2016: ICANN freed from U.S. government oversight: The United States Department of Commerce (DOC) has signed an agreement to end it's 19 year oversight of ICANN.

bullet Latest Terms

bullet Aaron Swartz: Was an American computer programmer and Internet activist.
bullet Dot Com Bubble: Speculative bubble - in stocks related to the Internet - that lasted until 2000.
bullet E. Feinler: Member of the Internet Hall of Fame, former director of the NIC.
bullet Internet of things (IoT): Term referring to the inter-working of physical items.
bullet Root zone file: The DNS root zone file is a small data set file (2,232,320 bytes).
bullet Root name servers: The root servers serve the root zone of the Domain Name System.
bullet TLD Managers: Organisations who manage, operate, administrate Top Level Domains (TLDs).
bullet World Wide Web Wanderer: One of the earliest web crawlers.

bullet Introduction

The Internet is a loosely-organised collaboration of computer networks that voluntarily communicate and interconnect via open procedures and protocols defined by Internet Standards. The Internet Protocol Suite (TCP/IP) consists of the core communications protocols that are used by these computer networks to interconnect, and become Interconnected Networks. During the development of TCP/IP (1974), Carl Sunshine, Vinton Cerf and Yogen Dalal coined the term 'Internet' in RFC 675. The most important protocol of the Internet Protocol Suite is the Internet Protocol (IP): it creates a datagram format and numbering (address) system that enables packet-switching networks to interconnect. No single individual is credited with inventing the Internet, but a small group of individuals, named the 'Internet Pioneers', are credited with designing the core technical architecture of the Internet in the 1970s and 1980s. While there has been other terms used to describe the Internet - Cyberspace and the Information Superhighway - the Internet is the name that has stuck. In 1995, the Federal Networking Council - a group composed of members from the DoD, NSF and NASA (US organisations) - passed a resolution that defined the Internet as:

Federal Networking council statement

bullet Developing and managing the Internet

bullet Introduction

From 1966-1992, the U.S. government funded the development of the Internet through a variety of federal agencies. The first wide area network, funded by ARPA, was ARPANET. During the 1980s more federal computer networks were created - NSFNET, MILNET, EFNET - and when these federal networks interconnected in the 1980s, they became known as the Internet: Interconnected Networks. The software systems (protocols) developed to make these networks operational, were likewise, funded by the U.S. federal government. The creation of TCP/IP was funded by DARPA in the 1970s. TCP/IP became a defense standard in 1982, and was implemented on the majority of federally funded computer networks in the 1980s.

DARPA decided that a central authority was needed to continue the development of TCP/IP. In 1983, the Internet Activities Board (IAB) was created by DARPA for this specific purpose. By 1987, the IAB had created the Internet Engineering Task Force (IETF) and the Internet Research Task Force (IRTF). The software systems (protocols) of the Internet, by their nature, produced information resources that needed to be managed. The most obvious information resource that needed to be managed was Internet numbers. Every device that connected to the Internet was assigned a number (IP) and the way in which numbers were assigned needed management. Groups, like IANA and NIC, were created to conduct this management.

Due to the success and popularity of federally funded computer networks, like NSFNET, commercially funded U.S. networks wanted to connect to the Internet. At the same time, more and more international networks, like NORDUNET, had connected to the Internet. By the late 1980s, it became obvious that a federally funded Internet would not work for two reasons:

1) The political issues created by allowing commercial companies to profit from being connected to a federally funded Internet backbone.
2) The demand from international and commercial networks wishing to interconnect, and have a 'voice' in the development of the Internet.

In the early 1990s, the U.S. government decided that the Internet backbone network should be comprised of autonomous commercial computer networks, and the development and management of its protocols and information resources should be administered by international multi stakeholder non-profit organisations.

bullet Internet protocol development

In 1992, the Internet Society (ISOC) was created - as a non-profit organisation - to provide leadership for Internet: development, governance, policy and technology. The Internet Society's membership is international in scope, and it's development process is open and aims to be of "benefit to all people throughout the world". The development of Internet Standards is outlined in RFC 1336:

How organisations manage the resources of the Internet in RFC 1336

In 1992, the Internet Society replaced DARPA and NSF (National Science Foundation) by providing leadership and a legal standing for the Internet Architecture Board (IAB) and the Internet Engineering Task Force (IETF). In 1983, the IAB had been created by DARPA to manage the evolution of TCP/IP, but it had been operating with 'little in the way' of legal protection from vendors. The core protocols (TCP and IP) of the Internet evolved to become the Internet protocol suite, and it is currently managed by the following organisations (listed below in their hierarchy).

  1. Internet Society (ISOC)
  2. Internet Architecture Board (IAB)
  3. Internet Engineering Steering Group (IESG)
  4. Internet Engineering Task Force (IETF)
  5. Internet Research Steering Group (IRSG)
  6. Internet Research Task Force (IRTF)

The Internet Society (ISOC) provides overall leadership, policy and potentially finance. The Internet Architecture Board (IAB) provides the planning and oversight for the organisations who conduct the research and technical development of the Internet. Internet standards are documented in Request for Comments (RFC) documents. RFC documents predate the Internet: it was a document system created during the development of ARPANET. The Internet Society (ISOC) has ensured that the term 'Internet' is free to use and is not trademarked. The Internet Society administrates an award scheme named the Internet Hall of Fame.

bullet Internet namespace management

Alongside the development of Internet Standards (protocols), another resource that needs to be managed is Internet numbers. Each device that connects to the Internet is assigned an IP address: which is a 32-bit number (IPv4) or 128-bit number (IPv6). How IP numbers are assigned is governed by ICANN; who were under-contract to the United States Department of Commerce. IANA is a department within ICANN that authorises the assignment of IP number blocks. IANA provides a block of IP numbers to five Regional Internet Registries (RIR) - ARIN, LACNIC, AFRINIC, RIPE NCC, APNIC - who then provide smaller blocks of IP numbers to network operators within their region.

Alongside assigning IP numbers, ICANN, and by extension, IANA, maintain ultimate authority over the Domain Name System. IANA manages the DNS root zone, which is served by thirteen root name servers that have information provided by IANA. IP number blocks and the Domain Name System are the 'heart' of the address system of the Internet; referred to as the Internet namespace. The U.S. government has been criticised for maintaining authority over the namespace of the Internet (ICANN was under contract to the U.S. Department of Commerce). However, on the 1st of October 2016, ICANN was freed from U.S. government oversight - ICANN will still be based in California. The removal of DOC oversight of ICANN marks a significant transition: the Internet was effectively governed by the U.S. government, but it is now to be governed by an international multi-stakeholder arrangement.

The transition from U.S. government oversight will be welcomed by many; the UN (United Nations) had previously formed a Working Group to discuss Internet Governance (WGIG), with the aim of increasing the influence other countries have in the governance of the Internet. Russia, Iran, China, India, France and Brazil have been focal critics of ICANN and the U.S. governments previous oversight of it. When the Edward Snowden leaks (2013) alleged that DNS data was being spyed on by the NSA, the aforementioned nations demanded that control of the Internet's namespace should be passed to an organisation like the International Telecommunications Union; an affiliate union of the United Nations. The final resolution of the NetMundial Initiative (2014) suggested that the oversight of ICANN should be transferred to an international organisation. ICANN, W3C, ISOC, and the IETF have previously signed statements urging the U.S. government to decrease its control of the Internet.

An interesting paper that focused upon the government of the Internet is: A Declaration of the Independence of Cyberspace.

bullet Internet History

bullet Origins

The origins of how the Internet came to be are complex, while ARPANET is identified as the computer network that evolved into the Internet, the scientists who inspired the scientists who built ARPANET are harder to identify. In 1948, Claude Shannon wrote an article titled "A Mathematical Theory of Communication", he is credited as being the 'father' of information theory; while at MIT, he taught Ivan Sutherland, who would later install one of the first ARPANET nodes. Vannevar Bush and his proposed Memex automatic information management system - outlined in an Atlantic Daily article titled 'As We May Think' in 1945 - is often credited with inspiring budding American research scientists. In the 1960s, Marshall McLuhan envisioned a 'global village' that would be achieved through the use of advanced electronics.

Probably the man most cited by the scientists who built ARPANET, as inspiring them to build the network and outlining its structure, is Joseph "Lick" Licklider. While working at MIT in the 1950s, Licklider was involved in the SAGE program: a radar defense system that linked radar site across the United States through a phone line network. Early papers that Licklider published - that inspired the men who built ARPANET, Bob Taylor et al - included "Man-Computer Symbiosis" and "On-Line Man Computer Communication" (co-authored with Welden Clark). Licklider also published the book "Libraries of the Future" and a later paper named "The Computer as a Communication Device" (co-authored with Bob Taylor). Probably the most important memo / paper Licklider wrote, and certainly the one cited the most, is "Members and Affiliates of the Intergalactic Computer Network", which outlined his idea of a 'Galactic Network'.

What is without question, is that the origins of the Internet are intertwined with the development of packet switching. Packet switching is a method of transmitting data - in blocks of data called packets - across digital networks. Paul Baran and Donald Davies independently developed the theory of packet switching: Baran published his paper before (1964) Davies (1966). The three papers listed below influenced or outlined the development of packet switching.

  1. Donald Davies: working at the National Physical Laboratory published a paper "A Digital Communications Network For Computers".
  2. Paul Baran: whilst working at the RAND Corporation (United States) published a paper "On Distributed Communications Networks".
  3. Leonard Kleinrock: published a paper "Information Flow in Large Communication Nets".

It is generally accepted that it was the work of Donald Davies that provided the term "packet" and the term was adopted by the scientists who built ARPANET. One of the first working examples of packet switching was demonstrated by the National Physical Laboratory (United Kingdom) in early 1968. This work eventually evolved into the NPL Mark I computer network (based in the UK). This network influenced computer scientists in the United States, but Mark I did not evolve into the Internet. It was ARPANET (U.S. packet switching computer network) that eventually evolved to become the 'parent' of the Internet. Later packet switching networks, like CYCLADES (1973), influenced the design of TCP/IP, with CYCLADES inventing the use of datagrams (best effort unreliable data transmission). Some other computer networks which may have had a minor influence upon the design of the Internet include: Societe lnternationale de Telecommunications Aeronautiques (SITAnet), European Informatics Network (EIN), TYMNET, and RCP (Reseau a Commutation par Paquets).

bullet ARPANET era

In 1962, Joseph Licklider, having previously worked at MIT on the SAGE program, was hired as the director of the Information Processing Techniques Office (IPTO) at the Advanced Research Projects Agency (ARPA). Licklider was replaced as director of the IPTO by Ivan Sutherland in 1964 and Bob Taylor in 1966; however, he managed to persuade both men of the potential of a wide area computer network. In 1965, Ivan Sutherland contracted Thomas Marill and Lawrence Roberts to build an experimental computer connect: this experiment proved a success and would lead to further more expansive experiments. In 1966, Robert Taylor, building upon Marill's and Robert's experiment, created a blueprint for a 'wide area' computer network and persuaded Lawrence Roberts to join DARPA and help him build it. Robert Taylor received $1 million in funding from ARPA's director, Charles Herzfeld, to build ARPANET (1966-1968).

ARPANET was one of the first computer networks to use packet switching and was launched in 1969; with procurement initiated in the summer of 1968. The physical hardware of ARPANET was built by Bolt, Beranek and Newman technologies; who developed the Interface Message Processor (IMP) (router) for ARPANET. This technology was outlined in the first ever RFC document (RFC 1). The first IMP was delivered to UCLA, and the team involved in its installation included: Vint Cerf, Bill Naylor, Jon Postel, Steve Crocker, and Mike Wingfield. Messages were sent between the IMP and the SDS Sigma 7, creating the first ARPANET node.

The first ARPANET connection was made between two nodes: SRI International (overseen by Douglas Engelbart) and UCLA (overseen by Leonard Kleinrock). Leonard Kleinrock had conducted early research into a mathematical study called 'queueing theory'. Queueing theory proved important in implementing packet switching into ARPANET. The first message sent on ARPANET was sent on the 29th of October 1969. ARPANET initially operated with four nodes - each was installed with an identical Interface Message Processor (IMP). The four locations were: UCLA, SRI, UCSB and the University of Utah. By 1972, there was over 20 IMPs connected to ARPANET. In 1973, ARPANET was connected to its first two international nodes: NORSAR in Norway, and the University College of London (United Kingdom).

ARPANET initially used the NCP (Network Control Program) to transport data packets across the network. NCP was devised by Larry Roberts, Stephen D. Crocker, and a team of graduate students. Stephen D. Crocker said that NCP was not created according to a 'grand plan' but largely occurred accidentally. It was during the design process of the ARPANET protocols, that it was concluded that an official document system was needed: which would become Request for Comments (RFC). The Defense Communication Agency (DCA) took control of ARPANET in 1975; ARPANET was fully operational, and ARPA's remit was the development of systems, not the management of them. In the 1980s, the DCA would split ARPANET into a military and an academic research network.

DARPA (ARPA was renamed) continued to fund the development of a new networking protocol that would improve the efficiency of adding new nodes to the network. TCP/IP was the result, it became a defence standard by 1980 and replaced NCP on the ARPANET on the 1st of January 1983. This day is commonly referred to as 'the day the Internet was born'. ARPANET was phased out from 1985-1989, due to the creation of NSFNET and the Federal Internet Exchange (FIX).

bullet CSNET era

The National Science Foundation helped to fund the development of CSNET (Computer Science Network); beginning in 1979 and finalising the project by 1981. The purpose of CSNET was to expand network access to science departments at U.S. educational institutions. Due to the Defense Communication Agency (DCA) desire to phase out it's support for the ARPANET network, it was clear that universities in the U.S. would have to fund a computer network through another means. Side note: the computer network JANET would connect universities in the United Kingdom. Most universities in the U.S. had not been connected to ARPANET because they had not been involved in research related to the Department of Defense; who had funded its development.

Larry Landweber, a Professor Emeritus of Computer Science at the University of Wisconsin-Madison, proposed the creation of CSNET to connect U.S. universities who were not connected to ARPANET. Seed funding for the project was provided by the National Science Foundation. With support from a range of government departments, Landweber had acquired millions of dollars to fund a new network by 1980. The first universities connected to the network were: Wisconsin-Madison, Princeton, Purdue, and Delaware. By the end of 1983 there was over seventy sites connected to the network. By 1984, Vint Cerf had organised a gateway between CSNET and the ARPANET - TCP/IP being the protocol used to facilitate it - and by 1985 a number of international sites had connected to CSNET.

In 1988, CSNET merged with BITNET, but, due to the success of NSFNET, the network was shutdown in 1991.

bullet NSFNET era

In 1985, the National Science Foundation funded the creation of NSFNET: NSFNET would expand upon the capabilities of CSNET, and would use TCP/IP. Dennis Jennings was hired by the NSF to build NSFNET in 1985. NSFNET was operational in 1986, with six supercomputer centers forming its backbone. NSFNET was based on a three-tier model: 1) backbone; 2) regional networks; 3) campus networks. This three-tier model was important, as it would evolve to become the modern day Internet. From 1987-1991, the speed of the NSFNET backbone was increased from 56 K-bit/sec to a 45-Mbit/s. In 1987, NSF had given Merit, IBM, and MCI a five-year contract to upgrade the infrastructure of the NSF backbone. NSFNET was connected to regional networks, like MIDnet, and federal agency networks, like MILNET, and by 1992 it was connected to over 5000 computer networks. By 1988-1990, it was clear that the NSFNET backbone had become the Internet's backbone, and had become a 'network of networks'.

NSFNET was government funded. Commercial use of the backbone of NSFNET was prohibited, but commercial companies could access the network under an 'acceptable use policy'. NSFNET was far from being "open" to commercial organisations. In 1991, the Commercial Internet Exchange (CIX) was created by three networks (using TCP/IP) to freely exchange commercial traffic across their networks. In 1991, Merit, IBM, and MCI created a commercial Internet Service Provider named ANS CO+RE. ANS CO+RE was able to use the NSFNET backbone infrastructure: due to it position of having designed the infrastructure, and it's apparent 'cosy' relationship with the NSF. ANS CO+RE refused to interconnect with the Commercial Internet Exchange (CIX).

The controversy of ANS CO+RE - where a federally funded project was being using for commercial profit - would lead to the decommissioning of NSFNET. It was decided that the Internet would not be a single federally funded system, but would be comprised of commercial networks that voluntarily interconnected; similar to the CIX model. Network Access Points (NAPs) were created in 1991 to replace the NSFNET backbone. NAPs would exchange data between commercial backbone networks. The four original NAP's were: Ameritech, MFS Datanet, Sprint, and Pacific Bell. Network Access Points were only a strategic 'stepping stone'. NAPs were eventually replaced by Internet Exchange Points. NSFNET was decommissioned on the 30th of April 1995.

bullet Internet era

NSFNET was U.S. government sponsored, and it's supercomputer infrastructure formed the backbone of the Internet. NSFNET did not have a commercial focus, and it was decided by the U.S. government to transition the Internet from being dominated by the NSFNET backbone to a commercial backbone. The National Information Infrastructure (NII) was a document that was a product of the High Performance Computing Act of 1991. This document defined the creation of Network Access Points (NAPs), which would replace the NSFNET backbone for exchanging data across the networks of the Internet. NAPS were eventually replaced by Internet Exchange Points (IXP): IXPs are commercial companies who provide the (present day) physical infrastructure that exchanges traffic between Internet networks. IXPs are a crucial aspect of the current Internet backbone: allowing networks to reduce their upstream transit costs and faults. The Internet is an informal system where networks - using the Internet protocol suite - voluntarily agree to interconnect and exchange data across their networks. IXPs facilitate this exchange of data. However, not all networks use IXPs. The networks which comprise the Internet are broadly categorised in a three tier hierarchy.

  1. Tier One: typically long-distance international telecom companies.
  2. Tier Two: typically large regional Internet Service Providers.
  3. Tier Three: small ISPs who pay for upstream transit from Tier Two networks.

Tier one, two and three networks create 'interconnect agreements' with one another: these agreements decide how data is transferred and routed on the Internet. There are two types of interconnect agreement: 1) Transit agreement: data transfer is paid for, 2) Peering agreement: data transfer is free. Tier one networks tend to be telecom companies who own national and international fiber optic trunk lines. The data routes of the Internet are similar to the thoroughfares of a country: motorways are the primary route that cars travel upon, and likewise, tier one networks are the primary route that data travels upon the Internet. Tier one networks typically connect to the entirety of the Internet via peering agreements, and do not pay for their access (transit of data). Some recognised 'tier one' networks are: AT&T, Verizon, and Sprint.

Tier two networks are Internet networks that have to pay for upstream transit of data (access to tier one networks). Tier two networks use Internet Exchange Points (IXP) to reduce their upstream transit costs and faults, and to improve latency and bandwidth. Internet Exchange Points use the Border Gateway Protocol (BGP) to exchange data across networks. Some examples of tier two networks are: BT, Deutsche Telekom and France Telecom. Finally, we have tier three networks: these networks pay for upstream data transit from tier two networks. Tier three networks can be 'standalone' single-homed networks, or can be multihomed networks. Multihoming is where a tier three network purchases upstream access from multiple 'tier two' networks: this helps to improve the reliability of their service: in the scenario of a (SPOF) single point of failure.

At the bottom of the hierarchy is the end user, also referred to as a subscriber: subscribers typically have to pay a fee to access the above networks and transmit data across them. End-users can be subscribers to either tier 1, 2 or 3 networks; most end-users will have no idea which type of network they are subscribing to.

bullet Internet History: UK and Continental Europe

The development of the protocols (IP and TCP) of the Internet was funded by the U.S. Department of Defense, therefore, a certain level of scepticism and mistrust existed within European governments about their own networks adopting TCP/IP. Europeans tended to favour networking standards they had more influence upon. This scepticism potentially has some merit: the recent Edward Snowden leaks disclosed vast court-approved NSA spying powers; VeriSign has stated it complied with "lawful orders" from the U.S. courts to redirect DNS data to a government IP address.

The North American ARPANET computer network was being developed in the early 1970s, Donald Davies, as head of the UK's NPL Network, had to decline an offer from Larry Roberts (ARPANET) to interconnect their networks. This was due to the European computer network initiative - the UK at the time wanted to join the EU - and Davies had to focus on European research projects in favour of a North American project. However, in 1971, ARPANET did manage to connect to a UK node: UCL (University College of London); at a speed of 9.6 Kbps. By 1975, the UCL link was being used by a number of Ministry of Defense (UK) installations. The UCL link was also used to test TCP/IP in the mid-1970's: sending data packets via radio from a car travelling across the Golden Gate Bridge in San Francisco to a terminal at the Royal Radar Establishment in Malvern. UCL scholars, Paal Spilling and Peter Kirstein, played an important role in the development of TCP/IP, and Kirstein is often referred to as a 'founding father of the European Internet'. Kirstein has commented that a UK government agency asked him to stop working on TCP/IP and focus on an international network standard, but he refused.

In the 1970s, European efforts to connect to ARPANET were less successful than the UK's: with French and German government agencies preferring to fund the development of a European network standard rather than relying on a U.S. dominated one. The CYCLADES packet switching computer network was developed in the early 1970s; which was a French alternative to ARPANET. CYCLADES helped to influence the development of the OSI networking model; an alternative to TCP/IP. However, by the early 1980s, some European networks were creating gateways to U.S. networks: such as gateway between The European Academic and Research Network (EARN) and BITNET. In 1983, the CERN Networking Group planned to build a new computer network, and it eventually decided to adopt TCP/IP instead of the ISO networking standard. By the end of the 1980s, the CERN network would provide nearly 80% of Europe's Internet capacity; according to the head of its external networking group, François Flückiger.

The Réseaux Associés pour la Recherche Européenne (RARE) - later renamed (TERENA) - was founded in 1986 to promote European network research and OSI protocols. In 1988 and 1989, members of the CERN Networking Group were present at a meeting of the Coordinating Committee for Intercontinental Research Network (CCIRN). Vint Cerf was also present at these meetings, and he encouraged Europeans to create an organisation that would be responsible for allocating Internet IP blocks in Europe. The result was the creation of RIPE (Réseaux IP Européens). By the late 1980s, important European networks, like The European Network (EUnet), began to adopt TPC/IP; having previously used the X.25 protocol. This era (late 1980s) is sometimes referred to as the "protocol wars" era: eventually IP became the dominant model, and in 1991, the EBONE (standing for European Backbone) consortium was established by RIPE to transition European networks from OSI to IP.

In 1988, Telehouse Europe was founded and it opened the Telehouse Docklands datacentre in London. Telehouse Docklands became the primary hub for the Internet in the United Kingdom. Telehouse Europe has expanded across London and Europe; it presently describes itself as a "Backbone for the Global Internet Network". Internet Exchange Points, like LINX, operate out of Telehouse Docklands; Internet Exchange Points (IXP) enable Internet Service Providers to freely transit data across each others networks, and are a key data route for the Internet in Europe and the UK.

bullet Using the Internet

The technology that can access the Internet is ever growing, and the speed at which people can send data across the Internet is likewise growing at a similar rate. The most common access technology at present is broadband: digital subscriber line networks, fibre optic networks, and mobile networks. People can also access the Internet, at home, through wireless router technologies. When end users access the Internet, a range of ethics have been outlined in RFC documents. The amount of services on the Internet has slowly expanded since the early 1990s, but the majority are based around a client-server application: web (browsers) applications, instant chat applications, email clients, and file downloads (FTP) clients. Security has been a constant issue since the general public started accessing the Internet: unauthorised system access and viruses are two of the most serious security problems. One of the latest developments, in relation to the use of the Internet, is the Internet of things (IoT), which refers to the current inter-connection of everyday 'dumb' items to the Internet, with the aim of improving the convenience and efficiency of everyday mundane activities. Internet content is usually found by using a web search engine, that crawls the web and the Internet for new information.