Advanced

A Geographic 3D Visualization and Browser of the World Wide Web

Rydgren, Lars-Olof LU (2015) MAMM01 20131
Ergonomics and Aerosol Technology
Abstract (Swedish)
Internet är ett stort globalt nätverk som fortsätter växa i komplexitet med nya tekniker och protokoll som utvidgar dess användbarhet och sättet vi sprider information.

Trender, nyheter, videor och annan information sprider sig snabbt över världen vilket gör Internet till ett fantastiskt redskap för de användare som prenumererar på rätt informationsströmmar eller nyheter. Webläsare är en nödvändighet för att struktuera den information vi hittat och för att surfning av webben ska bli bekväm.

De områden som en traditionell webläsare saknar är främst en vägledning in i den digitala världen för en icke-erfaren användare. Det är svårt att få en uppfattning av Internets storlek, djup och var man är respektive alla andra användare.... (More)
Internet är ett stort globalt nätverk som fortsätter växa i komplexitet med nya tekniker och protokoll som utvidgar dess användbarhet och sättet vi sprider information.

Trender, nyheter, videor och annan information sprider sig snabbt över världen vilket gör Internet till ett fantastiskt redskap för de användare som prenumererar på rätt informationsströmmar eller nyheter. Webläsare är en nödvändighet för att struktuera den information vi hittat och för att surfning av webben ska bli bekväm.

De områden som en traditionell webläsare saknar är främst en vägledning in i den digitala världen för en icke-erfaren användare. Det är svårt att få en uppfattning av Internets storlek, djup och var man är respektive alla andra användare. Internet har en stor kultur som kan anses transparent i första ögonblicket då man öppnar en webläsare för första gången. Traditionella webläsare saknar en vägvisande introduktion till Internets kultur och dess populära hemsidor.

Om man visualiserar alla Internet's publika hemsidor i en 3-dimensionell värld så ger det möjlighet till att se dess storlek och utforska det på ett alternativt sätt. Vilket därmed också simplifierar dess komplexitet. Användaren kan då få en överblick av webben där dess aktivitet och kultur kan visas i formen av en mer spelliknande miljö.

Denna avhandling handlar om att visualisera en delmängd av Internet's publika hemsidor som byggnadsobjekt i en värld där användaren interaktivt kan besöka varje hemsida i världen, där höjden av varje byggnadsobjekt återspeglar hemsidans popularitet. Ett bot-program med flera trådar har används för att lagra relationerna mellan hemsidorna vi hittat för att senare använda denna data i en så kallad force-directed algorithm. Denna algoritm kommer skapa attraktions och repulsions krafter mellan noder som representerar hemsidorna, där nodernas position ändras iterativt av dessa krafter i mån om att få dem geografiskt placerade. Krafterna mellan noderna bestäms av hur mycket PageRank en sida har gett en annan.

Världen kommer renderas i WebGL med hjälp av en 3D JavaScript motor som heter Three.js. En användare kommer kunna nå den visualiserade världen via sin webläsare som ansluter till min hemsida där de laddar ner alla nödvändiga resurser t.ex. texturer, objekt och skript. Jag använder mig av olika tekniker bl.a. en variant av Level of Detail för att kunna rendera en så stor mängd av hemsidor som möjligt i världen. (Less)
Abstract
Internet is a vast digital network. Evergrowing in its complexity with frequent newly developed protocols extending the technology and changing the way we communicate and share information over the world.

Trends, news, videos and other information spread quickly over the world, making web browsers an incredible tool for users who listen to the right feeds or news networks. Web browsers are a necessity for structuring our obtained information and are needed for convenient surfing of the web. But for the non-experienced user it may not be completely self-explanatory what the Internet is, where to go or how far its borders stretches, the depth isn't shown and have to be individually explored mainly through the use of search engines. The... (More)
Internet is a vast digital network. Evergrowing in its complexity with frequent newly developed protocols extending the technology and changing the way we communicate and share information over the world.

Trends, news, videos and other information spread quickly over the world, making web browsers an incredible tool for users who listen to the right feeds or news networks. Web browsers are a necessity for structuring our obtained information and are needed for convenient surfing of the web. But for the non-experienced user it may not be completely self-explanatory what the Internet is, where to go or how far its borders stretches, the depth isn't shown and have to be individually explored mainly through the use of search engines. The culture of Internet can seem transparent the first time you open the traditional web browser. Traditional web browsers lack an introductional guidance into the culture and to the popular sites.

By visualizing public websites of the Internet as objects in a 3-dimensional world, the user will be able to see the boundaries of the web and explore it in a new fashion where the complexity of its structure is greatly reduced. The user will get an overview of the web in which activity and the culture can be shown in a game-alike environment.

This thesis will be about visualizing a crawled subset of websites as a city of buildings, where each building represents a website that the user can visit inside the world, the building's height reflecting its website's popularity. A multi-threaded crawler is used to find and store the relations between the set of websites, namely how many outgoing and which outgoing links each site has. This data in turn will be used by a force-directed algorithm that will position these buildings relatively geographical by attaching imaginary strings between them that either repulse or attract websites with high respective low relational attraction. The attractional forces being defined by the calculated PageRank that are passed between the sites.

The world will be rendered in WebGL and use the JavaScript library Three.js, and will thus be accessed through a web browser that connects to a web server and download all the necessary resources, e.g. textures, objects and JavaScript functions.

Trying to render a subset of Internet's websites as objects obviously puts a lot of stress on standard web browsers. Graphical features and tricks such as Level of Detail have been necessary to implement in order to make it appear a larger part is visualized than what actually is. (Less)
Please use this url to cite or link to this publication:
author
Rydgren, Lars-Olof LU
supervisor
organization
course
MAMM01 20131
year
type
H2 - Master's Degree (Two Years)
subject
keywords
visualization, 3d, browser, web, www, webgl, game, internet, force-directed, algorithm, crawler, javascript, three.js, pagerank, graphics, html, favicon, octree
language
English
id
8408736
date added to LUP
2015-12-21 11:09:37
date last changed
2015-12-21 11:09:37
@misc{8408736,
  abstract     = {Internet is a vast digital network. Evergrowing in its complexity with frequent newly developed protocols extending the technology and changing the way we communicate and share information over the world. 

Trends, news, videos and other information spread quickly over the world, making web browsers an incredible tool for users who listen to the right feeds or news networks. Web browsers are a necessity for structuring our obtained information and are needed for convenient surfing of the web. But for the non-experienced user it may not be completely self-explanatory what the Internet is, where to go or how far its borders stretches, the depth isn't shown and have to be individually explored mainly through the use of search engines. The culture of Internet can seem transparent the first time you open the traditional web browser. Traditional web browsers lack an introductional guidance into the culture and to the popular sites.

By visualizing public websites of the Internet as objects in a 3-dimensional world, the user will be able to see the boundaries of the web and explore it in a new fashion where the complexity of its structure is greatly reduced. The user will get an overview of the web in which activity and the culture can be shown in a game-alike environment.

This thesis will be about visualizing a crawled subset of websites as a city of buildings, where each building represents a website that the user can visit inside the world, the building's height reflecting its website's popularity. A multi-threaded crawler is used to find and store the relations between the set of websites, namely how many outgoing and which outgoing links each site has. This data in turn will be used by a force-directed algorithm that will position these buildings relatively geographical by attaching imaginary strings between them that either repulse or attract websites with high respective low relational attraction. The attractional forces being defined by the calculated PageRank that are passed between the sites. 

The world will be rendered in WebGL and use the JavaScript library Three.js, and will thus be accessed through a web browser that connects to a web server and download all the necessary resources, e.g. textures, objects and JavaScript functions.

Trying to render a subset of Internet's websites as objects obviously puts a lot of stress on standard web browsers. Graphical features and tricks such as Level of Detail have been necessary to implement in order to make it appear a larger part is visualized than what actually is.},
  author       = {Rydgren, Lars-Olof},
  keyword      = {visualization,3d,browser,web,www,webgl,game,internet,force-directed,algorithm,crawler,javascript,three.js,pagerank,graphics,html,favicon,octree},
  language     = {eng},
  note         = {Student Paper},
  title        = {A Geographic 3D Visualization and Browser of the World Wide Web},
  year         = {2015},
}