Webcrawler - prestanda och säkerhetsanalys
(2013)Computer Science and Engineering (BSc)
- Abstract
- The thesis was to make a tool to Edument AB. Edument wanted a tool that gave them information about how the 1000 biggest Swedish sites are performing and how the security is. This information will later be used for a new course in web-security and web-performance that Edument will offer.
The final tool was divided into four parts. The first part reads the 1000 biggest Swedish sites from a file of the 1,000,000 biggest sites in the world. Then the pages url is stored in a database.
The second part was visiting all of the 1000 sites and stores the raw data in a database.
The third part was intended to create a tool that retrieved the saved raw data and then transform it to a format that would be easier to analyze in the next step.
The fourth... (More) - The thesis was to make a tool to Edument AB. Edument wanted a tool that gave them information about how the 1000 biggest Swedish sites are performing and how the security is. This information will later be used for a new course in web-security and web-performance that Edument will offer.
The final tool was divided into four parts. The first part reads the 1000 biggest Swedish sites from a file of the 1,000,000 biggest sites in the world. Then the pages url is stored in a database.
The second part was visiting all of the 1000 sites and stores the raw data in a database.
The third part was intended to create a tool that retrieved the saved raw data and then transform it to a format that would be easier to analyze in the next step.
The fourth and last part would make the analysis itself. (Less)
Please use this url to cite or link to this publication:
http://lup.lub.lu.se/student-papers/record/3959516
- author
- Arndorff, Kristofer and Rosdahl, Markus
- organization
- year
- 2013
- type
- M2 - Bachelor Degree
- subject
- keywords
- fiddlercore, crawler, web-performance, web-security, ravendb, http, nosql
- language
- Swedish
- id
- 3959516
- date added to LUP
- 2013-08-08 03:39:50
- date last changed
- 2018-10-18 10:27:20
@misc{3959516,
abstract = {{The thesis was to make a tool to Edument AB. Edument wanted a tool that gave them information about how the 1000 biggest Swedish sites are performing and how the security is. This information will later be used for a new course in web-security and web-performance that Edument will offer.
The final tool was divided into four parts. The first part reads the 1000 biggest Swedish sites from a file of the 1,000,000 biggest sites in the world. Then the pages url is stored in a database.
The second part was visiting all of the 1000 sites and stores the raw data in a database.
The third part was intended to create a tool that retrieved the saved raw data and then transform it to a format that would be easier to analyze in the next step.
The fourth and last part would make the analysis itself.}},
author = {{Arndorff, Kristofer and Rosdahl, Markus}},
language = {{swe}},
note = {{Student Paper}},
title = {{Webcrawler - prestanda och säkerhetsanalys}},
year = {{2013}},
}