Skriptovatelny web crawler v C#

Loading...
Thumbnail Image

Downloads

2

Date issued

Authors

Gereg, Jakub

Journal Title

Journal ISSN

Volume Title

Publisher

Vysoká škola báňská - Technická univerzita Ostrava

Location

Signature

Abstract

The aim of this bachelor thesis is to create a scriptable Web crawler. The basic idea was to create an application that would automatically browse web pages based on user-specified script. However, we needed to analyze which scripting language would be appropriate for operating with crawler and it was also necessary to learn the basic rules for the movement of the web crawler, even before we began. Also, we needed to take in account some limitations, that come with crawlers itself. In result, there is a functional application, allowing simplified searches on the Internet.

Description

Import 26/06/2013

Subject(s)

URL, HTTP, C#, crawler, Web crawler, scripting language

Citation