A B C D E F G H I J L M N P R S T U X

F

fetch(String, String) - Method in class spider.util.Fetcher

fetches a page and returns a Page type object

Fetcher - class spider.util.Fetcher.

Fetches HTTP pages and various details from its response header

Fetcher() - Constructor for class spider.util.Fetcher

FetcherPool - class spider.crawl.FetcherPool.

A pool of multi-threaded fetchers that can be used to fetch many pages at the same time

FetcherPool(Cache, RobotExclusion, Statistics) - Constructor for class spider.crawl.FetcherPool

FetcherPool(int, Cache, RobotExclusion, Statistics) - Constructor for class spider.crawl.FetcherPool

fetchPages(String[]) - Method in class spider.crawl.FetcherPool

called to fetch one or more pages

foundInCache(int) - Method in class spider.crawl.Statistics

add to noFoundInCache

Frontier - class spider.crawl.Frontier.

Frontier(Cache) - Constructor for class spider.crawl.Frontier

if no size is specified, then set up a flag for unlimited frontier

Frontier(int, Cache) - Constructor for class spider.crawl.Frontier

FrontierElement - class spider.crawl.FrontierElement.

FrontierElement(String) - Constructor for class spider.crawl.FrontierElement

FrontierElement(String, double) - Constructor for class spider.crawl.FrontierElement

FrontierElement(String, double, int) - Constructor for class spider.crawl.FrontierElement

FrontierElement(String, double, int, String) - Constructor for class spider.crawl.FrontierElement