程序包 us.codecraft.webmagic
的使用

使用us.codecraft.webmagic的程序包

程序包	说明
us.codecraft.webmagic	Main class "Spider" and models.
us.codecraft.webmagic.downloader	Downloader is the part that downloads web pages and store in Page object.
us.codecraft.webmagic.pipeline	Pipeline is the persistent and offline process part of crawler.
us.codecraft.webmagic.processor	PageProcessor custom part of a crawler for specific site.
us.codecraft.webmagic.processor.example
us.codecraft.webmagic.scheduler	Scheduler is the part of url management.
us.codecraft.webmagic.scheduler.component	Component of scheduler.
us.codecraft.webmagic.utils	Static utils of webmagic.

us.codecraft.webmagic使用的us.codecraft.webmagic中的类

类和说明
Page Object storing extracted result and urls to fetch.
Request Object contains url to crawl.
ResultItems Object contains extract results.
Site Object contains setting for crawler.
Spider Entrance of a crawler.
Spider.Status
SpiderListener Listener of Spider on page processing.
Task Interface for identifying different tasks.

us.codecraft.webmagic.downloader使用的us.codecraft.webmagic中的类

类和说明
Page Object storing extracted result and urls to fetch.
Request Object contains url to crawl.
Site Object contains setting for crawler.
Task Interface for identifying different tasks.

us.codecraft.webmagic.pipeline使用的us.codecraft.webmagic中的类

类和说明
ResultItems Object contains extract results.
Task Interface for identifying different tasks.

us.codecraft.webmagic.processor使用的us.codecraft.webmagic中的类

类和说明
Page Object storing extracted result and urls to fetch.
Site Object contains setting for crawler.

us.codecraft.webmagic.processor.example使用的us.codecraft.webmagic中的类

类和说明
Page Object storing extracted result and urls to fetch.
Site Object contains setting for crawler.

us.codecraft.webmagic.scheduler使用的us.codecraft.webmagic中的类

类和说明
Request Object contains url to crawl.
Task Interface for identifying different tasks.

us.codecraft.webmagic.scheduler.component使用的us.codecraft.webmagic中的类

类和说明
Request Object contains url to crawl.
Task Interface for identifying different tasks.

us.codecraft.webmagic.utils使用的us.codecraft.webmagic中的类

类和说明
Request Object contains url to crawl.