| Package | Description |
|---|---|
| us.codecraft.webmagic |
Main class "Spider" and models.
|
| us.codecraft.webmagic.processor |
PageProcessor custom part of a crawler for specific site.
|
| us.codecraft.webmagic.processor.example |
| Modifier and Type | Field and Description |
|---|---|
protected PageProcessor |
Spider.pageProcessor |
| Modifier and Type | Method and Description |
|---|---|
static Spider |
Spider.create(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
| Constructor and Description |
|---|
Spider(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
| Modifier and Type | Class and Description |
|---|---|
class |
SimplePageProcessor
A simple PageProcessor.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BaiduBaikePageProcessor |
class |
GithubRepoPageProcessor |
class |
ZhihuPageProcessor |
Copyright © 2017. All rights reserved.