| Package | Description |
|---|---|
| us.codecraft.webmagic.scheduler |
Scheduler is the part of url management.
|
| Modifier and Type | Class and Description |
|---|---|
class |
PriorityScheduler
Priority scheduler.
|
class |
QueueScheduler
Basic Scheduler implementation.
Store urls to fetch in LinkedBlockingQueue and remove duplicate urls by HashMap. |
Copyright © 2017. All rights reserved.