UrlUtils (webmagic-core 0.5.2 API)

构造器
构造器和说明
`UrlUtils()`

方法
限定符和类型	方法和说明
`static String`	`canonicalizeUrl(String url, String refer)` canonicalizeUrl Borrowed from Jsoup.
`static List<Request>`	`convertToRequests(Collection<String> urls)`
`static List<String>`	`convertToUrls(Collection<Request> requests)`
`static String`	`encodeIllegalCharacterInUrl(String url)`
`static String`	`fixAllRelativeHrefs(String html, String url)`
`static String`	`getCharset(String contentType)`
`static String`	`getDomain(String url)`
`static String`	`getHost(String url)`
`static String`	`removeProtocol(String url)`
`static String`	`replaceByPattern(String html, String url, Pattern pattern)`

public static String canonicalizeUrl(String url,
                     String refer)

canonicalizeUrl

Borrowed from Jsoup.

public static String encodeIllegalCharacterInUrl(String url)

public static String getHost(String url)

public static String removeProtocol(String url)

public static String getDomain(String url)

public static String fixAllRelativeHrefs(String html,
                         String url)

public static String replaceByPattern(String html,
                      String url,
                      Pattern pattern)

public static List<Request> convertToRequests(Collection<String> urls)

public static List<String> convertToUrls(Collection<Request> requests)

public static String getCharset(String contentType)

类 UrlUtils