webmagic框架
摘要:http://webmagic.io/docs/zh/posts/ch6-custom-componenet/scheduler.htmlhttp://webmagic.io/
阅读全文
httpclient 超时设置
摘要:最近项目客户反应超时经常出现:现已经总结超时设置:使用是apache的HttpClient:DefaultHttpClient:请求超时httpclient.getParams().setParameter(CoreConnectionPNames.CONNECTION_TIMEOUT, 60000);读取超时httpclient.getParams().setParameter(CoreConnectionPNames.SO_TIMEOUT, 60000);HttpClientHttpClienthttpClient=newHttpClient();链接超时httpClient.getHtt
阅读全文