data - 随笔分类(第7页) - papering

mysql group by 组内排序 group by 原理

摘要：mysql group by 组内排序 SELECT * FROM (SELECT MAX(id) AS t,wukong_uid, 1 AS tag FROM toutiao_uid_gathered_wukong GROUP BY wukong_uidUNION ALLSELECT id AS 阅读全文

posted @ 2018-01-18 16:51 papering 阅读(360) 评论(0) 推荐(0)

GraphDatabase_action

摘要：https://neo4j.com/docs/ Server version Neo4j/3.3.1 Server address 127.0.0.1:7687 Query MATCH (a:Person)-[:KNOWS]->(friend) WHERE a.name ="Arthur" RETU 阅读全文

posted @ 2018-01-18 15:07 papering 阅读(622) 评论(0) 推荐(0)

python js

摘要：js = 'var a=document.getElementsByClassName("user-data-right")[0];a.target="_self";a.href="{}";a.click();'.format( 'https://www.toutiao.com/c/user/{}/ 阅读全文

posted @ 2018-01-18 13:51 papering 阅读(147) 评论(0) 推荐(0)

实时站内热点链接池塘

摘要：实时热点池塘阅读全文

posted @ 2018-01-18 13:37 papering 阅读(116) 评论(0) 推荐(0)

charset='utf8mb4'

摘要：charset='utf8mb4' conn = pymysql.connect(host=h, port=pt, user=u, passwd=p, db=db, charset='utf8mb4') 阅读全文

posted @ 2018-01-18 12:08 papering 阅读(466) 评论(0) 推荐(0)

neo4j 张一鸣 8

摘要：头条关注粉丝关系张一鸣 8 阅读全文

posted @ 2018-01-18 11:05 papering 阅读(156) 评论(0) 推荐(0)

代理ip 测试

摘要：Line #1218 : 101.232.208.245 - - [16/Jan/2018:02:47:34 +0800] "GET /?xltestdesfs HTTP/1.1" 200 3865 Line #1243 : 101.232.208.245 - - [16/Jan/2018:03:0 阅读全文

posted @ 2018-01-18 09:44 papering 阅读(345) 评论(0) 推荐(0)

关注的关注的关注。。。。

摘要：关注的关注的关注。。。。阅读全文

posted @ 2018-01-18 01:47 papering 阅读(109) 评论(0) 推荐(0)

shell 爬虫从日志分析到数据采集与分析

摘要：[root@VM_61_158_centos ~]# curl http://ip.chinaz.com/220.112.233.179 |grep -e Whwtdhalf.*span.*span.*span.*span % Total % Received % Xferd Average Spe 阅读全文

posted @ 2018-01-18 01:02 papering 阅读(226) 评论(0) 推荐(0)

浏览器分离

摘要：from selenium import webdriverimport time, randomdef gen_browser(btype='chrome'): return webdriver.Chrome()browser = webdriver.Chrome()url = 'https://www.wukong.com/'browser.get(url)browser.refre... 阅读全文

posted @ 2018-01-17 19:39 papering 阅读(276) 评论(0) 推荐(0)

一切的入口都是漏洞

摘要：一切的入口都是漏洞都是数据的出口阅读全文

posted @ 2018-01-17 16:32 papering 阅读(128) 评论(0) 推荐(0)

程序化关注在同一窗口打开

摘要：for tof in tofollow_uid_list: print(tof) js = 'window.location.href="https://www.toutiao.com/c/user/{}/"'.format(tof) browser.execute_script(js) time.sleep(random.randint(30, 60)) n... 阅读全文

posted @ 2018-01-17 12:25 papering 阅读(181) 评论(0) 推荐(0)

简化窗口的控制和异常处理的复杂性

摘要：实例化一个新的浏览器，打开某个url from selenium import webdriverfrom selenium.webdriver.chrome.options import Optionsimport time, randomfrom selenium.webdriver.commo 阅读全文

posted @ 2018-01-17 00:41 papering 阅读(510) 评论(0) 推荐(0)

提升600百万数据的处理速度禁止图片下载

摘要：firefox_profile = webdriver.FirefoxProfile()firefox_profile.set_preference('permissions.default.image', 2)#某些firefox只需要这个firefox_profile.set_preference('browser.migration.version', 9001)#部分需要加上这个#... 阅读全文

posted @ 2018-01-16 00:02 papering 阅读(278) 评论(0) 推荐(0)

逻辑分离

摘要：避免逻辑捆绑、打包单个逻辑越简单，越高效，越有机动性阅读全文

posted @ 2018-01-15 22:29 papering 阅读(207) 评论(0) 推荐(0)

手机热点 ip

摘要：ip 阅读全文

posted @ 2018-01-14 08:46 papering 阅读(162) 评论(0) 推荐(0)

双层for 循环

摘要：说说图片集合阅读全文

posted @ 2018-01-13 16:12 papering 阅读(198) 评论(0) 推荐(0)

c采集qq空间说说存入数据库

摘要：db 阅读全文

posted @ 2018-01-13 15:10 papering 阅读(202) 评论(0) 推荐(0)

b-is-in- (1267, "Illegal mix of collations (utf8mb4_unicode_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='") SELECT id FROM qqzoneshuoshuo WHERE words=

摘要：db-is-in- (1267, "Illegal mix of collations (utf8mb4_unicode_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='") SELECT id FROM qqzoneshu 阅读全文

posted @ 2018-01-13 15:07 papering 阅读(195) 评论(0) 推荐(0)

修改数据表的字符集为utf8mb4

摘要：修改数据表的字符集为utf8mb4 阅读全文

posted @ 2018-01-13 14:26 papering 阅读(303) 评论(0) 推荐(0)

papering

随笔分类 - data