我正在尝试下载一个txt您可以找到的文件here http://proxy-ip-list.com/download/free-proxy-list.txt。下载文件不是问题:
testfile = urllib.URLopener()
testfile.retrieve(_proxy_list_download_, "proxies.txt")
但问题是,当它下载时,它的行为很奇怪。当我以任何方式打开它时txt编辑器,我可以看到内容IP地址,但是当我尝试将内容打印到控制台时,它会打印以下内容:
212.3.183.210:8080; 0; 0; anonymous proxy; Italy; ; a; in); an Jose); ree download proxy IP
当我试图得到IP地址从那里开始,输出中没有地址。
with open('proxies.txt') as f:
content = f.read()
ip = re.findall( r"^\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3}$", content )
我已经尝试过另一个regex:
r'([0-9]+)(?:\.[0-9]+){3}'
This regex仅返回3-digit数字。
你知道如何解析这些IP吗?
编辑:这是从文本编辑器复制+粘贴的文本,但在编辑器中所有内容都在一行中:
# http://proxy-ip-list.com/ provides you this fresh txt proxy list to free download proxy IP
# Date: Sat, 27 Jun 2015 12:53:02 +0000
39.166.95.9:8123; 0; 0; high-anonymous; China;
178.189.92.118:3129; 16.83; 405; high-anonymous; Austria;
198.2.202.33:8090; 8.05; 884; anonymous; United States (CA, San Jose);
171.96.152.89:8080; 0; 0; anonymous; Thailand;
153.149.104.76:80; 0; 0; anonymous; Japan (Tokyo);
106.187.52.191:80; 0; 0; anonymous proxy; Japan;
194.187.214.204:80; 0.91; 6374; anonymous proxy; Finland;
59.78.160.247:8080; 0; 0; anonymous; China (Shanghai);
61.156.3.166:80; 1.12; 1449; anonymous proxy; China (Jinan);
221.238.140.164:8080; 1.39; 257; anonymous; China (Tianjin);
117.178.157.107:8123; 8.44; 847; high-anonymous; China;
39.166.205.95:8123; 0; 0; high-anonymous; China;
117.163.216.8:8123; 4.21; 1577; high-anonymous; China;
189.31.143.250:3128; 0; 0; high-anonymous; Brazil;
183.89.84.82:8080; 0; 0; anonymous proxy; Thailand;
183.88.41.42:8080; 0; 0; anonymous; Thailand;
212.3.183.210:8080; 0; 0; anonymous proxy; Italy;