新人报道，发个91爬虫？

ralaro

10000 发表于 2018-2-3 22:54
为毛我抓成功，下载失败啊

改个地方，看下错误 我都下载了500g了

10000

ralaro 发表于 2018-2-4 00:36
改个地方，看下错误 我都下载了500g了

改哪里啊~~

10000

ralaro 发表于 2018-2-4 00:36
改个地方，看下错误 我都下载了500g了

开始抓取第21页，地址为http://XX/v.php?category=mf&viewtype=basic&page=21
Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
开始抓取第22页，地址为http://XX/v.php?category=mf&viewtype=basic&page=22
Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
开始抓取第23页，地址为http://XX/v.php?category=mf&viewtype=basic&page=23
Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
开始抓取第24页，地址为http://XX/v.php?category=mf&viewtype=basic&page=24
Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
本次还有662条未下载
开始下载地址为http://XX/view_video.php?viewkey=f2394902c854712f47cb&page=23&viewtype=basic&category=mf
下载失败
开始下载地址为http://XX/view_video.php?viewkey=e607a1a75f6fc439a465&page=24&viewtype=basic&category=mf
下载失败
开始下载地址为http://XX/view_video.php?viewkey=5df6a5c666c421157b76&page=25&viewtype=basic&category=mf
下载失败
开始下载地址为http://XX/view_video.php?viewkey=e0d3fbf0142859f653b9&page=25&viewtype=basic&category=mf
下载失败
开始下载地址为http://XX/view_video.php?viewkey=b3b63573ea3e64409055&page=25&viewtype=basic&category=mf
下载失败
开始下载地址为http://XX/view_video.php?viewkey=97added79518f0e85002&page=25&viewtype=basic&category=mf

bigboss60

也是要request库的？

ralaro

bigboss60 发表于 2018-2-4 12:31
也是要request库的？

嗯

cw723

ralaro 发表于 2018-2-4 13:35
嗯

Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
我也是这个错误

python3.6

yidaomm

为兄弟点赞~~

vultrlinode

快500g了。目前9420个视频文件。

ralaro

vultrlinode 发表于 2018-2-4 14:28
快500g了。目前9420个视频文件。

我都1t了。。没空间了。。

ralaro

cw723 发表于 2018-2-4 14:15
Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
我也是这个错误 ...

不管他它，能下就行