- 将
ImageSpider\ImgInWebsite\spiders\ImgSpider.py
文件中的allowed_domains = ["www.meizu.com"]
和start_urls = ['http://www.meizu.com/']
中的地址换成自己想要爬取图片网站的地址。 - 运行命令
scrapy crawl ImgSpider
- 本地生成一个
imgs.txt
文件,其中有全部图片的下载地址
-
Notifications
You must be signed in to change notification settings - Fork 11
wly2014/ImageSpider
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
scrapy爬取网站上的所有图片
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published