1
通过官方啧啧,我决定尝试建立自己的蜘蛛在同一个项目之后。
start_urls = [
"myurl"
]
class Parker_Spider(scrapy.Spider):
name = "parker"
def make_requests(self):
for i in range(self.max_id):
yield Request('myurl', method="post", headers= headers, body=payload, callback=self.parse_method)
def parse_method(self,response):
print(response.body)
当我运行:
$ scrapy runspider parker
2016-05-25 20:26:42 [scrapy] INFO: Scrapy 1.1.0 started (bot: tutorial)
2016-05-25 20:26:42 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'tutorial.spiders', 'SPIDER_MODULES': ['tutorial.spiders'], 'ROBOTSTXT_OBEY': True, 'BOT_NAME': 'tutoria
l'}
Usage
=====
scrapy runspider [options] <spider_file>
runspider: error: File not found: parker
我在做什么错了,我在其中包含蜘蛛创建parker_spider.py?
如果该命令是scrapy runspider parker_spider.py? –