2012-11-21 82 views

回答

7

更新它会出现cookie默认情况下在中间件,所以只需COOKIES_ENABLED = True应该足够。你只需要下面如果中间件是不是默认的一部分......

从我可以从doc.scrapy.org/en/latest/topics/downloader-middleware.html添加 'scrapy.contrib.downloadermiddleware.cookies.CookiesMiddleware'告诉DOWNLOADER_MIDDLEWARE与相关排序:

要启动一个下载中间件组件,将其添加到 DOWNLOADER_MIDDLEWARES设置,这是一个字典的键是 中间件类路径和他们的价值观是中间件的订单。

DOWNLOADER_MIDDLEWARES = { 
    'myproject.middlewares.CustomDownloaderMiddleware': 543, 
    'scrapy.contrib.downloadermiddleware.cookies.CookiesMiddleware': 700 # <- 
} 

700在http://doc.scrapy.org/en/latest/topics/downloader-middleware.html#built-in-downloader-middleware-reference 然后把COOKIES_ENABLED = True(和可选COOKIES_DEBUG = True)与您设置的其余部分来自于默认DOWNLOADER_MIDDLEWARES_BASE

2

只要把:

COOKIES_DEBUG = True 

my-project/my-spider/spiders/settings.py