Python Shell未运行Scrapy

Question

我在Windows Vista 64位上运行Python.org版本2.7 64位以使用Scrapy。我有一些代码在我通过Command Shell运行时运行（除了一些Command Shell没有识别非Unicode字符的问题），但是当我尝试通过Python IDLE运行脚本时，我收到以下错误消息：

Warning (from warnings module): 
    File "C:\Python27\mrscrap\mrscrap\spiders\test.py", line 24 
    class MySpider(BaseSpider): 
ScrapyDeprecationWarning: __main__.MySpider inherits from deprecated class scrapy.spider.BaseSpider, please inherit from scrapy.spider.Spider. (warning only on first subclass, there may be others) 

用来生成该错误代码是：

from scrapy.spider import BaseSpider 
from scrapy.selector import Selector 
from scrapy.utils.markup import remove_tags 
import re 

class MySpider(BaseSpider): 
    name = "wiki" 
    allowed_domains = ["wikipedia.org"] 
    start_urls = ["http://en.wikipedia.org/wiki/Asia"] 

    def parse(self, response): 
     titles = response.selector.xpath("normalize-space(//title)") 
     for titles in titles: 

      body = response.xpath("//p").extract() 
      body2 = "".join(body) 
      print remove_tags(body2) 

首先，这是什么错误，当它工作正常在命令外壳的原因是什么？其次，当我按照错误中的指示并用“Spider”代替代码中的BaseSpider的两个实例时，代码将在Python shell中运行，但什么也不做。没有错误，没有打印到日志，没有错误或警告，什么都没有。

谁能告诉我为什么这个修订版本的代码不打印它的输出到Python IDLE？

感谢

Answer 1

添加from scrapy.cmdline import execute到您的进口

然后把execute(['scrapy','crawl','wiki'])并运行你的脚本。

from scrapy.spider import Spider 
from scrapy.selector import Selector 
from scrapy.utils.markup import remove_tags 
import re 
from scrapy.cmdline import execute 
class MySpider(Spider): 
    name = "wiki" 
    allowed_domains = ["wikipedia.org"] 
    start_urls = ["http://en.wikipedia.org/wiki/Asia"] 

    def parse(self, response): 
     titles = response.selector.xpath("normalize-space(//title)") 
     for title in titles: 

      body = response.xpath("//p").extract() 
      body2 = "".join(body) 
      print remove_tags(body2) 

execute(['scrapy','crawl','wiki'])