1
出于某种原因,我不能得到正确的XPath和抓住从Nordstrom.com产品图像获得的图像,我使用Scrapy,继承人我的代码,该strPicture永远是空的:广东话使用XPath
from scrapy.spider import Spider
from scrapy.selector import Selector
from bed2.items import bed2Item
import urlparse
class MySpider(Spider):
name = "bed2"
allowed_domains = ["nordstrom.com,"nordstromimage.com"]
start_urls = ["http://shop.nordstrom.com/c/bedding-home?origin=leftnav#category=b60175057&type=category&marketingslots=2&page=1&defaultsize3=&size=&width=&color=&price=&brand=&instoreavailability=false&lastfilter=&sizeFinderId=0&resultsmode=&segmentId=0&sort=newest&sortreverse=0"]
def parse(self, response):
hxs = Selector(response)
titles = hxs.xpath("//div[@class='fashion-item']")
items = []
for titles in titles[:1]:
item = bed2Item()
item ["strTitle"] = titles.xpath("div[2]/a[1]/text()").extract()
item ["strLink"] = urlparse.urljoin(response.url, titles.xpath("div[2]/a[1]/@href").extract()[0])
item ["strPrice"] = "0"
item ["strPicture"] = titles.xpath("a/div[1]/img/@src").extract()
items.append(item)
return items
我刮网址是:
试图获得的第一个产品。
感谢
谢谢Jens,关于javascript改变源码的好点! –