解析的HttpResponse与引入nokogiri红宝石解析的HttpResponse与引入nokogiri
嗨,我无法解析的HttpResponse与引入nokogiri对象。
我用这个功能来获取此网站:
当我做这个网站打印获取链接
def fetch(uri_str, limit = 10)
# You should choose better exception.
raise ArgumentError, 'HTTP redirect too deep' if limit == 0
url = URI.parse(URI.encode(uri_str.strip))
puts url
#get path
req = Net::HTTP::Get.new(url.path,headers)
#start TCP/IP
response = Net::HTTP.start(url.host,url.port) { |http|
http.request(req)
}
case response
when Net::HTTPSuccess
then #print final redirect to a file
puts "this is location" + uri_str
puts "this is the host #{url.host}"
puts "this is the path #{url.path}"
return response
# if you get a 302 response
when Net::HTTPRedirection
then
puts "this is redirect" + response['location']
return fetch(response['location'],aFile, limit - 1)
else
response.error!
end
end
html = fetch("http://www.somewebsite.com/hahaha/")
puts html
noko = Nokogiri::HTML(html)
乱码一大堆和 引入nokogiri抱怨说,“node_set必须是引入nokogiri :: XML :: NODESET
如果有人可以提供帮助这将是颇为赞赏
你应该使用机械化代替这个炎热的烂摊子。它负责重定向并处理你的编码。 – pguardiario 2012-07-05 23:15:58