我想提取从以下网站的标题和描述:如何使用python从URL中提取元描述?
查看源代码:http://www.virginaustralia.com/au/en/bookings/flights/make-a-booking/
与源代码下面的代码片段:
<title>Book a Virgin Australia Flight | Virgin Australia
</title>
<meta name="keywords" content="" />
<meta name="description" content="Search for and book Virgin Australia and partner flights to Australian and international destinations." />
我想要的标题和meta内容。
我用鹅,但它没有做好提取。这里是我的代码:
website_title = [g.extract(url).title for url in clean_url_data]
和
website_meta_description=[g.extract(urlw).meta_description for urlw in clean_url_data]
结果是空
BeautifulSoup怎么样? - https://www.crummy.com/software/BeautifulSoup/ –