使用BeautifulSoup进行网页扫描 - Python

Question

我需要刮取下面的代码，以检索“SCRAPE THIS”和“SCRAPE THIS ASWELL”部分。我一直在玩它几个小时，没有运气！有谁知道这可以做到吗？

<div class="mod-body add-border"> <div class="mod-inline mod-body-A-F"> <h4>SCRAPE THIS</h4> <div class="mod-body"> <ul class="list"> <li>SCRAPE THIS AS WELL</li> </ul> </div> </div>

Answer 1

试试这个代码：

from bs4 import BeautifulSoup 
text = """<div class="mod-body add-border"> <div class="mod-inline mod-body-A-F"> <h4>SCRAPE THIS</h4> <div class="mod-body"> <ul class="list"> <li>SCRAPE THIS AS WELL</li> </ul> </div> </div>""" 
x = BeautifulSoup(text, 'lxml') 
print(x.find('h4').get_text()) 
print(x.find('li').get_text())