如何使用硒

Question

我试图用硒和Python来打印一些信息，但它打印不是所有的CSS的路径，这是while循环怎么会只是一个信息打印信息..

pageIndex = 1 
while True: # Keep looping through all pages 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    for link in links: 
     urls = link.text 


    jobs = browser.find_elements_by_css_selector('div > div.description') 
    for title in jobs: 
     jobtitles = title.text 


    with open("1Exportdata.csv", "a") as csvFile: 
     csvFile.write(url + "," + jobtitle + "\n") 

    pageIndex += 1 
    if pageIndex == 5010: 
     browser.close() 

Answer 1

因为你使用：

for title in jobs: 
    jobtitles = title.text 

在第一循环中，jobtitles是第一title.text，但随后，在第二循环中，它成为第二个title.text。最后它会成为最后的title.text。

例如：

>>> for i in [1, 2, 3]: 
...  num = i 
>>> print(num) 
3 
>>> 

所以你需要写with open("1Exportdata.csv", "a") as csvFile:的for循环中。因为你有两个名单，我建议你使用zip类压缩他们：

pageIndex = 1 
while True: # Keep looping through all pages 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    jobs = browser.find_elements_by_css_selector('div > div.description') 

    for link, title in zip(links, jobs): 
     url = link.text 
     jobtitle = title.text 


     with open("1Exportdata.csv", "a") as csvFile: 
      csvFile.write(url + "," + jobtitle + "\n") 

    pageIndex += 1 
    if pageIndex == 5010: 
     browser.close() 

---

而且我认为使用while循环是没用的，尽量使用for循环，而不是：

for pageIndex in range(1, 5011): 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    jobs = browser.find_elements_by_css_selector('div > div.description') 

    for link, title in zip(links, jobs): 
     url = link.text 
     jobtitle = title.text 


     with open("1Exportdata.csv", "a") as csvFile: 
      csvFile.write(url + "," + jobtitle + "\n")