将数据解析到列表的列表

尝试将数据解析到列表的列表时遇到了问题。我试图抓取关于部门及其主题的信息。但是，由于每个部门都有不同数量的主题，因此我需要创建一个列表清单，以便稍后将数据链接在一起。我已设法导航索引错误，并且问题似乎来自编译主题列表。将数据解析到列表的列表

from lxml import html 
import requests 

page = requests.get('URL') 

page_source_code = html.fromstring(page.text) 


departments_list = [] 
subject_list = [] 

for dep in range(1,3): 
    departments = page_source_code.xpath('tag' 
             +str(dep)+']tag/text()') 

    ### print(dep, departments) 
    if departments == []: 
     pass 
    else: 
     departments_list.append(departments[0]) 


    for sub in range(1,20): 
     subjects = page_source_code.xpath('tag' 
             +str(dep)+']tag' 
             +str(sub)+']tag/text()') 
     ### print(sub, subjects) 
     if subjects == []: 
      pass 
     else: 
      subject_list.append(subjects[0]) 

print('Department list ------ ', len(departments_list), departments_list, '\n') 
print('Subject list ------ ', len(subject_list), subject_list)

我的输出是这样的：

Department list ------ 2 ['Department_1', 'Department_2'] 

Subject list ------ 7 ['Subject_1'(dep_1), 'Subject_2 '(dep_1), 'Subject_3 '(dep_1), 'Subject_4'(dep_1), 'Subject_5'(dep_2), 'Subject_6 '(dep_2), 'Subject_7 '(dep_2)']

此代码似乎把所有科目到一个列表。我想，如下所示：

Subject list ------ 7 [['Subject_1'(dep_1), 'Subject_2 '(dep_1), 'Subject_3 '(dep_1), 'Subject_4'(dep_1)], ['Subject_5'(dep_2), 'Subject_6 '(dep_2), 'Subject_7 '(dep_2)']]

来源

2017-09-02 baffled_all_time

需要两个全局添加两个列表主题列表中，找出受试者[0]字符串“dep_1”或“dep_2”字。

 #declare the list for subject 
    sub_list1 = [] sub_list2 = [] 

    #this code is under the second for loop 
    if subjects.find('dep_1') == -1 : 
     sub_list2.append(subjects[0]) 
    else: 
     sub_list1.append(subjects[0]) 

    #Please remove the subjectList.append statement 
    #from second for loop 
    #and put it end of both loop like that . 
    subjectList = [sub_list1,sub_list2]

来源

2017-09-16 19:24:19 PramodG

将数据解析到列表的列表

回答

相关问题