2012-01-26 67 views
0

我有一个来自Google的XML源,大约有300个条目。它看起来像这样:通过条目递归搜索xml

<?xml version="1.0"?> 
-<ns0:feed ns1:etag="W/"LIESANDCRAPfyt7I2A9WhHERE."" xmlns:ns4="http://www.w3.org/2007/app" xmlns:ns3="http://schemas.google.com/contact/2008" xmlns:ns2="http://a9.com/-/spec/opensearchrss/1.0/" xmlns:ns1="http://schemas.google.com/g/2005" xmlns:ns0="http://www.w3.org/2005/Atom"> 
    <ns0:updated>2012-01-25T14:52:12.867Z</ns0:updated> 
    <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/> 
    <ns0:id>domain.com</ns0:id> 
    <ns0:generator version="1.0" uri="http://www.google.com/m8/feeds">Contacts</ns0:generator> 
    <ns0:author> 
     <ns0:name>domain.com</ns0:name> 
    </ns0:author> 
    <ns0:link type="text/html" rel="alternate" href="http://www.google.com/"/> 
    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#feed" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full"/> 
    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#batch" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/batch"/> 
    <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300"/> 
    <ns2:startIndex>1</ns2:startIndex> 
    <ns2:itemsPerPage>300</ns2:itemsPerPage> 
    <ns0:entry ns1:etag=""CRAPQR4KTit7I2A4""> 
     <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/> 
     <ns0:id>http://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson</ns0:id> 
     <ns1:name> 
      <ns1:familyName>Person</ns1:familyName> 
      <ns1:fullName>Name Person</ns1:fullName> 
      <ns1:givenName>Name</ns1:givenName> 
     </ns1:name> 
     <ns0:updated>2012-01-25T14:52:13.081Z</ns0:updated> 
     <ns1:organization rel="http://schemas.google.com/g/2005#work" primary="true"> 
      <ns1:orgTitle>JobField</ns1:orgTitle> 
      <ns1:orgDepartment>DepartmentField</ns1:orgDepartment> 
      <ns1:orgName>CompanyField</ns1:orgName> 
     </ns1:organization> 
     <ns3:status indexed="true"/> 
     <ns0:title>Name Person</ns0:title> 
     <ns0:link type="image/*" rel="http://schemas.google.com/contacts/2008/rel#photo" href="https://www.google.com/m8/feeds/photos/profile/domain.com/nperson"/> 
     <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/> 
     <ns0:link type="application/atom+xml" rel="edit" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/> 
     <ns1:email rel="http://schemas.google.com/g/2005#other" address="[email protected]"/> 
     <ns1:email rel="http://schemas.google.com/g/2005#other" primary="true" address="[email protected]"/> 
     <ns4:edited>2012-01-25T14:52:13.081Z</ns4:edited> 
    </ns0:entry> 
    <ns0:title>domain.com's Profiles</ns0:title> 
</ns0:feed> 

我能够拉动数据形成的名称,组织和电子邮件领域与beautifulstonesoup与此代码:

profiles_feed = gd_client.GetProfilesFeed('https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300') 

soup = BeautifulSoup(str(profiles_feed)) 


for tag in soup.findAll('ns1:name'): 
    print tag.find('ns1:familyname').text 
    print tag.find('ns1:fullname').text 
    print tag.find('ns1:givenname').text 

for tag in soup.findAll('ns1:organization'): 
    print tag.find('ns1:orgtitle').text 
    print tag.find('ns1:orgdepartment').text 
    print tag.find('ns1:orgname').text 

for tag in soup.findAll('ns1:email',address=True): 
    print tag['address'] 

我希望能够抓住数据组从每一个NS0在一起:入口节点,所以它的输出线,如:姓,给定的名称,组织名称,组织名称,电子邮件

我已经尝试使用:

for tag in soup('ns0:entry'): 
    print tag.name.familyName.text 

但将其视为属性

我想过使用XPath,但我找不到属于beautifulstonesoup和XPath的任何文档,所以我不知道它支持它本土。那么,我如何搜索每个入口节点并返回所有特定于该条目的数据,而不是按标记分组。从文档(http://www.crummy.com/software/BeautifulSoup/documentation.html#Parsing XML)

回答

1
>>> from BeautifulSoup import BeautifulStoneSoup 
>>> xml = """<ns0:feed ns1:etag="W/"LIESANDCRAPfyt7I2A9WhHERE."" xmlns:ns4="http://www.w3.org/2007/app" xmlns:ns3="http://schemas.google.com/contact/2008" xmlns:ns2="http://a9.com/-/spec/opensearchrss/1.0/" xmlns:ns1="http://schemas.google.com/g/2005" xmlns:ns0="http://www.w3.org/2005/Atom"> 
...    <ns0:updated>2012-01-25T14:52:12.867Z</ns0:updated> 
...    <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/> 
...    <ns0:id>domain.com</ns0:id> 
...    <ns0:generator version="1.0" uri="http://www.google.com/m8/feeds">Contacts</ns0:generator> 
...    <ns0:author> 
...     <ns0:name>domain.com</ns0:name> 
...    </ns0:author> 
...    <ns0:link type="text/html" rel="alternate" href="http://www.google.com/"/> 
...    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#feed" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full"/> 
...    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#batch" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/batch"/> 
...    <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300"/> 
...    <ns2:startIndex>1</ns2:startIndex> 
...    <ns2:itemsPerPage>300</ns2:itemsPerPage> 
...    <ns0:entry ns1:etag=""CRAPQR4KTit7I2A4""> 
...     <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/> 
...     <ns0:id>http://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson</ns0:id> 
...     <ns1:name> 
...      <ns1:familyName>Person</ns1:familyName> 
...      <ns1:fullName>Name Person</ns1:fullName> 
...      <ns1:givenName>Name</ns1:givenName> 
...     </ns1:name> 
...     <ns0:updated>2012-01-25T14:52:13.081Z</ns0:updated> 
...     <ns1:organization rel="http://schemas.google.com/g/2005#work" primary="true"> 
...      <ns1:orgTitle>JobField</ns1:orgTitle> 
...      <ns1:orgDepartment>DepartmentField</ns1:orgDepartment> 
...      <ns1:orgName>CompanyField</ns1:orgName> 
...     </ns1:organization> 
...     <ns3:status indexed="true"/> 
...     <ns0:title>Name Person</ns0:title> 
...     <ns0:link type="image/*" rel="http://schemas.google.com/contacts/2008/rel#photo" href="https://www.google.com/m8/feeds/photos/profile/domain.com/nperson"/> 
...     <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/> 
...     <ns0:link type="application/atom+xml" rel="edit" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/> 
...     <ns1:email rel="http://schemas.google.com/g/2005#other" address="[email protected]"/> 
...     <ns1:email rel="http://schemas.google.com/g/2005#other" primary="true" address="[email protected]"/> 
...     <ns4:edited>2012-01-25T14:52:13.081Z</ns4:edited> 
...    </ns0:entry> 
...    <ns0:title>domain.com's Profiles</ns0:title> 
...   </ns0:feed>""" 

注:

BeautifulStoneSoup最常见的缺点是,它不不知道自动关闭标签。 HTML具有一组固定的自闭标签,但使用XML时,它取决于DTD所说的内容。你可以告诉BeautifulStoneSoup某些标签是自闭在他们的名字传递作为selfClosingTags参数的构造器:

>>> soup = BeautifulStoneSoup(xml, selfClosingTags=['ns0:category','ns3:status', 'ns0:link','ns1:email']) 
>>> a = soup.findAll('ns0:entry') 
>>> a[0].find('ns1:familyname') 
<ns1:familyname>Person</ns1:familyname> 
>>> a[0].find('ns1:familyname').text 
u'Person' 
>>> a[0].find('ns1:givenname') 
<ns1:givenname>Name</ns1:givenname> 
>>> a[0].find('ns1:givenname').text 
u'Name' 
>>> for entry in a: 
...  print ', '.join([entry.find('ns1:familyname').text, entry.find('ns1:givenname').text, entry.find('ns1:orgtitle').text, entry.find('ns1:orgname').text, entry.find('ns1:email')['address']]) 
... 
Person, Name, JobField, CompanyField, [email protected] 

希望这有助于。

+0

这完美的作品,谢谢你帮我明白这一点。只是一个问题;解析器在找到一个空的attrib时停下来,我在文档中找不到任何东西,你知道是否有一个标志忽略空的attribs和标签吗? – Kevin

+0

'entry.find('ns1:email')。get('address','No-address-found')'你可以改变''无地址找到''是你想要的任何字符串。请参阅:http://docs.python.org/library/stdtypes.html#dict.get – sgallen

+0

对不起,我应该更具体一点,如果文本字段是空白的,地址字段的attrib很可能不会在我将要使用的xml中是空白的,但是像orgname这样的文本字段可能会。 – Kevin