1. 首页
  2. 问答
  3. 使用JSOUP从html表格提取非结构化数据

使用JSOUP从html表格提取非结构化数据

2013-11-05 105 views
0

我一直在使用jSoup使用此代码进行试验。我们的想法是从这个页面中提取的电影档期：使用JSOUP从html表格提取非结构化数据

http://www.blitzmegaplex.com/en/schedule_movie.php?id=MOV1970

到目前为止，我只能单独提取电影的名称。由于它使用特定的类名称（“separator2”）进行标记。而其余的则被命名为“分隔符”。

我试图建立使用循环以下步骤： 对于每一行表：

  1. 拿到电影院标题
  2. （步骤＃1行）跳过它下面一行。
  3. 获得第二个名为“分隔符”的类
  4. 从下面的所有行中获取第二个（来自步骤＃3的行）。直到它到达包含名为“separator2”的类的下一行
  5. 重复此过程，直到处理完所有行。

任何人都可以建议我该怎么做？或者更好的建议？

谢谢。

我迄今为止代码：

public void getMovieSchedule(String movieUrl) throws IOException 
{ 


    //URL url = new URL(movieUrl); 
    //Document doc = Jsoup.parse(url, 3000); 

    //Element table = doc.select("table[div=scheduletbl]").first(); 
    //Iterator<Element> ite = table.select("tr").iterator(); 
    //ite.next(); // Skip the first row. 

    // Actual content 
    //print(ite.next().text()); 

    *** CODE ABOVE DOES NOT WORK *** 

    //final String urlSchedule = "http://www.blitzmegaplex.com/en/schedule_movie.php?id=MOV1970"; 

    Document doc = Jsoup.connect(movieUrl).get(); 
    Elements div = doc.select("div.panelbox"); 

    for(Element child : div) 
    { 
     Elements table = child.select("table"); 
     Elements row = table.select("tr"); // The actual content. 

     for (Element a: row) 
     { 
      Elements cinemaName = a.select("td.separator2"); 
      print(cinemaName.text().toString()); 
     } 
    } 
}

HTML被提取（一些代码省略）：

<table width="95%" border="0" cellpadding="2" cellspacing="0" id="scheduletbl"> 
    <tbody> 

    <tr> 
    <td colspan="3" class="separator2"><strong>BLITZMEGAPLEX - PARIS VAN JAVA, BANDUNG</strong></td> 
    </tr> 

    <tr> 
    <td colspan="3"><img src="../img/ico_rss_schedule_white.gif" width="16" height="16" hspace="5" align="left"><strong><a href="../rss/schedule.php" class="navlink">RSS- Paris van Java</a></strong></td> 
    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td colspan="2" class="separator">TUESDAY, 05 NOVEMBER 2013</td> 
    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    10:30&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0100&amp;movie=MOV1970&amp;showtime=10:30&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    13:15&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0100&amp;movie=MOV1970&amp;showtime=13:15&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    16:00&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0100&amp;movie=MOV1970&amp;showtime=16:00&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    18:45&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0100&amp;movie=MOV1970&amp;showtime=18:45&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    21:30&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0100&amp;movie=MOV1970&amp;showtime=21:30&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td colspan="3" class="separator2"><strong>BLITZMEGAPLEX - GRAND INDONESIA, JAKARTA</strong></td> 
    </tr> 

    <tr> 
    <td colspan="3"><img src="../img/ico_rss_schedule_white.gif" width="16" height="16" hspace="5" align="left"><strong><a href="../rss/schedule.php" class="navlink">RSS- Grand Indonesia</a></strong></td> 
    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td colspan="2" class="separator">TUESDAY, 05 NOVEMBER 2013</td> 
    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    10:45&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0200&amp;movie=MOV1970&amp;showtime=10:45&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    13:30&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0200&amp;movie=MOV1970&amp;showtime=13:30&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    16:15&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0200&amp;movie=MOV1970&amp;showtime=16:15&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    19:00&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0200&amp;movie=MOV1970&amp;showtime=19:00&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 

    </tr> 
    <tr> 
    <td class="separator">&nbsp;</td> 
    <td width="20%" class="separator" rel="2D"> 
    21:45&nbsp;&nbsp;&nbsp; 
    </td> 
    <td width="30%" class="separator"> 
    <a href="https://www.blitzmegaplex.com/olb/seats.php?showdate=2013-11-05&amp;cinema=0200&amp;movie=MOV1970&amp;showtime=21:45&amp;suite=N&amp;movieformat=2D" class="navlink" target="_blank">Buy Tickets</a></td> 
    </tr> 
    ... MORE <tr> here ... 
    </tbody></table>

来源

2013-11-05 Jeremy

回答

0

如果我正确理解你的问题，你只需要提取一些细节从表（即电影名称，日期和时间），但你有麻烦，因为大多数行具有相同的className。

所以此基础上，这里是我的解决方案：

Elements e = doc.select("table#scheuletbl > tbody > tr > td"); 
for (Element el : e) { 
    if (el.hasClass("separator2")) System.out.println(el.text()); // cinema name 
    else if (el.toString().contains("colspan=\"2\"")) System.out.println(el.text()); // date 
    else if (el.hasAttr("rel")) System.out.println(el.text()); // times 
}

这将打印出：

BLITZMEGAPLEX - PARIS VAN JAVA, BANDUNG 
TUESDAY, 05 NOVEMBER 2013 
10:30    
13:15    
16:00    
18:45    
21:30    
BLITZMEGAPLEX - GRAND INDONESIA, JAKARTA 
TUESDAY, 05 NOVEMBER 2013 
10:45    
13:30    
16:15    
19:00    
21:45 

当然，该解决方案具有连接到该网站上的特定表，但由于只要格式不经常变化，并且在整个网站中保持一致，它就会起作用。您可以考虑创建一个类来存储所有这些信息。

来源

2013-11-06 05:02:18 ashatte

相关问题

 相关问题