2013-07-26 63 views
0

我正在开发一个网站,该网站允许用户搜索'x'产品并以表格格式显示结果。PHP curl。遍历搜索结果

我打算从另一个网站使用php curl抓取搜索数据。 (被抓的网站的所有者知道并允许它,所以没有法律问题)。

我已经有一个php卷曲代码去登录到网站,并根据用户输入做搜索。我不知道如何通过搜索和输出的结果,然后在我的网站上逐一。

PHP卷曲代码:

$username = '********'; 
$password = '********'; 
$loginUrl = 'http://www.a-website.com/login.asp'; 

//init curl 
$ch = curl_init(); 

//Set the URL to work with 
curl_setopt($ch, CURLOPT_URL, $loginUrl); 

// ENABLE HTTP POST 
curl_setopt($ch, CURLOPT_POST, 1); 

//Set the post parameters 
curl_setopt($ch, CURLOPT_POSTFIELDS, 'username=' . $username . '&password=' . $password . '&submit1=' . 'Login'); 

//Handle cookies for the login 
curl_setopt($ch, CURLOPT_COOKIEJAR, 'cookie stuff hure'); 

//Setting CURLOPT_RETURNTRANSFER variable to 1 will force cURL 
//not to print out the results of its query. 
//Instead, it will return the results as a string return value 
//from curl_exec() instead of the usual true/false. 
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1); 

//execute the request (the login) 
$store = curl_exec($ch); 

/*   * *****************SEARCH HERE****************** */ 
curl_setopt($ch, CURLOPT_URL, 'http://www.a-website.com/Index.asp'); 
//execute the request 
$content = curl_exec($ch); 


//Set the post parameters 

curl_setopt($ch, CURLOPT_POSTFIELDS, 'search_txt_vs=' . '' . '&search_txt_UPC=' . '' . '&search_txt_Name=' . $searchString . 
     '&search_txt_Manufacturer=' . '' . '&submit=' . 'Search'); 
//execute the request (the search) 
$Search = curl_exec($ch); 

print CJSON::encode($Search); 
print $Search; 

//save the data to disk 
print $content; 

下面是从网站进出口报废的HTML代码(顺便说一句是老校表格式)

<td colspan="3" height="100%" valign="top"> 
    <table width="100%" border="0" cellpadding="2" cellspacing="0" bordercolor="#99CCCC" class="text"> 
     <tbody> 
      <tr bgcolor="#9999CC"> 
       <td align="right" class="calendar">Sort &gt;</td> 
       <td align="center"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=1">NDC</a> 
       </td> 
       <td align="left"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=2">Brand Name</a> 
       </td> 
       <td align="center" colspan="2"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=3">Strength</a> 
&nbsp;|&nbsp; <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=4">UD</a> 
       </td> 
       <td align="left"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=5">Stock</a> 
       </td> 
       <td align="center"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=6">Manufacturer</a> 
       </td> 
       <td align="center" bgcolor="cccccc"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=7">AWP</a> 
&nbsp;/&nbsp; <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=8">Your Price</a> 
       </td> 
      </tr> 
      <tr bgcolor="#9999CC"> 
       <td align="right" class="calendar">&nbsp;</td> 
       <td align="center"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=9">UPC</a> 
       </td> 
       <td align="left"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=10">Generic Alt/Name</a> 
       </td> 
       <td align="center" colspan="2"> <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=11">Size</a> 
&nbsp;|&nbsp; <a href="Index.asp?search_txt_UPC=&amp;search_txt_Name=novolin&amp;search_txt_Manufacturer=&amp;orderby=12">Form</a> 
       </td> 
       <td align="left" colspan="3" class="selected">Category</td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center" valign="top" rowspan="2">1 
        <br> <a href="#" onclick="return openCart(19112,0.01021);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169347718</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN 70/ 30U/ML CRT 5X3 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 70-30 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NOVO NORDISK PHARM</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 

    0.01&nbsp; 

    &nbsp;/&nbsp;$ 

    0.01 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center"><span class="smallNorm">000000000000</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('50101');">HUM INSULIN NPH/REG INSULIN HM</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 5X3ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(19112,0.01021);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center" valign="top" rowspan="2">2 
        <br> <a href="#" onclick="return openCart(19116,0.012);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169347418</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN N 100 UN/ML CRT 5X3 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 100 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NNP</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 

     0.00&nbsp; 

    &nbsp;/&nbsp;$ 

    0.01 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center"><span class="smallNorm">000000000000</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('05331');">NPH HUMAN INSULIN ISOPHANE</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 5X3ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(19116,0.012);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center" valign="top" rowspan="2">3 
        <br> <a href="#" onclick="return openCart(45211,0.012);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169231721</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN INNO 70/30 PFS 5X3 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 70-30 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NOVO NORDISK PHARM</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 


     0.00&nbsp; 

    &nbsp;/&nbsp;$ 

    0.01 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center"><span class="smallNorm">000000000000</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('24486');">HUM INSULIN NPH/REG INSULIN HM</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 5X3ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(45211,0.012);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center" valign="top" rowspan="2">4 
        <br> <a href="#" onclick="return openCart(19117,82.0884);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169183311</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN R 100 UN/ML VL 10 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 100 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NOVO NORDISK PHARM</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 

    99.00&nbsp; 

    &nbsp;/&nbsp;$ 

    82.09 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center"><span class="smallNorm">000169183311</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('11642');">INSULIN REGULAR HUMAN</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 10ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(19117,82.0884);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center" valign="top" rowspan="2">5 
        <br> <a href="#" onclick="return openCart(19110,82.0884);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169183711</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN 70/ 30U/ML VL 10 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 70-30 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NOVO NORDISK PHARM</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 

    99.00&nbsp; 

    &nbsp;/&nbsp;$ 

    82.09 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="eeeeee"> 
       <td align="center"><span class="smallNorm">000169183711</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('50001');">HUM INSULIN NPH/REG INSULIN HM</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 10ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(19110,82.0884);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center" valign="top" rowspan="2">6 
        <br> <a href="#" onclick="return openCart(19114,82.0884);"><span class="smallNorm_red">[add]</span></a> 

       </td> 
       <td align="center"><span class="smallNorm">00169183411</span> 
       </td> 
       <td align="left"><span class="smallNorm_red">NOVOLIN N 100 UN/ML VL 10 ML</span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 100 U/ML</span> 
       </td> 
       <td align="left"><span class="smallNorm">YES</span> 
       </td> 
       <td align="center"><span class="smallNorm">NOVO NORDISK PHARM</span> 
       </td> 
       <td align="center"><span class="smallNorm">$ 

    99.00&nbsp; 

    &nbsp;/&nbsp;$ 

    82.09 

    </span> 
       </td> 
      </tr> 
      <tr bgcolor="#99CCCC"> 
       <td align="center"><span class="smallNorm">000000000000</span> 
       </td> 
       <td align="left"><span class="smallNorm"><a href="#" onclick="return openGeneric('11660');">NPH HUMAN INSULIN ISOPHANE</a></span> 
       </td> 
       <td align="center" colspan="2"><span class="smallNorm"> 10ML </span> 
       </td> 
       <td align="left" colspan="3"><span class="smallNorm">&nbsp; 

    <a href="#" onclick="return openreturn(19114,82.0884);"><span class="smallNorm_red">[return]</span> 
        </a>INSULIN</span> 
       </td> 
      </tr> 
     </tbody> 
    </table> 
</td> 

回答

1

你可以尝试添加字符串到DOMDocument并使用getElementsByTagName,然后将它们写入数组或您可以使用的某个东西。点击此处了解详情:http://php.net/manual/en/domdocument.getelementsbytagname.php

而且,类似的问题在这里回答,考虑到你返回HTML:PHP parse HTML tags

+0

嘿感谢您的回答首先的。但你能更具体一点吗?也许是一个例子。我的主要问题是输出没有任何标签名称。它只是表格内部的表格。那么我该如何区分网站的其他部分和我想要展示的实际项目? – ecorvo