发送多个GOUTTE请求异步

Question

这是代码我使用

require_once 'goutte.phar'; 
use Goutte\Client; 
$client = new Client(); 
for($i=0;$i<10;$i++){ 
    $crawler = $client->request('GET', 'http://website.com'); 
    echo '<p>'.$crawler->filterXpath('//meta[@property="og:description"]')->attr('content').'</p>'; 
    echo '<p>'.$crawler->filter('title')->text().'</p>'; 
} 

这工作，但需要花费大量的时间来处理？有没有办法更快地做到这一点。

Answer 1

对于初学者来说，代码示例没有任何异步。这意味着您的应用程序将按顺序执行get请求，等待响应，解析响应并返回。

虽然Goutte在内部使用Guzzle，但它并未使用Guzzles异步功能。

要真正使你的代码异步你将要参考狂饮文档上：

• Sending Requests within a Pool
• Asynchronous Response Handling

你上面的代码示例会导致类似：

require 'vendor/autoload.php' //assuming composer package management. 

$client = new GuzzleHttp\Client(); 

$requests = [ 
    $client->createRequest('GET', $url1), 
    $client->createRequest('GET', $url2), 
    $client->createRequest('GET', $url3), 
    $client->createRequest('GET', $url4), 
    $client->createRequest('GET', $url5), 
    $client->createRequest('GET', $url6), 
    $client->createRequest('GET', $url7), 
    $client->createRequest('GET', $url8), 
    $client->createRequest('GET', $url9), 
    $client->createRequest('GET', $url10), 
]; 

$options = [ 
    'complete' => [ 
     [ 
      'fn' => function (CompleteEvent $event) { 
       $crawler = new Symfony\Component\DomCrawler\Crawler(null, $event->getRequest()->getUrl()); 
       $crawler->addContent($event->getResponse->getBody(), $event->getResponse()->getHeader('Content-Type')); 
       echo '<p>'.$crawler->filterXpath('//meta[@property="og:description"]')->attr('content').'</p>'; 
       echo '<p>'.$crawler->filter('title')->text().'</p>'; 
      }, 
      'priority' => 0, // Optional 
      'once'  => false // Optional 
     ] 
    ] 
]; 

$pool = new GuzzleHttp\Pool($client, $requests, $options); 

$pool->wait();