PHP数组，添加的foreach多个查询，并行请求并提高性能

Question

我有下面的代码，我从CLI所以没有Apache进程..运行：

//$multiContent is an array of JSON responses 
foreach($multi_Content as $htmlContent) 
{ 

    //get the items from JSON response 
    $htmlContent = $htmlContent['findItems']['0']['searchResult']['0']['item']; 

    //get sellerinfo from each item block 
    foreach($htmlContent as $item) 
    { 
     //print_r($item); 
     $username = $item['seller']['0']['UserName']['0']; 

     //verify if the user already exists in our db 
     $number_object = $db->query("SELECT count(*) as number from users WHERE username='$username'"); 
     $number_object = $number_object->fetch_assoc(); 
     $number = $number_object['number']; 
     if($number < 1) 
     { 
      $db->query("INSERT INTO users(id, username)VALUES('', '$username')"); 
     } 
    } 
} 

是否有可能在处理所有JSON响应一次？我的意思是没有逐个获取每个响应（使用foreach），将所有这些响应都放入单个进程任务中，然后使用并行技术将其全部插入到数据库中。我正在处理大量数据，并且我发现这部分代码的执行速度非常缓慢，所以我们欢迎任何建议！ 我正在使用mysqli

Answer 1

不确定，但我认为如果你使用类似的东西，那应用程序会更快。

$values = array(); 
foreach ($number_object -> fetch_assoc() as $data) 
{ 
    $values[] = "(".$objct['number'].",'".$username."')"; 
    if (count($values) > 9) 
    { 
     $values_str = implode(',', $values); 
     query("INSERT INTO users(id, username) VALUES ".$values_str); 
     $values = array(); 
    } 
} 

Answer 2

确保您已完成"username"字段的索引编制。

也试图做到这一点的变化，如果这样可以提高...

//$multiContent is an array of JSON responses 
$usernames = array(); 
foreach($multi_Content as $htmlContent) 
{ 

    //get the items from JSON response 
    $htmlContent = $htmlContent['findItems']['0']['searchResult']['0']['item']; 

    //get sellerinfo from each item block 
    foreach($htmlContent as $item) 
    { 
     //print_r($item); 
     $username = $item['seller']['0']['UserName']['0']; 

     //verify if the user already exists in our db 
     $number_object = $db->query("SELECT count(id) as number from users WHERE username='$username'"); 
     $number_object = $number_object->fetch_assoc(); 
     $number = $number_object['number']; 
     if($number < 1) 
     { 
      $usernames[] = $username; 
     } 
    } 
} 

if(count($usernames) == 0) 
exit; 

$sql = 'insert into users (username) values '; 
foreach ($usernames as $username) 
{ 
     $sql .= "('".mysql_real_escape_string($username)."'),"; 
} 

//remove out extra comma from end of the string 
$sql = substr($sql, 0 , -1); 

$db->query($sql); 

如你所提到u的处理大量数据，可以insert这$usernames数组中的一批250左右。因为大的查询长度可以禁止插入。