PHP shell_exec returns 一段时间后为空字符串
PHP shell_exec returns empty string after a while
我制作了一个 Symfony 控制台命令,它使用 pngquant
来处理和压缩一长串图像。图像是从 CSV 文件中读取的。
该批处理在本地环境中工作正常但在舞台环境中它工作了大约 5 分钟然后它开始从 shell_exec
命令返回空结果。我什至做了一个重试系统,但它总是返回空结果:
// escapeshellarg() makes this safe to use with any path
// errors are redirected to standard output
$command = sprintf(
'%s --quality %d-%d --output %s --force %s 2>&1',
$this->pngquantBinary,
$minQuality,
$maxQuality,
escapeshellarg($tempPath),
$path
);
// tries a few times
$data = null;
$attempt = 0;
do {
// command result
$data = shell_exec($command);
// error
if (null !== $data) {
$this->logger->warning('An error occurred while compressing the image with pngquant', [
'command' => $command,
'output' => $data,
'cpu' => sys_getloadavg(),
'attempt' => $attempt + 1,
'sleep' => self::SLEEP_BETWEEN_ATTEMPTS,
]);
sleep(self::SLEEP_BETWEEN_ATTEMPTS);
}
++$attempt;
} while ($attempt < self::MAX_NUMBER_OF_ATTEMPTS && null !== $data);
// verifies that the command has finished successfully
if (null !== $data) {
throw new \Exception(sprintf('There was an error compressing the file with command "%s": %s.', $command, $data));
}
问题是在同一环境中的另一个shell中执行的相同命令可以正常工作!我的意思是,当我记录错误时,如果我将完全相同的命令放在同一台服务器上的另一个实例中,工作正常。
即使从 Symfony 日志中我也看不到任何错误,我应该在哪里寻找更详细的错误?
这可能是什么原因造成的?执行期间内存和处理器都很好!
经过多次尝试,我读到了这个问题:
Symfony2 Process component - unable to create pipe and launch a new process
解决方案是在循环期间刷新后添加对 gc_collect_cycles
的调用!
if ($flush || 0 === ($index % self::BATCH_SIZE)) {
$this->em->flush();
$this->em->clear();
// clears the temp directory after flushing
foreach ($this->tempImages as $tempImage) {
unlink($tempImage);
}
$this->tempImages = [];
// forces collection of any existing garbage cycles
gc_collect_cycles();
}
重要提示: 还要注意 磁盘 inode 的数量。
df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 125193 392 124801 1% /dev
tmpfs 127004 964 126040 1% /run
/dev/vda2 5886720 5831604 55116 100% /
我制作了一个 Symfony 控制台命令,它使用 pngquant
来处理和压缩一长串图像。图像是从 CSV 文件中读取的。
该批处理在本地环境中工作正常但在舞台环境中它工作了大约 5 分钟然后它开始从 shell_exec
命令返回空结果。我什至做了一个重试系统,但它总是返回空结果:
// escapeshellarg() makes this safe to use with any path
// errors are redirected to standard output
$command = sprintf(
'%s --quality %d-%d --output %s --force %s 2>&1',
$this->pngquantBinary,
$minQuality,
$maxQuality,
escapeshellarg($tempPath),
$path
);
// tries a few times
$data = null;
$attempt = 0;
do {
// command result
$data = shell_exec($command);
// error
if (null !== $data) {
$this->logger->warning('An error occurred while compressing the image with pngquant', [
'command' => $command,
'output' => $data,
'cpu' => sys_getloadavg(),
'attempt' => $attempt + 1,
'sleep' => self::SLEEP_BETWEEN_ATTEMPTS,
]);
sleep(self::SLEEP_BETWEEN_ATTEMPTS);
}
++$attempt;
} while ($attempt < self::MAX_NUMBER_OF_ATTEMPTS && null !== $data);
// verifies that the command has finished successfully
if (null !== $data) {
throw new \Exception(sprintf('There was an error compressing the file with command "%s": %s.', $command, $data));
}
问题是在同一环境中的另一个shell中执行的相同命令可以正常工作!我的意思是,当我记录错误时,如果我将完全相同的命令放在同一台服务器上的另一个实例中,工作正常。
即使从 Symfony 日志中我也看不到任何错误,我应该在哪里寻找更详细的错误?
这可能是什么原因造成的?执行期间内存和处理器都很好!
经过多次尝试,我读到了这个问题:
Symfony2 Process component - unable to create pipe and launch a new process
解决方案是在循环期间刷新后添加对 gc_collect_cycles
的调用!
if ($flush || 0 === ($index % self::BATCH_SIZE)) {
$this->em->flush();
$this->em->clear();
// clears the temp directory after flushing
foreach ($this->tempImages as $tempImage) {
unlink($tempImage);
}
$this->tempImages = [];
// forces collection of any existing garbage cycles
gc_collect_cycles();
}
重要提示: 还要注意 磁盘 inode 的数量。
df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 125193 392 124801 1% /dev
tmpfs 127004 964 126040 1% /run
/dev/vda2 5886720 5831604 55116 100% /