由于超过时间限制,marklogic MLCP 导入失败
marklogic MLCP import fail due to time limit exceeded
使用 MLCP 导入 zip 文件时如何避免 "time limit exceeded"。
18/07/02 10:39:19 INFO contentpump.LocalJobRunner: Content type: XML
18/07/02 10:39:19 INFO contentpump.FileAndDirectoryInputFormat: Total input
paths to process : 12
18/07/02 10:39:22 INFO contentpump.LocalJobRunner: completed 0%
18/07/02 10:41:53 INFO contentpump.LocalJobRunner: completed 8%
18/07/02 10:42:16 INFO contentpump.LocalJobRunner: completed 17%
18/07/02 10:42:38 INFO contentpump.LocalJobRunner: completed 25%
18/07/02 10:42:43 INFO contentpump.LocalJobRunner: completed 33%
18/07/02 10:44:09 INFO contentpump.LocalJobRunner: completed 42%
18/07/02 10:44:49 INFO contentpump.LocalJobRunner: completed 50%
18/07/02 10:52:47 ERROR mapreduce.ContentWriter: SVC-EXTIME: Time limit exceeded
18/07/02 10:56:55 WARN mapreduce.ContentWriter: Failed document /R10/3F_7_3600_PaB_2010.xml
我将从使用 -transaction_size 1
和 -batch_size 1
开始。这将导致批处理更快地完成。如果您发现您的 MarkLogic 服务器 运行 内存不足或 cpu,请考虑调低 -thread_count
.
如果调整上述参数还不够,您还可以考虑增加用于上传的 MarkLogic 端口后面的应用服务器的 default time limit
设置。
HTH!
使用 MLCP 导入 zip 文件时如何避免 "time limit exceeded"。
18/07/02 10:39:19 INFO contentpump.LocalJobRunner: Content type: XML
18/07/02 10:39:19 INFO contentpump.FileAndDirectoryInputFormat: Total input
paths to process : 12
18/07/02 10:39:22 INFO contentpump.LocalJobRunner: completed 0%
18/07/02 10:41:53 INFO contentpump.LocalJobRunner: completed 8%
18/07/02 10:42:16 INFO contentpump.LocalJobRunner: completed 17%
18/07/02 10:42:38 INFO contentpump.LocalJobRunner: completed 25%
18/07/02 10:42:43 INFO contentpump.LocalJobRunner: completed 33%
18/07/02 10:44:09 INFO contentpump.LocalJobRunner: completed 42%
18/07/02 10:44:49 INFO contentpump.LocalJobRunner: completed 50%
18/07/02 10:52:47 ERROR mapreduce.ContentWriter: SVC-EXTIME: Time limit exceeded
18/07/02 10:56:55 WARN mapreduce.ContentWriter: Failed document /R10/3F_7_3600_PaB_2010.xml
我将从使用 -transaction_size 1
和 -batch_size 1
开始。这将导致批处理更快地完成。如果您发现您的 MarkLogic 服务器 运行 内存不足或 cpu,请考虑调低 -thread_count
.
如果调整上述参数还不够,您还可以考虑增加用于上传的 MarkLogic 端口后面的应用服务器的 default time limit
设置。
HTH!