OpenVINO 1D CNN 推理设备在使用 MYRIAD 重启后没有出现，但可以使用 CPU
OpenVINO 1D CNN inference device didn't appear after reboot with MYRIAD but could work with CPU
我的环境是Windows11，版本openvino_2022.1.0.643。
我使用mo --saved_model_dir=. -b=1 --data_type=FP16生成IR文件。
模型的输入是一个包含 240 字节数据的二进制文件。
当我 运行 benchmark_app.
时，它与 CPU 一起工作正常
但是 benchmark_app 无法正确执行 NCS2。
[Step 10/11] Measuring performance (Start inference asynchronously, 4 inference requests, inference only: True, limits: 60000 ms duration)
[ INFO ] Benchmarking in inference only mode (inputs filling are not included in measurement loop).
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[31mF: [global] [ 0] [EventRead00Thr] dispatcherEventReceive:92 Duplicate id detected.
[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [ncAPI] [ 0] [] ncGraphQueueInference:3453 Can't get trigger response[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[ ERROR ] Failed to queue inference: NC_ERROR
Traceback (most recent call last):
File "c:\users\john0\openvino_env\lib\site-packages\openvino\tools\benchmark\main.py", line 451, in run
duration_ms = f"{benchmark.first_infer(requests):.2f}"
File "c:\users\john0\openvino_env\lib\site-packages\openvino\tools\benchmark\benchmark.py", line 79, in first_infer
requests.wait_all()
RuntimeError: Failed to queue inference: NC_ERROR[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=433
[0m
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncFifoDestroy:3161 myriad NACK
[0m
[Warning][VPU][MyriadPlugin] ncFifoDelete result NC_ERROR
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncFifoDestroy:3161 myriad NACK
[0m
[[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
Warning][VPU][MyriadPlugin[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_CLOSE_STREAM_REQ
[0m
] ncFifoDelete result NC_ERROR
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncGraphDestroy:2232 myriad NACK
[0m
[Warning][VPU][MyriadPlugin] Deallocate Graph result NC_ERROR.
[36mI: [ncAPI] [ 0] [] ncDeviceClose:1708 Removing device...[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_CLOSE_STREAM_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_RESET_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [ncAPI] [ 0] [] ncDeviceClose:1851 Device didn't appear after reboot[0m
[36mI: [ncAPI] [ 0] [] destroyDeviceHandle:1651 Destroying device handler[0m
在 API 2.0 中使用 NCS2 的 1D CNN 是否存在错误？
但是1D CNN在过去的版本中似乎不支持
更新我的文件 here。
（ZIP 文件包含 3 个 IR 文件和 1 个输入文件。）
以下是我使用的基准测试命令
benchmark_app -m saved_model.xml -i A4C_LV_V.bin -d MYRIAD
我用 openvino_2022.1.0.643 版本试过 Windows 10。
但是面对同样的结果
到目前为止，Windows11 仍然是官方不支持的。 OpenVINO 系统需要 Microsoft Windows 10、64 位。当 OpenVINO 与不受支持的 OS.
一起使用时，预计会出现问题
您需要考虑恢复到 Windows 10 环境。
你可以参考这个OpenVINO System Requirement.
我的环境是Windows11，版本openvino_2022.1.0.643。
我使用mo --saved_model_dir=. -b=1 --data_type=FP16生成IR文件。
模型的输入是一个包含 240 字节数据的二进制文件。
当我 运行 benchmark_app.
但是 benchmark_app 无法正确执行 NCS2。
[Step 10/11] Measuring performance (Start inference asynchronously, 4 inference requests, inference only: True, limits: 60000 ms duration)
[ INFO ] Benchmarking in inference only mode (inputs filling are not included in measurement loop).
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[31mF: [global] [ 0] [EventRead00Thr] dispatcherEventReceive:92 Duplicate id detected.
[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [ncAPI] [ 0] [] ncGraphQueueInference:3453 Can't get trigger response[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[ ERROR ] Failed to queue inference: NC_ERROR
Traceback (most recent call last):
File "c:\users\john0\openvino_env\lib\site-packages\openvino\tools\benchmark\main.py", line 451, in run
duration_ms = f"{benchmark.first_infer(requests):.2f}"
File "c:\users\john0\openvino_env\lib\site-packages\openvino\tools\benchmark\benchmark.py", line 79, in first_infer
requests.wait_all()
RuntimeError: Failed to queue inference: NC_ERROR[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=433
[0m
[35mE: [global] [ 0] [EventRead00Thr] handleIncomingEvent:676 handleIncomingEvent() Read failed -2
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[31mF: [xLink] [ 0] [Scheduler00Thr] dispatcherResponseServe:852 no request for this response: XLINK_WRITE_RESP 1
[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncFifoDestroy:3161 myriad NACK
[0m
[Warning][VPU][MyriadPlugin] ncFifoDelete result NC_ERROR
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncFifoDestroy:3161 myriad NACK
[0m
[[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
Warning][VPU][MyriadPlugin[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_CLOSE_STREAM_REQ
[0m
] ncFifoDelete result NC_ERROR
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_WRITE_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [global] [ 0] [] addEvent:361 Condition failed: event->header.flags.bitField.ack != 1[0m
[35mE: [global] [ 0] [] addEventWithPerf:373 addEvent(event, timeoutMs) method call failed with an error: 3[0m
[35mE: [global] [ 0] [] XLinkReadData:156 Condition failed: (addEventWithPerf(&event, &opTime, 0xFFFFFFFF))[0m
[35mE: [ncAPI] [ 0] [] getGraphMonitorResponseValue:1901 XLink error, rc: X_LINK_ERROR[0m
[33mW: [ncAPI] [ 0] [] ncGraphDestroy:2232 myriad NACK
[0m
[Warning][VPU][MyriadPlugin] Deallocate Graph result NC_ERROR.
[36mI: [ncAPI] [ 0] [] ncDeviceClose:1708 Removing device...[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_CLOSE_STREAM_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [xLinkWinUsb] [ 0] [Scheduler00Thr] usb_bulk_write:467
WinUsb_WritePipe failed with error:=22
[0m
[35mE: [global] [ 0] [Scheduler00Thr] dispatcherEventSend:54 Write failed (header) (err -2) | event XLINK_RESET_REQ
[0m
[35mE: [xLink] [ 0] [Scheduler00Thr] sendEvents:1150 Event sending failed[0m
[35mE: [ncAPI] [ 0] [] ncDeviceClose:1851 Device didn't appear after reboot[0m
[36mI: [ncAPI] [ 0] [] destroyDeviceHandle:1651 Destroying device handler[0m
在 API 2.0 中使用 NCS2 的 1D CNN 是否存在错误？
但是1D CNN在过去的版本中似乎不支持
更新我的文件 here。
（ZIP 文件包含 3 个 IR 文件和 1 个输入文件。）
以下是我使用的基准测试命令
benchmark_app -m saved_model.xml -i A4C_LV_V.bin -d MYRIAD
我用 openvino_2022.1.0.643 版本试过 Windows 10。
但是面对同样的结果
到目前为止，Windows11 仍然是官方不支持的。 OpenVINO 系统需要 Microsoft Windows 10、64 位。当 OpenVINO 与不受支持的 OS.
一起使用时，预计会出现问题您需要考虑恢复到 Windows 10 环境。 你可以参考这个OpenVINO System Requirement.