将日志提取到 Oracle 时无法处理 JSON 输入

Question

错误：

    send: b'{"specversion": "1.0", "logEntryBatches": [{"entries": [{"data": "{\"hello\": \"oracle\", \"as\": \"aaa\"}", "id": "ocid1.test.oc1..jkhjkhh23423fd", "time": "2021-04-01T12:19:28.416000Z"}], "source": "EXAMPLE-source-Value", "type": "remediationLogs", "defaultlogentrytime": "2021-04-01T12:19:28.416000Z"}]}'
reply: 'HTTP/1.1 400 Bad Request\r\n'
header: Date: Fri, 02 Apr 2021 07:39:16 GMT
header: opc-request-id: ER6S6HDVTNWUOKCJ7XXZ/OpcRequestIdExample/770899C2C7CA6ABA11D996CC57E8EE8F
header: Content-Type: application/json
header: Connection: close
header: Content-Length: 79
Traceback (most recent call last):
  File "tool.py", line 45, in <module>
    put_logs_response = loggingingestion_client.put_logs(
  File "/home/ubuntu/.local/lib/python3.8/site-packages/oci/loggingingestion/logging_client.py", line 172, in put_logs
    return self.base_client.call_api(
  File "/home/ubuntu/.local/lib/python3.8/site-packages/oci/base_client.py", line 276, in call_api
    response = self.request(request)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/oci/base_client.py", line 388, in request
    self.raise_service_error(request, response)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/oci/base_client.py", line 553, in raise_service_error
    raise exceptions.ServiceError(
oci.exceptions.ServiceError: {'opc-request-id': 'ER6S6HDVTNWUOKCJ7XXZ/OpcRequestIdExample/770899C2C7CA6ABA11D996CC57E8EE8F', 'code': 'InvalidParameter', 'message': 'Unable to process JSON input', 'status': 400}

我正在尝试将 json 数据发送到 Oracle 日志，但出现上述错误。我正在使用 json.dumps(data) 将字典转换为字符串。如果有任何可用的解决方法，请告诉我。

代码：

data = {'hello':'oracle', "as":"aaa"}
put_logs_response = loggingingestion_client.put_logs(
        log_id="ocid1.log.oc1.iad.<<Log OCID>>",
        put_logs_details=oci.loggingingestion.models.PutLogsDetails(
            specversion="1.0",
            log_entry_batches=[
                oci.loggingingestion.models.LogEntryBatch(
                    entries=[
                        oci.loggingingestion.models.LogEntry(
                            data= json.dumps(data),
                            id="ocid1.test.oc1..jkhjkhh23423fd",
                            time=datetime.strptime(
                                "2021-04-01T12:19:28.416Z",
                                "%Y-%m-%dT%H:%M:%S.%fZ"))],
                    source="EXAMPLE-source-Value",
                    type="Logs",
                    defaultlogentrytime=datetime.strptime(
                        "2021-04-01T12:19:28.416Z",
                        "%Y-%m-%dT%H:%M:%S.%fZ"))]),
        timestamp_opc_agent_processing=datetime.strptime(
            "2021-04-01T12:19:28.416Z",
            "%Y-%m-%dT%H:%M:%S.%fZ"),
        opc_agent_version="EXAMPLE-opcAgentVersion-Value",
        opc_request_id="ER6S6HDVTNWUOKCJ7XXZ/OpcRequestIdExample/")

Answer 1

您的数据看起来不错，我认为问题在于时间精度超过毫秒。如果您及时丢失尾随零，它应该可以正常工作。
Format a datetime into a string with milliseconds

https://docs.oracle.com/en-us/iaas/api/#/en/logging-dataplane/20200831/LogEntry/

Answer 2

此异常表明您的 JSON 输入中有一个 InvalidParameter。

oci.exceptions.ServiceError: {'opc-request-id': 'ER6S6HDVTNWUOKCJ7XXZ/OpcRequestIdExample/770899C2C7CA6ABA11D996CC57E8EE8F', 'code': 'InvalidParameter', 'message': 'Unable to process JSON input', 'status': 400}

InvalidParameter 是您的时间戳，即日期 - 2021-04-01T12:19:28.416Z.

根据创建 LogEntry 时Oracle's documentation you need to use a RFC3339-formatted date-time string with milliseconds precision。

此代码片段来自oci-python-sdk - log_entry.py，但它没有像 Oracle 的文档那样提到毫秒精度。

@time.setter
    def time(self, time):
        """
        Sets the time of this LogEntry.
        Optional. The timestamp associated with the log entry. An RFC3339-formatted date-time string.
        If unspecified, defaults to PutLogsDetails.defaultlogentrytime.
        :param time: The time of this LogEntry.
        :type: datetime
        """
        self._time = time

此代码创建一个 UTC RFC3339 投诉时间戳，精度为毫秒

from datetime import datetime
from datetime import timezone

current_utc_time_with_offset = datetime.now(timezone.utc).isoformat()
print(current_utc_time_with_offset)
#output 
2021-04-06T13:00:52.706040+00:00

current_utc_time_with_timezone = datetime.now(timezone.utc).isoformat().replace("+00:00", "Z")
print(current_utc_time_with_timezone)
#output 
2021-04-06T13:09:10.053432Z

这个 Stack Overflow 问题值得一读：

What's the difference between ISO 8601 and RFC 3339 Date Formats?

这篇文章也很有用：

Understanding about RFC 3339 for Datetime and Timezone Formatting in Software Engineering

Answer 3

你的时间是 RFC3339 但精度超过毫秒

'{"specversion": "1.0", "logEntryBatches": [{"entries": [{"data": "{\"hello\": \"oracle\", \"as\" : \"aaa\"}", "id": "ocid1.test.oc1..jkhjkhh23423fd", "time": "2021-04-01T12:19:28.416000Z"}], "source": "EXAMPLE-source-Value", "type": "remediationLogs", "defaultlogentrytime": "2021-04-01T12:19:28.416000Z "}]}'

见https://docs.oracle.com/en-us/iaas/api/#/en/logging-dataplane/20200831/LogEntry/

The timestamp associated with the log entry. An RFC3339-formatted date-time string with milliseconds precision. If unspecified, defaults to PutLogsDetails.defaultlogentrytime.

将日志提取到 Oracle 时无法处理 JSON 输入

Unable to process JSON input when ingesting logs to Oracle

json

python-3.x

oracle-cloud-infrastructure

oracle-cloud-functions