为什么气流 logging_mixin.py 在日志消息中添加三颗星?
Why is airflow logging_mixin.py adding triple stars to the log message?
以下是 airflow 任务日志的摘录。一旦 logging_mixin.py
接管日志记录,它就会将所有这些星号添加到日志消息中,使其不可读。
我查看了源代码以查看该行发生了什么(在撰写本文时现在是 L109)
https://github.com/apache/airflow/blob/main/airflow/utils/log/logging_mixin.py#L109
self.logger.log(self.level, remove_escape_codes(message))
查看文档,它说它正在删除用于颜色的转义码。
https://github.com/apache/airflow/blob/main/airflow/utils/log/logging_mixin.py#L28
还有其他人 运行 了解这个问题吗?我怎样才能prevent/fix呢?
--------------------------------------------------------------------------------
[2021-07-01 10:21:12,479] {taskinstance.py:1068} INFO - Starting attempt 1 of 3
[2021-07-01 10:21:12,482] {taskinstance.py:1069} INFO -
--------------------------------------------------------------------------------
[2021-07-01 10:21:12,494] {taskinstance.py:1087} INFO - Executing
<Task(SnowflakeOperator): put_csv_file_into_internal_stage> on 2021-05-03T00:00:00+00:00
[2021-07-01 10:21:12,503] {standard_task_runner.py:52} INFO - Started process 16448 to run task
[2021-07-01 10:21:12,509] {standard_task_runner.py:76} INFO - Running: ['airflow', 'tasks', 'run', 'scv', 'put_csv_file_into_internal_stage', '2021-05-03T00:00:00+00:00', '--job-id', '24', '--pool', 'default_pool', '--raw', '--subdir', 'DAGS_FOLDER/scv.py', '--cfg-path', '/tmp/tmpqlig2mm8', '--error-file', '/tmp/tmpnmmwbq6e']
[2021-07-01 10:21:12,513] {standard_task_runner.py:77} INFO - Job 24: Subtask put_csv_file_into_internal_stage
[2021-07-01 10:21:12,557] {logging_mixin.py:104} INFO - Running <TaskInstance: scv.put_csv_file_into_internal_stage 2021-05-03T00:00:00+00:00 [running]> on host [redacted]
[2021-07-01 10:21:12,607] {taskinstance.py:1282} INFO - Exporting the following env vars:
[redacted]
[2021-07-01 10:21:12,624] {logging_mixin.py:104} WARNING - ***-***-***-*** ***L***o***g***g***i***n***g*** ***e***r***r***o***r*** ***-***-***-***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***T***r***a***c***e***b***a***c***k*** ***(***m***o***s***t*** ***r***e***c***e***n***t*** ***c***a***l***l*** ***l***a***s***t***)***:***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***9***9***4***,*** ***i***n*** ***e***m***i***t***
*** *** *** *** ***m***s***g*** ***=*** ***s***e***l***f***.***f***o***r***m***a***t***(***r***e***c***o***r***d***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***8***4***0***,*** ***i***n*** ***f***o***r***m***a***t***
*** *** *** *** ***r***e***t***u***r***n*** ***f***m***t***.***f***o***r***m***a***t***(***r***e***c***o***r***d***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***5***7***7***,*** ***i***n*** ***f***o***r***m***a***t***
*** *** *** *** ***r***e***c***o***r***d***.***m***e***s***s***a***g***e*** ***=*** ***r***e***c***o***r***d***.***g***e***t***M***e***s***s***a***g***e***(***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***3***3***8***,*** ***i***n*** ***g***e***t***M***e***s***s***a***g***e***
*** *** *** *** ***m***s***g*** ***=*** ***m***s***g*** ***%*** ***s***e***l***f***.***a***r***g***s***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***T***y***p***e***E***r***r***o***r***:*** ******* ***w***a***n***t***s*** ***i***n***t***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***C***a***l***l*** ***s***t***a***c***k***:***
以下是 airflow 任务日志的摘录。一旦 logging_mixin.py
接管日志记录,它就会将所有这些星号添加到日志消息中,使其不可读。
我查看了源代码以查看该行发生了什么(在撰写本文时现在是 L109) https://github.com/apache/airflow/blob/main/airflow/utils/log/logging_mixin.py#L109
self.logger.log(self.level, remove_escape_codes(message))
查看文档,它说它正在删除用于颜色的转义码。
https://github.com/apache/airflow/blob/main/airflow/utils/log/logging_mixin.py#L28
还有其他人 运行 了解这个问题吗?我怎样才能prevent/fix呢?
--------------------------------------------------------------------------------
[2021-07-01 10:21:12,479] {taskinstance.py:1068} INFO - Starting attempt 1 of 3
[2021-07-01 10:21:12,482] {taskinstance.py:1069} INFO -
--------------------------------------------------------------------------------
[2021-07-01 10:21:12,494] {taskinstance.py:1087} INFO - Executing
<Task(SnowflakeOperator): put_csv_file_into_internal_stage> on 2021-05-03T00:00:00+00:00
[2021-07-01 10:21:12,503] {standard_task_runner.py:52} INFO - Started process 16448 to run task
[2021-07-01 10:21:12,509] {standard_task_runner.py:76} INFO - Running: ['airflow', 'tasks', 'run', 'scv', 'put_csv_file_into_internal_stage', '2021-05-03T00:00:00+00:00', '--job-id', '24', '--pool', 'default_pool', '--raw', '--subdir', 'DAGS_FOLDER/scv.py', '--cfg-path', '/tmp/tmpqlig2mm8', '--error-file', '/tmp/tmpnmmwbq6e']
[2021-07-01 10:21:12,513] {standard_task_runner.py:77} INFO - Job 24: Subtask put_csv_file_into_internal_stage
[2021-07-01 10:21:12,557] {logging_mixin.py:104} INFO - Running <TaskInstance: scv.put_csv_file_into_internal_stage 2021-05-03T00:00:00+00:00 [running]> on host [redacted]
[2021-07-01 10:21:12,607] {taskinstance.py:1282} INFO - Exporting the following env vars:
[redacted]
[2021-07-01 10:21:12,624] {logging_mixin.py:104} WARNING - ***-***-***-*** ***L***o***g***g***i***n***g*** ***e***r***r***o***r*** ***-***-***-***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***T***r***a***c***e***b***a***c***k*** ***(***m***o***s***t*** ***r***e***c***e***n***t*** ***c***a***l***l*** ***l***a***s***t***)***:***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***9***9***4***,*** ***i***n*** ***e***m***i***t***
*** *** *** *** ***m***s***g*** ***=*** ***s***e***l***f***.***f***o***r***m***a***t***(***r***e***c***o***r***d***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***8***4***0***,*** ***i***n*** ***f***o***r***m***a***t***
*** *** *** *** ***r***e***t***u***r***n*** ***f***m***t***.***f***o***r***m***a***t***(***r***e***c***o***r***d***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***5***7***7***,*** ***i***n*** ***f***o***r***m***a***t***
*** *** *** *** ***r***e***c***o***r***d***.***m***e***s***s***a***g***e*** ***=*** ***r***e***c***o***r***d***.***g***e***t***M***e***s***s***a***g***e***(***)***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - *** *** ***F***i***l***e*** ***"***/***u***s***r***/***l***i***b***6***4***/***p***y***t***h***o***n***3***.***6***/***l***o***g***g***i***n***g***/***_***_***i***n***i***t***_***_***.***p***y***"***,*** ***l***i***n***e*** ***3***3***8***,*** ***i***n*** ***g***e***t***M***e***s***s***a***g***e***
*** *** *** *** ***m***s***g*** ***=*** ***m***s***g*** ***%*** ***s***e***l***f***.***a***r***g***s***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***T***y***p***e***E***r***r***o***r***:*** ******* ***w***a***n***t***s*** ***i***n***t***
[2021-07-01 10:21:12,625] {logging_mixin.py:104} WARNING - ***C***a***l***l*** ***s***t***a***c***k***:***