Kedro：找不到名为“__default__”的管道
Kedro : Failed to find the pipeline named '__default__'
kedro 有问题。 'register_pipelines' 函数似乎不是 运行 或创建我从中返回的 default 管道。
错误是
(kedro-environment) C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files>kedro run
2021-03-22 13:30:28,201 - kedro.framework.session.store - INFO - `read()` not implemented for `BaseSessionStore`. Assuming empty store.
fatal: not a git repository (or any of the parent directories): .git
2021-03-22 13:30:28,447 - kedro.framework.session.session - WARNING - Unable to git describe C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files
2021-03-22 13:30:28,476 - root - INFO - ** Kedro project dcs_files
2021-03-22 13:30:28,486 - kedro.framework.session.store - INFO - `save()` not implemented for `BaseSessionStore`. Skipping the step.
Traceback (most recent call last):
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\context\context.py", line 304, in _get_pipeline
return pipelines[name]
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\dynaconf\utils\functional.py", line 17, in inner
return func(self._wrapped, *args)
KeyError: '__default__'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "C:\Anaconda3\envs\kedro-environment\Scripts\kedro-script.py", line 9, in <module>
sys.exit(main())
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\cli\cli.py", line 228, in main
cli_collection(**cli_context)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 782, in main
rv = self.invoke(ctx)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 610, in invoke
return callback(*args, **kwargs)
File "C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files\src\dcs_package\cli.py", line 240, in run
pipeline_name=pipeline,
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\session\session.py", line 344, in run
pipeline = context._get_pipeline(name=pipeline_name)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\context\context.py", line 310, in _get_pipeline
) from exc
kedro.framework.context.context.KedroContextError: Failed to find the pipeline named '__default__'. It needs to be generated and returned by the 'register_pipelines' function.
我的 src\dcs_package\pipeline_registry.py 看起来像这样：
# Copyright 2021 QuantumBlack Visual Analytics Limited
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
# EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
# OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND
# NONINFRINGEMENT. IN NO EVENT WILL THE LICENSOR OR OTHER CONTRIBUTORS
# BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY, WHETHER IN AN
# ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF, OR IN
# CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
#
# The QuantumBlack Visual Analytics Limited ("QuantumBlack") name and logo
# (either separately or in combination, "QuantumBlack Trademarks") are
# trademarks of QuantumBlack. The License does not grant you any right or
# license to the QuantumBlack Trademarks. You may not use the QuantumBlack
# Trademarks or any confusingly similar mark as a trademark for your product,
# or use the QuantumBlack Trademarks in any other manner that might cause
# confusion in the marketplace, including but not limited to in advertising,
# on websites, or on software.
#
# See the License for the specific language governing permissions and
# limitations under the License.
"""Project pipelines."""
from typing import Dict
from kedro.pipeline import Pipeline, node
from .pipelines.data_processing.pipeline import create_pipeline
import logging
def register_pipelines() -> Dict[str, Pipeline]:
"""Register the project's pipelines.
Returns:
A mapping from a pipeline name to a ``Pipeline`` object.
"""
log = logging.getLogger(__name__)
log.info("Start register_pipelines")
data_processing_pipeline = create_pipeline()
log.info("create pipeline done")
return {
"__default__": data_processing_pipeline,
"dp": data_processing_pipeline
}
然后我有一个“src\dcs_package\pipelines\data_processing\pipeline.py”文件，它有一个真正简单的函数，输出“测试字符串”，没有别的。
我能够从我的目录中读取一些项目（一个 csv 和一个 xlsx），所以我认为所有依赖项都工作正常。
您使用的是什么版本的 kedro？ kedro 0.17.2 存在一些问题，其中真正的错误被屏蔽，并且 return 您看到的异常。错误的根本原因实际上可能是其他 ModuleNotFoundError 或 AttributeError。尝试在 kedro run 之前执行 kedro install，看看是否可以解决问题。
我在 Kedro 0.17.(0~3) 中发现，此错误消息的一个原因是您的 pipeline.py 中某个节点的输入或输出比您的节点接受/输出的要多/少在 node.py 中定义。我建议检查您的 pipeline.py 和 node.py 以确保两个文件中的输入/输出数量匹配。
kedro 有问题。 'register_pipelines' 函数似乎不是 运行 或创建我从中返回的 default 管道。
错误是
(kedro-environment) C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files>kedro run
2021-03-22 13:30:28,201 - kedro.framework.session.store - INFO - `read()` not implemented for `BaseSessionStore`. Assuming empty store.
fatal: not a git repository (or any of the parent directories): .git
2021-03-22 13:30:28,447 - kedro.framework.session.session - WARNING - Unable to git describe C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files
2021-03-22 13:30:28,476 - root - INFO - ** Kedro project dcs_files
2021-03-22 13:30:28,486 - kedro.framework.session.store - INFO - `save()` not implemented for `BaseSessionStore`. Skipping the step.
Traceback (most recent call last):
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\context\context.py", line 304, in _get_pipeline
return pipelines[name]
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\dynaconf\utils\functional.py", line 17, in inner
return func(self._wrapped, *args)
KeyError: '__default__'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "C:\Anaconda3\envs\kedro-environment\Scripts\kedro-script.py", line 9, in <module>
sys.exit(main())
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\cli\cli.py", line 228, in main
cli_collection(**cli_context)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 782, in main
rv = self.invoke(ctx)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\click\core.py", line 610, in invoke
return callback(*args, **kwargs)
File "C:\Users\cc667216\OneDrive\DCS_Pipeline\dcs_files\src\dcs_package\cli.py", line 240, in run
pipeline_name=pipeline,
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\session\session.py", line 344, in run
pipeline = context._get_pipeline(name=pipeline_name)
File "C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\context\context.py", line 310, in _get_pipeline
) from exc
kedro.framework.context.context.KedroContextError: Failed to find the pipeline named '__default__'. It needs to be generated and returned by the 'register_pipelines' function.
我的 src\dcs_package\pipeline_registry.py 看起来像这样：
# Copyright 2021 QuantumBlack Visual Analytics Limited
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
# EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES
# OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND
# NONINFRINGEMENT. IN NO EVENT WILL THE LICENSOR OR OTHER CONTRIBUTORS
# BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY, WHETHER IN AN
# ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF, OR IN
# CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
#
# The QuantumBlack Visual Analytics Limited ("QuantumBlack") name and logo
# (either separately or in combination, "QuantumBlack Trademarks") are
# trademarks of QuantumBlack. The License does not grant you any right or
# license to the QuantumBlack Trademarks. You may not use the QuantumBlack
# Trademarks or any confusingly similar mark as a trademark for your product,
# or use the QuantumBlack Trademarks in any other manner that might cause
# confusion in the marketplace, including but not limited to in advertising,
# on websites, or on software.
#
# See the License for the specific language governing permissions and
# limitations under the License.
"""Project pipelines."""
from typing import Dict
from kedro.pipeline import Pipeline, node
from .pipelines.data_processing.pipeline import create_pipeline
import logging
def register_pipelines() -> Dict[str, Pipeline]:
"""Register the project's pipelines.
Returns:
A mapping from a pipeline name to a ``Pipeline`` object.
"""
log = logging.getLogger(__name__)
log.info("Start register_pipelines")
data_processing_pipeline = create_pipeline()
log.info("create pipeline done")
return {
"__default__": data_processing_pipeline,
"dp": data_processing_pipeline
}
然后我有一个“src\dcs_package\pipelines\data_processing\pipeline.py”文件，它有一个真正简单的函数，输出“测试字符串”，没有别的。
我能够从我的目录中读取一些项目（一个 csv 和一个 xlsx），所以我认为所有依赖项都工作正常。
您使用的是什么版本的 kedro？ kedro 0.17.2 存在一些问题，其中真正的错误被屏蔽，并且 return 您看到的异常。错误的根本原因实际上可能是其他 ModuleNotFoundError 或 AttributeError。尝试在 kedro run 之前执行 kedro install，看看是否可以解决问题。
我在 Kedro 0.17.(0~3) 中发现，此错误消息的一个原因是您的 pipeline.py 中某个节点的输入或输出比您的节点接受/输出的要多/少在 node.py 中定义。我建议检查您的 pipeline.py 和 node.py 以确保两个文件中的输入/输出数量匹配。