java.lang.IllegalArgumentException: 输入标记不以输入路径开头
java.lang.IllegalArgumentException: Input marker does not start with input path
使用以下代码在 Databricks 中获取此错误。任何人都可以解释错误的含义吗?
df.writeStream \
.format("delta") \
.option("checkpointLocation", CHECKPOINT_LOCATION) \
.trigger(once=True) \
.start(DELTA_FILE_LOCATION)
错误:
java.lang.IllegalArgumentException: Input marker does not start with input path!
我通过添加 .option("cloudFiles.useIncrementalListing", False)
解决了这个问题
https://docs.databricks.com/spark/latest/structured-streaming/auto-loader-s3.html
使用以下代码在 Databricks 中获取此错误。任何人都可以解释错误的含义吗?
df.writeStream \
.format("delta") \
.option("checkpointLocation", CHECKPOINT_LOCATION) \
.trigger(once=True) \
.start(DELTA_FILE_LOCATION)
错误:
java.lang.IllegalArgumentException: Input marker does not start with input path!
我通过添加 .option("cloudFiles.useIncrementalListing", False)
https://docs.databricks.com/spark/latest/structured-streaming/auto-loader-s3.html