java.lang.IllegalArgumentException: 输入标记不以输入路径开头

java.lang.IllegalArgumentException: Input marker does not start with input path

使用以下代码在 Databricks 中获取此错误。任何人都可以解释错误的含义吗?

df.writeStream \
  .format("delta") \
  .option("checkpointLocation", CHECKPOINT_LOCATION) \
  .trigger(once=True) \
  .start(DELTA_FILE_LOCATION)

错误:

java.lang.IllegalArgumentException: Input marker does not start with input path!

我通过添加 .option("cloudFiles.useIncrementalListing", False)

解决了这个问题

https://docs.databricks.com/spark/latest/structured-streaming/auto-loader-s3.html