https://learn.microsoft.com/en-us/azure/databricks/ldp/for-each-batch
Use ForEachBatch to write to arbitrary data sinks in pipelines - Azure Databricks | Microsoft Learn
Use `foreachBatch` in Lakeflow Spark Declarative Pipelines to take arbitrary actions on streaming data, including transformation and writing to one or more...