OK
This is the equivalent Python code
from pyspark.sql import SparkSession
from pyspark.sql.functions import expr, when
from pyspark.sql.types import StructType, StructField, LongType
from datetime import datetime
spark = SparkSession.builder \
.master("local[*]") \
I described the issue here:
https://stackoverflow.com/questions/77893939/how-does-starttimestamp-option-work-for-the-rate-micro-batch-format
Could someone please respond?
The rate-micro-batch format doesn't seem to respect the startTimestamp
option.
Thanks.
