Gabor Somogyi created SPARK-26889:
-------------------------------------
Summary: Fix timestamp type in Structured Streaming + Kafka
Integration Guide
Key: SPARK-26889
URL: https://issues.apache.org/jira/browse/SPARK-26889
Project: Spark
Issue Type: Bug
Components: Documentation, Structured Streaming
Affects Versions: 3.0.0
Reporter: Gabor Somogyi
{code:java}
$ spark-shell --packages
org.apache.spark:spark-sql-kafka-0-10_2.11:3.0.0-SNAPSHOT
...
scala> val df = spark.read.format("kafka").option("kafka.bootstrap.servers",
"foo").option("subscribe", "bar").load().printSchema()
root
|-- key: binary (nullable = true)
|-- value: binary (nullable = true)
|-- topic: string (nullable = true)
|-- partition: integer (nullable = true)
|-- offset: long (nullable = true)
|-- timestamp: timestamp (nullable = true)
|-- timestampType: integer (nullable = true)
df: Unit = ()
{code}
In the doc timestamp type is long.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
