Hi,

Is spark structured streaming supported using Phoenix-Spark driver?
 when phoenix-spark driver is used to write the structured streamed data,
we get the exception

Exception in thread "main" java.lang.UnsupportedOperationException: Data
source org.apache.phoenix.spark does not support streamed writing
at
org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:287)
at
org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:266)



Code:

Dataset<Row> inputDF =
sparkSession
.readStream()
.schema(jsonSchema)
.json(inputPath);



StreamingQuery query = inputDF
.writeStream()
.format("org.apache.phoenix.spark")
.outputMode(OutputMode.Complete())
.option("zkUrl", "localhost:2181")
.option("table","SHM2")
.start();

query.awaitTermination();


Jira - https://issues.apache.org/jira/browse/PHOENIX-4627

Reply via email to