[
https://issues.apache.org/jira/browse/SPARK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016213#comment-17016213
]
Sowmya commented on SPARK-18165:
--------------------------------
Hi [~itsvikramagr] ,Can this library be used in production with spark 2.4 code
rather than command line? I tried to use it with spark code(sbt in intellij) I
tried to use it with this code and see an error "Cannot find data source
kinesis".
val spark = SparkSession.builder
.master("local")
.appName("Spark Kinesis Connector")
.getOrCreate()
println(spark)
val kinesis = spark
.readStream
.format("kinesis")
.option("streamName", "stream name")
.option("endpointUrl", "kinesis endpoint")
.option("startingposition", "TRIM_HORIZON")
.load
> Kinesis support in Structured Streaming
> ---------------------------------------
>
> Key: SPARK-18165
> URL: https://issues.apache.org/jira/browse/SPARK-18165
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Reporter: Lauren Moos
> Priority: Major
>
> Implement Kinesis based sources and sinks for Structured Streaming
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
