[
https://issues.apache.org/jira/browse/SPARK-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ganesh Chand updated SPARK-16886:
---------------------------------
Description:
Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has
the following code comment:
{code}
// Create DataFrame representing the stream of input lines from connection to
host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
The above comment should be
{code}
// Create Dataset representing the stream of input lines from connection to
host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
because .as[String] returns a Dataset.
Files affected are:
*
examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
was:
Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has
the following code comment:
{code}
// Create DataFrame representing the stream of input lines from connection to
host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
The above comment should be
{code}
// Create Dataset representing the stream of input lines from connection to
host:port
val lines = spark.readStream
.format("socket")
.option("host", host)
.option("port", port)
.load().as[String]
{code}
because .as[String] returns a Dataset.
> StructuredNetworkWordCount code comment incorrectly refers to DataFrame
> instead of Dataset
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-16886
> URL: https://issues.apache.org/jira/browse/SPARK-16886
> Project: Spark
> Issue Type: Bug
> Components: Examples
> Affects Versions: 2.0.0
> Reporter: Ganesh Chand
> Priority: Trivial
> Labels: comment, examples
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Both StructuredNetworkWordCount.scala and StructuredNetworkWordCount.java has
> the following code comment:
> {code}
> // Create DataFrame representing the stream of input lines from connection to
> host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> The above comment should be
> {code}
> // Create Dataset representing the stream of input lines from connection to
> host:port
> val lines = spark.readStream
> .format("socket")
> .option("host", host)
> .option("port", port)
> .load().as[String]
> {code}
> because .as[String] returns a Dataset.
> Files affected are:
> *
> examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
