[
https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cristian Teodor updated SPARK-20914:
------------------------------------
Description:
i was looking over the
[dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html]
and noticed the code on top that does not make sense in java.
{code}
// To create Dataset<Row> using SparkSession
Dataset<Row> people = spark.read().parquet("...");
Dataset<Row> department = spark.read().parquet("...");
people.filter("age".gt(30))
.join(department, people.col("deptId").equalTo(department("id")))
.groupBy(department.col("name"), "gender")
.agg(avg(people.col("salary")), max(people.col("age")));
{code}
invalid parts:
*"age".gt(30)
*department("id")
was:
i was looking over the
{link]dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html{link}
and noticed the code on top that does not make sense in java.
{code}
// To create Dataset<Row> using SparkSession
Dataset<Row> people = spark.read().parquet("...");
Dataset<Row> department = spark.read().parquet("...");
people.filter("age".gt(30))
.join(department, people.col("deptId").equalTo(department("id")))
.groupBy(department.col("name"), "gender")
.agg(avg(people.col("salary")), max(people.col("age")));
{code}
invalid parts:
*"age".gt(30)
*department("id")
> Javadoc contains code that is invalid
> -------------------------------------
>
> Key: SPARK-20914
> URL: https://issues.apache.org/jira/browse/SPARK-20914
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
> Affects Versions: 2.1.1
> Reporter: Cristian Teodor
> Priority: Minor
>
> i was looking over the
> [dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html]
> and noticed the code on top that does not make sense in java.
> {code}
> // To create Dataset<Row> using SparkSession
> Dataset<Row> people = spark.read().parquet("...");
> Dataset<Row> department = spark.read().parquet("...");
> people.filter("age".gt(30))
> .join(department, people.col("deptId").equalTo(department("id")))
> .groupBy(department.col("name"), "gender")
> .agg(avg(people.col("salary")), max(people.col("age")));
> {code}
> invalid parts:
> *"age".gt(30)
> *department("id")
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
