Cristian Teodor created SPARK-20914:
---------------------------------------
Summary: Javadoc contains code that is invalid
Key: SPARK-20914
URL: https://issues.apache.org/jira/browse/SPARK-20914
Project: Spark
Issue Type: Improvement
Components: Documentation
Affects Versions: 2.1.1
Reporter: Cristian Teodor
Priority: Minor
i was looking over the
{link]dataset|https://spark.apache.org/docs/2.1.1/api/java/org/apache/spark/sql/Dataset.html{link}
and noticed the code on top that does not make sense in java.
{code}
// To create Dataset<Row> using SparkSession
Dataset<Row> people = spark.read().parquet("...");
Dataset<Row> department = spark.read().parquet("...");
people.filter("age".gt(30))
.join(department, people.col("deptId").equalTo(department("id")))
.groupBy(department.col("name"), "gender")
.agg(avg(people.col("salary")), max(people.col("age")));
{code}
invalid parts:
*"age".gt(30)
*department("id")
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
