[
https://issues.apache.org/jira/browse/SPARK-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikhil updated SPARK-23215:
---------------------------
Description:
Peforming groupByKey operation followed by reduceGroups on dataset results in
java.lang.ArrayIndexOutOfBoundsException.
*Input data(*spark_issue.csv*):*
1,nikhil
2,amit
3,rajeev
1,nikhil
2,amit2
3,rajeev2
*Attached Code,csv and stacktrace.*
*Note:* If we change the data so that all rows are distinct over two columns of
input csv,above code does not throw error.
was:
Peforming groupByKey operation followed by reduceGroups on dataset results in
java.lang.ArrayIndexOutOfBoundsException.
*Input data(*spark_issue.csv*):*
1,nikhil
2,amit
3,rajeev
1,nikhil
2,amit2
3,rajeev2
*Note:* If we change the data so that all rows are distinct over two columns of
input csv,above code does not throw error.
> Dataset Grouping: Index out of bounds error
> -------------------------------------------
>
> Key: SPARK-23215
> URL: https://issues.apache.org/jira/browse/SPARK-23215
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.1.0, 2.2.0
> Reporter: Nikhil
> Priority: Major
> Attachments: SparkIndexOutOfBoundsIssue.java, spark_issue.csv,
> stack_trace.txt
>
>
> Peforming groupByKey operation followed by reduceGroups on dataset results in
> java.lang.ArrayIndexOutOfBoundsException.
> *Input data(*spark_issue.csv*):*
> 1,nikhil
> 2,amit
> 3,rajeev
> 1,nikhil
> 2,amit2
> 3,rajeev2
> *Attached Code,csv and stacktrace.*
> *Note:* If we change the data so that all rows are distinct over two columns
> of input csv,above code does not throw error.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
