[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Priority: Minor (was: Major) > Default polling and trigger intervals cause excessive RPC

[jira] [Created] (SPARK-17445) Reference an ASF page as the main place to find third-party packages

Matei Zaharia created SPARK-17445: - Summary: Reference an ASF page as the main place to find third-party packages Key: SPARK-17445 URL: https://issues.apache.org/jira/browse/SPARK-17445 Project:

[jira] [Commented] (SPARK-17429) spark sql length(1) return error

[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472801#comment-15472801 ] cen yuhai commented on SPARK-17429: --- ok, I wil make a PR later > spark sql length(1) return error >

[jira] [Created] (SPARK-17444) spark memory allocation makes workers non responsive

Ofer Eliassaf created SPARK-17444: - Summary: spark memory allocation makes workers non responsive Key: SPARK-17444 URL: https://issues.apache.org/jira/browse/SPARK-17444 Project: Spark Issue

[jira] [Updated] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17339: -- Fix Version/s: 2.0.1 > Fix SparkR tests on Windows >

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472704#comment-15472704 ] Apache Spark commented on SPARK-17442: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472681#comment-15472681 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472682#comment-15472682 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17442: - Target Version/s: 2.0.1, 2.1.0 (was: 2.0.1) > Additional arguments in write.df are not passed to data

[jira] [Commented] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472616#comment-15472616 ] Apache Spark commented on SPARK-17443: -- User 'kishorvpatil' has created a pull request for this

[jira] [Assigned] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17443: Assignee: (was: Apache Spark) > SparkLauncher should allow stoppingApplication and

[jira] [Assigned] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17443: Assignee: Apache Spark > SparkLauncher should allow stoppingApplication and need not rely

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472604#comment-15472604 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472602#comment-15472602 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Created] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

Kishor Patil created SPARK-17443: Summary: SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary Key: SPARK-17443 URL: https://issues.apache.org/jira/browse/SPARK-17443

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472549#comment-15472549 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472551#comment-15472551 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472523#comment-15472523 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472522#comment-15472522 ] Hadoop QA commented on SPARK-17339: --- [

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472413#comment-15472413 ] Hadoop QA commented on SPARK-17400: --- Frank Dai created SPARK-17400: -

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472409#comment-15472409 ] Hadoop QA commented on SPARK-17400: --- Frank Dai created SPARK-17400: -

[jira] [Commented] (SPARK-17423) Support IGNORE NULLS option in Window functions

[ https://issues.apache.org/jira/browse/SPARK-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472394#comment-15472394 ] Tim Chan commented on SPARK-17423: -- [~hvanhovell] I was able to rewrite this Redshift fragment:

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472381#comment-15472381 ] Hadoop QA commented on SPARK-17400: --- [

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472382#comment-15472382 ] Hadoop QA commented on SPARK-17400: --- [

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472372#comment-15472372 ] Hadoop QA commented on SPARK-17400: --- [

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472371#comment-15472371 ] Hadoop QA commented on SPARK-17400: --- [

[jira] [Comment Edited] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472323#comment-15472323 ] Zhenhua Wang edited comment on SPARK-16026 at 9/8/16 1:06 AM: -- 1. It's a

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472323#comment-15472323 ] Zhenhua Wang commented on SPARK-16026: -- 1. It's a good point. I think it's worth a try, even without

[jira] [Commented] (SPARK-17414) Set type is not supported for creating data frames

[ https://issues.apache.org/jira/browse/SPARK-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472302#comment-15472302 ] Shuai Lin commented on SPARK-17414: --- So what type should {{Set}} be mapped to? {{ArrayType}}? That

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Target Version/s: 2.0.1 > Additional arguments in write.df are not passed to data source >

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472245#comment-15472245 ] Apache Spark commented on SPARK-17339: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472219#comment-15472219 ] Apache Spark commented on SPARK-17442: -- User 'falaki' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17442: Assignee: Apache Spark > Additional arguments in write.df are not passed to data source >

[jira] [Assigned] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17442: Assignee: (was: Apache Spark) > Additional arguments in write.df are not passed to

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472189#comment-15472189 ] Sean Zhong commented on SPARK-17364: I have a trial fix at https://github.com/apache/spark/pull/15006

[jira] [Comment Edited] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472182#comment-15472182 ] Sean Zhong edited comment on SPARK-17364 at 9/7/16 11:56 PM: - [~hvanhovell]

[jira] [Comment Edited] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472182#comment-15472182 ] Sean Zhong edited comment on SPARK-17364 at 9/7/16 11:55 PM: - [~hvanhovell]

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472182#comment-15472182 ] Sean Zhong commented on SPARK-17364: [~hvanhovell] That is because the antlr4 lexer breaks

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472174#comment-15472174 ] Shivaram Venkataraman commented on SPARK-17442: --- I think we missed passing the options

[jira] [Assigned] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17364: Assignee: (was: Apache Spark) > Can not query hive table starting with number >

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472175#comment-15472175 ] Apache Spark commented on SPARK-17364: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17364: Assignee: Apache Spark > Can not query hive table starting with number >

[jira] [Updated] (SPARK-16533) Spark application not handling preemption messages

[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-16533: --- Fix Version/s: 2.0.1 > Spark application not handling preemption messages >

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Summary: Default polling and trigger intervals cause excessive RPC calls (was: Default

[jira] [Updated] (SPARK-17386) Default trigger interval causes excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Priority: Blocker (was: Critical) > Additional arguments in write.df are not passed to data

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Priority: Critical (was: Major) > Additional arguments in write.df are not passed to data

[jira] [Created] (SPARK-17442) Additional arguments in write.df are not passed to data source

Hossein Falaki created SPARK-17442: -- Summary: Additional arguments in write.df are not passed to data source Key: SPARK-17442 URL: https://issues.apache.org/jira/browse/SPARK-17442 Project: Spark

[jira] [Commented] (SPARK-17421) Warnings about "MaxPermSize" parameter when building with Maven and Java 8

[ https://issues.apache.org/jira/browse/SPARK-17421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472045#comment-15472045 ] Apache Spark commented on SPARK-17421: -- User 'frreiss' has created a pull request for this issue:

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472037#comment-15472037 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen] Yes, running local[32] will reproduce the exception.

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472009#comment-15472009 ] Qifan Pu commented on SPARK-17405: -- One quick fix is to set memory capacity in configuration to make

[jira] [Commented] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472005#comment-15472005 ] Apache Spark commented on SPARK-17441: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17441: Assignee: (was: Apache Spark) > Issue Exceptions when ALTER TABLE RENAME PARTITION

[jira] [Assigned] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17440: Assignee: (was: Apache Spark) > Issue Exception when ALTER TABLE commands try to

[jira] [Commented] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472004#comment-15472004 ] Apache Spark commented on SPARK-17440: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17441: Assignee: Apache Spark > Issue Exceptions when ALTER TABLE RENAME PARTITION tries to

[jira] [Assigned] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17440: Assignee: Apache Spark > Issue Exception when ALTER TABLE commands try to alter a VIEW >

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472000#comment-15472000 ] Ron Hu commented on SPARK-16026: Hi Srinath, Thank you for your comments. Let me answer them one by one.

[jira] [Issue Comment Deleted] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-16026: --- Comment: was deleted (was: Hi Srinath, Thank you for your comments. Let me answer them one by one.

[jira] [Created] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

Xiao Li created SPARK-17441: --- Summary: Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table Key: SPARK-17441 URL: https://issues.apache.org/jira/browse/SPARK-17441 Project:

[jira] [Created] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

Xiao Li created SPARK-17440: --- Summary: Issue Exception when ALTER TABLE commands try to alter a VIEW Key: SPARK-17440 URL: https://issues.apache.org/jira/browse/SPARK-17440 Project: Spark Issue

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471986#comment-15471986 ] Ron Hu commented on SPARK-16026: Hi Srinath, Thank you for your comments. Let me answer them one by

[jira] [Updated] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17439: --- Labels: correctness (was: ) > QuantilesSummaries returns the wrong result after compression >

[jira] [Commented] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471829#comment-15471829 ] Apache Spark commented on SPARK-17439: -- User 'thunterdb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17439: Assignee: (was: Apache Spark) > QuantilesSummaries returns the wrong result after

[jira] [Assigned] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17439: Assignee: Apache Spark > QuantilesSummaries returns the wrong result after compression >

[jira] [Created] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

Tim Hunter created SPARK-17439: -- Summary: QuantilesSummaries returns the wrong result after compression Key: SPARK-17439 URL: https://issues.apache.org/jira/browse/SPARK-17439 Project: Spark

[jira] [Commented] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471801#comment-15471801 ] Tim Hunter commented on SPARK-17439: I have a patch for that. It should be merged after SPARK-17306

[jira] [Resolved] (SPARK-17052) Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala

[ https://issues.apache.org/jira/browse/SPARK-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17052. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14635

[jira] [Updated] (SPARK-17052) Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala

[ https://issues.apache.org/jira/browse/SPARK-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17052: --- Assignee: Xiao Li > Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala >

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471747#comment-15471747 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen] Yes likely. The new hashmap asks for 64MB per task, and

[jira] [Commented] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471741#comment-15471741 ] Apache Spark commented on SPARK-17438: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17438: Assignee: Shixiong Zhu (was: Apache Spark) > Master UI should show the correct core

[jira] [Assigned] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17438: Assignee: Apache Spark (was: Shixiong Zhu) > Master UI should show the correct core

[jira] [Created] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

Shixiong Zhu created SPARK-17438: Summary: Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set Key: SPARK-17438 URL: https://issues.apache.org/jira/browse/SPARK-17438

[jira] [Updated] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17370: --- Fix Version/s: 2.0.1 > Shuffle service files not invalidated when a slave is lost >

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471690#comment-15471690 ] Josh Rosen commented on SPARK-17405: My hunch is that this is affected by the default number of cores

[jira] [Assigned] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17437: Assignee: Apache Spark > uiWebUrl is not accessible to JavaSparkContext or

[jira] [Commented] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471667#comment-15471667 ] Apache Spark commented on SPARK-17437: -- User 'apetresc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17437: Assignee: (was: Apache Spark) > uiWebUrl is not accessible to JavaSparkContext or

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471640#comment-15471640 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen][~jlaskowski]Thanks for the comments and suggestions. I

[jira] [Created] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

Adrian Petrescu created SPARK-17437: --- Summary: uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext Key: SPARK-17437 URL: https://issues.apache.org/jira/browse/SPARK-17437

[jira] [Resolved] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17370. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14931

[jira] [Commented] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471563#comment-15471563 ] Nick Pentreath commented on SPARK-17094: It's true that constructor doesn't exist. It could be

[jira] [Assigned] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17433: Assignee: Apache Spark > YarnShuffleService doesn't handle moving credentials levelDb >

[jira] [Assigned] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17433: Assignee: (was: Apache Spark) > YarnShuffleService doesn't handle moving credentials

[jira] [Commented] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471503#comment-15471503 ] Apache Spark commented on SPARK-17433: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Closed] (SPARK-17431) How to get 2 years prior date from currentdate using Spark Sql

[ https://issues.apache.org/jira/browse/SPARK-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17431. - Resolution: Not A Problem > How to get 2 years prior date from currentdate using Spark

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471450#comment-15471450 ] Sean Owen commented on SPARK-17368: --- This is beyond my knowledge I'm afraid. I'd help take a look if I

[jira] [Commented] (SPARK-17429) spark sql length(1) return error

[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471443#comment-15471443 ] Dongjoon Hyun commented on SPARK-17429: --- Ya. I agree with [~hvanhovell]. It seems to be debatable.

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471428#comment-15471428 ] Jakob Odersky commented on SPARK-17368: --- Hmm, you're right my assumption was of using only value

[jira] [Commented] (SPARK-17431) How to get 2 years prior date from currentdate using Spark Sql

[ https://issues.apache.org/jira/browse/SPARK-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471414#comment-15471414 ] Dongjoon Hyun commented on SPARK-17431: --- Could you close this issue, [~farman.bsse1855]? I think

[jira] [Updated] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-17094: --- Description: Many machine learning pipeline has the API for easily assembling transformers. One

[jira] [Updated] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-17094: --- Description: Many machine learning pipeline has the API for easily assembling transformers. One

[jira] [Updated] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-17094: --- Description: Many machine learning pipeline has the API for easily assembling transformers. One

[jira] [Commented] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471366#comment-15471366 ] yuhao yang commented on SPARK-17094: Thanks for the comment, Sean. The two questions were great. 1.

  1   2   >