[jira] [Commented] (SPARK-9285) Remove InternalRow's inheritance from Row

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639456#comment-14639456 ] Apache Spark commented on SPARK-9285: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9285) Remove InternalRow's inheritance from Row

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9285: --- Assignee: Apache Spark (was: Reynold Xin) Remove InternalRow's inheritance from Row

[jira] [Assigned] (SPARK-9285) Remove InternalRow's inheritance from Row

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9285: --- Assignee: Reynold Xin (was: Apache Spark) Remove InternalRow's inheritance from Row

[jira] [Created] (SPARK-9287) Speedup unit test of Date expressions

2015-07-23 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9287: - Summary: Speedup unit test of Date expressions Key: SPARK-9287 URL: https://issues.apache.org/jira/browse/SPARK-9287 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9286) Methods in Unevaluable should be final

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9286: --- Assignee: Apache Spark (was: Josh Rosen) Methods in Unevaluable should be final

[jira] [Assigned] (SPARK-9284) Remove tests' dependency on the assembly

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9284: --- Assignee: Apache Spark Remove tests' dependency on the assembly

[jira] [Assigned] (SPARK-9284) Remove tests' dependency on the assembly

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9284: --- Assignee: (was: Apache Spark) Remove tests' dependency on the assembly

[jira] [Commented] (SPARK-9284) Remove tests' dependency on the assembly

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639671#comment-14639671 ] Apache Spark commented on SPARK-9284: - User 'vanzin' has created a pull request for

[jira] [Created] (SPARK-9290) DateExpressionsSuite is slow to run

2015-07-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9290: -- Summary: DateExpressionsSuite is slow to run Key: SPARK-9290 URL: https://issues.apache.org/jira/browse/SPARK-9290 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-9286) Methods in Unevaluable should be final

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9286. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7627

[jira] [Commented] (SPARK-9286) Methods in Unevaluable should be final

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639507#comment-14639507 ] Apache Spark commented on SPARK-9286: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9286) Methods in Unevaluable should be final

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9286: --- Assignee: Josh Rosen (was: Apache Spark) Methods in Unevaluable should be final

[jira] [Commented] (SPARK-9269) Add Set to the matching type in ArrayConverter

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639603#comment-14639603 ] Apache Spark commented on SPARK-9269: - User 'alexliu68' has created a pull request for

[jira] [Assigned] (SPARK-9269) Add Set to the matching type in ArrayConverter

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9269: --- Assignee: Apache Spark Add Set to the matching type in ArrayConverter

[jira] [Assigned] (SPARK-9269) Add Set to the matching type in ArrayConverter

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9269: --- Assignee: (was: Apache Spark) Add Set to the matching type in ArrayConverter

[jira] [Created] (SPARK-9285) Remove InternalRow's inheritance from Row

2015-07-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9285: -- Summary: Remove InternalRow's inheritance from Row Key: SPARK-9285 URL: https://issues.apache.org/jira/browse/SPARK-9285 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9284) Remove tests' dependency on the assembly

2015-07-23 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-9284: - Summary: Remove tests' dependency on the assembly Key: SPARK-9284 URL: https://issues.apache.org/jira/browse/SPARK-9284 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9284) Remove tests' dependency on the assembly

2015-07-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639448#comment-14639448 ] Marcelo Vanzin commented on SPARK-9284: --- BTW I have a patch that does this, I'm

[jira] [Created] (SPARK-9288) Improve test speed

2015-07-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9288: -- Summary: Improve test speed Key: SPARK-9288 URL: https://issues.apache.org/jira/browse/SPARK-9288 Project: Spark Issue Type: Umbrella Components:

[jira] [Created] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

2015-07-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9289: -- Summary: OrcPartitionDiscoverySuite is slow to run Key: SPARK-9289 URL: https://issues.apache.org/jira/browse/SPARK-9289 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9276) ThriftServer process can't stop if using command yarn application -kill appid

2015-07-23 Thread meiyoula (JIRA)
meiyoula created SPARK-9276: --- Summary: ThriftServer process can't stop if using command yarn application -kill appid Key: SPARK-9276 URL: https://issues.apache.org/jira/browse/SPARK-9276 Project: Spark

[jira] [Commented] (SPARK-5447) Replace reference to SchemaRDD with DataFrame

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638645#comment-14638645 ] Apache Spark commented on SPARK-5447: - User 'darroyocazorla' has created a pull

[jira] [Updated] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-23 Thread Andrey Vykhodtsev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Vykhodtsev updated SPARK-9277: - Attachment: SparseVector test.ipynb SparseVector test.html Attached is

[jira] [Updated] (SPARK-9212) update Netty version to 4.0.29.Final for Netty Metrics

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9212: - Assignee: Zhang, Liye Priority: Trivial (was: Major) update Netty version to 4.0.29.Final for Netty

[jira] [Created] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Steve Lindemann (JIRA)
Steve Lindemann created SPARK-9278: -- Summary: DataFrameWriter.insertInto inserts incorrect data Key: SPARK-9278 URL: https://issues.apache.org/jira/browse/SPARK-9278 Project: Spark Issue

[jira] [Created] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-23 Thread Andrey Vykhodtsev (JIRA)
Andrey Vykhodtsev created SPARK-9277: Summary: SparseVector constructor must throw an error when declared number of elements less than array lenght Key: SPARK-9277 URL:

[jira] [Resolved] (SPARK-4024) Remember user preferences for metrics to show in the UI

2015-07-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4024. - Resolution: Fixed Fix Version/s: 1.5.0 Resolved in

[jira] [Resolved] (SPARK-9212) update Netty version to 4.0.29.Final for Netty Metrics

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9212. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7562

[jira] [Commented] (SPARK-9276) ThriftServer process can't stop if using command yarn application -kill appid

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638714#comment-14638714 ] Sean Owen commented on SPARK-9276: -- I might misunderstand this, but, is that surprising?

[jira] [Updated] (SPARK-9249) local variable assigned but may not be used

2015-07-23 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-9249: --- Description: local variable assigned but may not be used For example: {noformat}

[jira] [Resolved] (SPARK-8092) OneVsRest doesn't allow flexibility in label/ feature column renaming

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8092. -- Resolution: Fixed Fix Version/s: 1.5.0 OneVsRest doesn't allow flexibility in

[jira] [Comment Edited] (SPARK-9249) local variable assigned but may not be used

2015-07-23 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639945#comment-14639945 ] Yu Ishikawa edited comment on SPARK-9249 at 7/24/15 5:22 AM: -

[jira] [Updated] (SPARK-7045) Word2Vec: avoid intermediate representation when creating model

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7045: - Shepherd: Joseph K. Bradley Target Version/s: 1.5.0 Word2Vec: avoid

[jira] [Updated] (SPARK-7045) Word2Vec: avoid intermediate representation when creating model

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7045: - Assignee: Manoj Kumar Word2Vec: avoid intermediate representation when creating model

[jira] [Assigned] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9293: --- Assignee: Apache Spark (was: Josh Rosen) Analysis should detect when set operations are

[jira] [Assigned] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9293: --- Assignee: Josh Rosen (was: Apache Spark) Analysis should detect when set operations are

[jira] [Updated] (SPARK-8564) Add the Python API for Kinesis

2015-07-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8564: --- Target Version/s: 1.5.0 Add the Python API for Kinesis --

[jira] [Commented] (SPARK-5373) literal in agg grouping expressioons leads to incorrect result

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639897#comment-14639897 ] Apache Spark commented on SPARK-5373: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-6548) stddev_pop and stddev_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639914#comment-14639914 ] Yin Huai commented on SPARK-6548: - [~JihongMA] Will you have time to implement stddev

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-23 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639949#comment-14639949 ] Paul Wu commented on SPARK-9255: [~srowen] I don't think it is due to version

[jira] [Commented] (SPARK-9249) local variable assigned but may not be used

2015-07-23 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639945#comment-14639945 ] Yu Ishikawa commented on SPARK-9249: [~chanchal.spark] Yes. I think we should remove

[jira] [Commented] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

2015-07-23 Thread Randy Kerber (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639940#comment-14639940 ] Randy Kerber commented on SPARK-9002: - That's what I was thinking when I created the

[jira] [Created] (SPARK-9302) collect()/head() failed with JSON of some format

2015-07-23 Thread Sun Rui (JIRA)
Sun Rui created SPARK-9302: -- Summary: collect()/head() failed with JSON of some format Key: SPARK-9302 URL: https://issues.apache.org/jira/browse/SPARK-9302 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9249) local variable assigned but may not be used

2015-07-23 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639955#comment-14639955 ] Yu Ishikawa commented on SPARK-9249: I'm working this issue. local variable assigned

[jira] [Assigned] (SPARK-9281) Parse literals as decimal in SQL

2015-07-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9281: - Assignee: Davies Liu Parse literals as decimal in SQL

[jira] [Created] (SPARK-9291) Conversion is applied twice on partitioned data sources

2015-07-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9291: -- Summary: Conversion is applied twice on partitioned data sources Key: SPARK-9291 URL: https://issues.apache.org/jira/browse/SPARK-9291 Project: Spark Issue

[jira] [Resolved] (SPARK-8906) Move all internal data source related classes out of sources package

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8906. Resolution: Fixed Fix Version/s: 1.5.0 Move all internal data source related classes out of

[jira] [Resolved] (SPARK-9207) Turn on Parquet filter push-down by default

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9207. Resolution: Fixed Fix Version/s: 1.5.0 Turn on Parquet filter push-down by default

[jira] [Updated] (SPARK-7446) Inverse transform for StringIndexer

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7446: - Shepherd: Joseph K. Bradley Inverse transform for StringIndexer

[jira] [Commented] (SPARK-9294) cleanup comments, code style, naming typo for the new aggregation

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639830#comment-14639830 ] Apache Spark commented on SPARK-9294: - User 'cloud-fan' has created a pull request for

[jira] [Created] (SPARK-9299) percentile and percentile_approx aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9299: --- Summary: percentile and percentile_approx aggregate functions Key: SPARK-9299 URL: https://issues.apache.org/jira/browse/SPARK-9299 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9296) variance, var_pop, and var_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9296: Description: A short introduction on how to build aggregate functions based on our new interface can be

[jira] [Created] (SPARK-9298) corr aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9298: --- Summary: corr aggregate functions Key: SPARK-9298 URL: https://issues.apache.org/jira/browse/SPARK-9298 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-9297) covar_pop and covar_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9297: --- Summary: covar_pop and covar_samp aggregate functions Key: SPARK-9297 URL: https://issues.apache.org/jira/browse/SPARK-9297 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-9292) Analysis should check that join conditions' data types are booleans

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9292: --- Assignee: Josh Rosen (was: Apache Spark) Analysis should check that join conditions' data

[jira] [Resolved] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9122. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7614

[jira] [Updated] (SPARK-9222) Make class instantiation variables in DistributedLDAModel [private] clustering

2015-07-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9222: - Target Version/s: 1.5.0 Make class instantiation variables in DistributedLDAModel

[jira] [Created] (SPARK-9296) variance, var_pop, and var_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9296: --- Summary: variance, var_pop, and var_samp aggregate functions Key: SPARK-9296 URL: https://issues.apache.org/jira/browse/SPARK-9296 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9300) histogram_numeric aggregate function

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9300: --- Summary: histogram_numeric aggregate function Key: SPARK-9300 URL: https://issues.apache.org/jira/browse/SPARK-9300 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7650) Move streaming css and js files to the streaming project

2015-07-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-7650. - Resolution: Fixed Fix Version/s: 1.4.0 Move streaming css and js files to the streaming

[jira] [Created] (SPARK-9301) collect_set and collect_list aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9301: --- Summary: collect_set and collect_list aggregate functions Key: SPARK-9301 URL: https://issues.apache.org/jira/browse/SPARK-9301 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9301) collect_set and collect_list aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9301: Target Version/s: 1.5.0 collect_set and collect_list aggregate functions

[jira] [Assigned] (SPARK-9292) Analysis should check that join conditions' data types are booleans

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9292: --- Assignee: Apache Spark (was: Josh Rosen) Analysis should check that join conditions' data

[jira] [Commented] (SPARK-9292) Analysis should check that join conditions' data types are booleans

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639756#comment-14639756 ] Apache Spark commented on SPARK-9292: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-9295) Analysis should detect sorting on unsupported column types

2015-07-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9295: - Summary: Analysis should detect sorting on unsupported column types Key: SPARK-9295 URL: https://issues.apache.org/jira/browse/SPARK-9295 Project: Spark Issue

[jira] [Created] (SPARK-9292) Analysis should check that join conditions' data types are booleans

2015-07-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9292: - Summary: Analysis should check that join conditions' data types are booleans Key: SPARK-9292 URL: https://issues.apache.org/jira/browse/SPARK-9292 Project: Spark

[jira] [Created] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

2015-07-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9293: - Summary: Analysis should detect when set operations are performed on tables with different numbers of columns Key: SPARK-9293 URL: https://issues.apache.org/jira/browse/SPARK-9293

[jira] [Assigned] (SPARK-9294) cleanup comments, code style, naming typo for the new aggregation

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9294: --- Assignee: (was: Apache Spark) cleanup comments, code style, naming typo for the new

[jira] [Assigned] (SPARK-9294) cleanup comments, code style, naming typo for the new aggregation

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9294: --- Assignee: Apache Spark cleanup comments, code style, naming typo for the new aggregation

[jira] [Created] (SPARK-9294) cleanup comments, code style, naming typo for the new aggregation

2015-07-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9294: -- Summary: cleanup comments, code style, naming typo for the new aggregation Key: SPARK-9294 URL: https://issues.apache.org/jira/browse/SPARK-9294 Project: Spark

[jira] [Commented] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639837#comment-14639837 ] Apache Spark commented on SPARK-9293: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-9216) Define KinesisBackedBlockRDDs

2015-07-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9216. -- Resolution: Fixed Fix Version/s: 1.5.0 Define KinesisBackedBlockRDDs

[jira] [Updated] (SPARK-6548) Adding stddev to DataFrame functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6548: Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 Adding stddev to DataFrame functions

[jira] [Commented] (SPARK-4366) Aggregation Improvement

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639921#comment-14639921 ] Yin Huai commented on SPARK-4366: - Here is a brief instruction on how to implement a

[jira] [Commented] (SPARK-6548) stddev_pop and stddev_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639923#comment-14639923 ] Yin Huai commented on SPARK-6548: - A short introduction on how to build aggregate

[jira] [Updated] (SPARK-9271) Concurrency bug triggered by partition predicate push-down

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9271: -- Description: SPARK-6910 and [PR #7492|https://github.com/apache/spark/pull/7492] introduced partition

[jira] [Updated] (SPARK-6548) stddev_pop and stddev_samp aggregate functions

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6548: Summary: stddev_pop and stddev_samp aggregate functions (was: Adding stddev to DataFrame functions)

[jira] [Assigned] (SPARK-9295) Analysis should detect sorting on unsupported column types

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9295: --- Assignee: Apache Spark (was: Josh Rosen) Analysis should detect sorting on unsupported

[jira] [Assigned] (SPARK-9295) Analysis should detect sorting on unsupported column types

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9295: --- Assignee: Josh Rosen (was: Apache Spark) Analysis should detect sorting on unsupported

[jira] [Commented] (SPARK-9295) Analysis should detect sorting on unsupported column types

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639912#comment-14639912 ] Apache Spark commented on SPARK-9295: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-4366) Aggregation Improvement

2015-07-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639400#comment-14639400 ] Herman van Hovell commented on SPARK-4366: -- What is going to happen to the old

[jira] [Commented] (SPARK-4366) Aggregation Improvement

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639403#comment-14639403 ] Yin Huai commented on SPARK-4366: - It will be probably still in 1.5 (right now, we still

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-07-23 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639472#comment-14639472 ] Sudhakar Thota commented on SPARK-8359: --- This is not working and breaking at 2^112

[jira] [Resolved] (SPARK-1744) Document how to pass in preferredNodeLocationData

2015-07-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-1744. --- Resolution: Won't Fix Document how to pass in preferredNodeLocationData

[jira] [Created] (SPARK-9286) Methods in Unevaluable should be final

2015-07-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9286: - Summary: Methods in Unevaluable should be final Key: SPARK-9286 URL: https://issues.apache.org/jira/browse/SPARK-9286 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Padron updated SPARK-9279: --- Description: When trying to start a spark master server as root... {code} export

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Affects Version/s: 1.3.1 New HiveContext object unexpectedly loads configuration settings from

[jira] [Created] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
Tien-Dung LE created SPARK-9280: --- Summary: New HiveContext object unexpectedly loads configuration settings from history Key: SPARK-9280 URL: https://issues.apache.org/jira/browse/SPARK-9280 Project:

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark-shell session, stopping a spark context and create a new spark context and

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Component/s: SQL New HiveContext object unexpectedly loads configuration settings from history

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark-shell session, stopping a spark context and create a new spark context and

[jira] [Commented] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Steve Lindemann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638843#comment-14638843 ] Steve Lindemann commented on SPARK-9278: Here are the steps to reproduce the

[jira] [Created] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
Omar Padron created SPARK-9279: -- Summary: Spark Master Refuses to Bind WebUI to a Privileged Port Key: SPARK-9279 URL: https://issues.apache.org/jira/browse/SPARK-9279 Project: Spark Issue

[jira] [Resolved] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9279. -- Resolution: Not A Problem This has nothing to do with Spark. Any Linux-like OS X requires root

[jira] [Updated] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-9270: - Description: Currently, the app name is hardcoded in pyspark as PySparkShell, and the

[jira] [Resolved] (SPARK-7254) Extend PIC to handle Graphs directly

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7254. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6054

[jira] [Updated] (SPARK-7254) Extend PIC to handle Graphs directly

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7254: - Assignee: Liang-Chi Hsieh Extend PIC to handle Graphs directly

[jira] [Updated] (SPARK-7254) Extend PIC to handle Graphs directly

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7254: - Target Version/s: 1.5.0 Extend PIC to handle Graphs directly

[jira] [Assigned] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-9243: Assignee: Xiangrui Meng Update crosstab doc for pairs that have no occurrences

[jira] [Created] (SPARK-9272) Persist information of individual partitions when persisting partitioned data source tables to metastore

2015-07-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-9272: - Summary: Persist information of individual partitions when persisting partitioned data source tables to metastore Key: SPARK-9272 URL: https://issues.apache.org/jira/browse/SPARK-9272

  1   2   3   >