[jira] [Updated] (SPARK-7970) Optimize code for SQL queries fired on Union of RDDs (closure cleaner)

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7970: - Assignee: Nitin Goyal Target Version/s: 1.6.0 > Optimize code for SQL queries fired on Union

[jira] [Updated] (SPARK-11365) consolidate aggregates for summary statistics in weighted least squares

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11365: -- Component/s: MLlib > consolidate aggregates for summary statistics in weighted least squares >

[jira] [Updated] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11348: -- Component/s: Spark Core > Replace addOnCompleteCallback with addTaskCompletionListener() in >

[jira] [Updated] (SPARK-11346) Spark EventLog for completed applications

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11346: -- Component/s: Spark Core > Spark EventLog for completed applications >

[jira] [Assigned] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11402: Assignee: (was: Apache Spark) > Allow to define a custom driver runner and executor

[jira] [Assigned] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11402: Assignee: Apache Spark > Allow to define a custom driver runner and executor runner >

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980441#comment-14980441 ] Apache Spark commented on SPARK-11402: -- User 'jacek-lewandowski' has created a pull request for this

[jira] [Commented] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980320#comment-14980320 ] Apache Spark commented on SPARK-11383: -- User 'rishabhbhardwaj' has created a pull request for this

[jira] [Assigned] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11383: Assignee: Apache Spark > Replace example code in

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-29 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980372#comment-14980372 ] Saif Addin Ellafi commented on SPARK-11330: --- Thank you. I cannot test master right now, shall I

[jira] [Updated] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11326: -- Description: h3.The idea Currently, in standalone mode, all components, for all

[jira] [Updated] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11270: -- Assignee: Nick Evans > Add improved equality testing for TopicAndPartition from the Kafka Streaming >

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980454#comment-14980454 ] Jacek Lewandowski commented on SPARK-11402: --- I'm not sure if I get what do you mean. Do you

[jira] [Assigned] (SPARK-11403) Log something when dying from OnOutOfMemoryError

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11403: Assignee: Apache Spark > Log something when dying from OnOutOfMemoryError >

[jira] [Commented] (SPARK-11403) Log something when dying from OnOutOfMemoryError

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980456#comment-14980456 ] Apache Spark commented on SPARK-11403: -- User 'darabos' has created a pull request for this issue:

[jira] [Resolved] (SPARK-10958) Upgrade json4s version to 3.3.0 to eliminate common serialization issues with Formats.

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10958. --- Resolution: Won't Fix > Upgrade json4s version to 3.3.0 to eliminate common serialization issues

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980492#comment-14980492 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Updated] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11322: -- Assignee: Liang-Chi Hsieh > Keep full stack track in captured exception in PySpark >

[jira] [Updated] (SPARK-11370) fix a bug in GroupedIterator and create unit test for it

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11370: -- Assignee: Wenchen Fan > fix a bug in GroupedIterator and create unit test for it >

[jira] [Created] (SPARK-11403) Log something when dying from OnOutOfMemoryError

2015-10-29 Thread Daniel Darabos (JIRA)
Daniel Darabos created SPARK-11403: -- Summary: Log something when dying from OnOutOfMemoryError Key: SPARK-11403 URL: https://issues.apache.org/jira/browse/SPARK-11403 Project: Spark Issue

[jira] [Issue Comment Deleted] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deming Zhu updated SPARK-5569: -- Comment: was deleted (was: For OffsetRange ClassNotFound issue, I'm sure this patch could solve the

[jira] [Issue Comment Deleted] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deming Zhu updated SPARK-5569: -- Comment: was deleted (was: For OffsetRange ClassNotFound issue, I'm sure this patch could solve the

[jira] [Issue Comment Deleted] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deming Zhu updated SPARK-5569: -- Comment: was deleted (was: For OffsetRange ClassNotFound issue, I'm sure this patch could solve the

[jira] [Updated] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11371: -- Component/s: SQL [~tedyu] again:

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980429#comment-14980429 ] Sean Owen commented on SPARK-11402: --- I personally think this is an abstraction too far. When you do

[jira] [Updated] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10986: -- Affects Version/s: 1.5.2 Target Version/s: 1.6.0 > ClassNotFoundException when running on Client

[jira] [Created] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11402: - Summary: Allow to define a custom driver runner and executor runner Key: SPARK-11402 URL: https://issues.apache.org/jira/browse/SPARK-11402 Project: Spark

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980493#comment-14980493 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Updated] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8582: - Assignee: Shixiong Zhu Target Version/s: 1.6.0 (was: ) > Optimize checkpointing to avoid

[jira] [Comment Edited] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980493#comment-14980493 ] Deming Zhu edited comment on SPARK-5569 at 10/29/15 2:20 PM: - For OffsetRange

[jira] [Updated] (SPARK-11318) Include hive profile in make-distribution.sh command

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11318: -- Assignee: Ted Yu > Include hive profile in make-distribution.sh command >

[jira] [Assigned] (SPARK-11403) Log something when dying from OnOutOfMemoryError

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11403: Assignee: (was: Apache Spark) > Log something when dying from OnOutOfMemoryError >

[jira] [Resolved] (SPARK-11318) Include hive profile in make-distribution.sh command

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11318. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9281

[jira] [Created] (SPARK-11401) PMML export for Logistic Regression Multiclass Classification

2015-10-29 Thread Vincenzo Selvaggio (JIRA)
Vincenzo Selvaggio created SPARK-11401: -- Summary: PMML export for Logistic Regression Multiclass Classification Key: SPARK-11401 URL: https://issues.apache.org/jira/browse/SPARK-11401 Project:

[jira] [Assigned] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11383: Assignee: (was: Apache Spark) > Replace example code in

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980383#comment-14980383 ] Jacek Lewandowski commented on SPARK-11326: --- [~vanzin] I'll really appreciate if you can take a

[jira] [Resolved] (SPARK-11211) Kafka - offsetOutOfRange forces to largest

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11211. --- Resolution: Not A Problem > Kafka - offsetOutOfRange forces to largest >

[jira] [Resolved] (SPARK-11388) Build breaks due to the use of tags in javadoc.

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11388. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 1.6.0 Resolved by

[jira] [Updated] (SPARK-11401) PMML export for Logistic Regression Multiclass Classification

2015-10-29 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenzo Selvaggio updated SPARK-11401: --- Description: tvmanikandan requested on https://github.com/apache/spark/pull/3062

[jira] [Updated] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11303: -- Assignee: Yanbo Liang > sample (without replacement) + filter returns wrong results in DataFrame >

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2015-10-29 Thread Pravin Gadakh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980419#comment-14980419 ] Pravin Gadakh commented on SPARK-11381: --- We should make this jira dependent upon

[jira] [Resolved] (SPARK-11004) MapReduce Hive-like join operations for RDDs

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11004. --- Resolution: Won't Fix For the moment I'd like to consider this concluded, but as in all things, it

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980484#comment-14980484 ] Ted Yu commented on SPARK-11371: Since I cannot assign the JIRA to myself, attaching patch shows my

[jira] [Updated] (SPARK-11388) Build breaks due to the use of tags in javadoc.

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11388: -- Affects Version/s: (was: 1.5.1) > Build breaks due to the use of tags in javadoc. >

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980490#comment-14980490 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980508#comment-14980508 ] Jacek Lewandowski commented on SPARK-6373: -- [~turp1twin] so are you going to continue working on

[jira] [Commented] (SPARK-11140) Replace file server in driver with RPC-based alternative

2015-10-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980537#comment-14980537 ] Marcelo Vanzin commented on SPARK-11140: SSL is really hard to configure correctly in a large

[jira] [Commented] (SPARK-11032) Failure to resolve having correctly

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980593#comment-14980593 ] Yin Huai commented on SPARK-11032: -- I add 1.5.3 as the fix version. If we re-cut 1.5.2, I will change

[jira] [Updated] (SPARK-11032) Failure to resolve having correctly

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11032: - Fix Version/s: 1.5.3 > Failure to resolve having correctly > --- > >

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980590#comment-14980590 ] Yin Huai commented on SPARK-11246: -- OK I add 1.5.3 as the fix version. If we re-cut 1.5.2, I will change

[jira] [Assigned] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11348: Assignee: Apache Spark > Replace addOnCompleteCallback with addTaskCompletionListener()

[jira] [Commented] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980534#comment-14980534 ] Apache Spark commented on SPARK-11348: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-11269) Java API support & test cases

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980610#comment-14980610 ] Apache Spark commented on SPARK-11269: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-10-29 Thread Jeffrey Turpin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980657#comment-14980657 ] Jeffrey Turpin commented on SPARK-6373: --- [~jlewandowski], Yes I am. I got crazy busy at work the

[jira] [Commented] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-10-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980717#comment-14980717 ] Sandy Ryza commented on SPARK-2089: --- My opinion is that we should be moving towards dynamic allocation

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980560#comment-14980560 ] Yin Huai commented on SPARK-11330: -- https://issues.apache.org/jira/browse/SPARK-10859 should fix this

[jira] [Assigned] (SPARK-11404) groupBy on column expressions

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11404: Assignee: Apache Spark (was: Michael Armbrust) > groupBy on column expressions >

[jira] [Commented] (SPARK-10859) Predicates pushed to InmemoryColumnarTableScan are not evaluated correctly

2015-10-29 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980546#comment-14980546 ] Saif Addin Ellafi commented on SPARK-10859: --- Hi, I have been told that this issue:

[jira] [Updated] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11246: - Fix Version/s: 1.5.3 > [1.5] Table cache for Parquet broken in 1.5 >

[jira] [Updated] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11246: - Fix Version/s: (was: 1.5.2) > [1.5] Table cache for Parquet broken in 1.5 >

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980570#comment-14980570 ] Yin Huai commented on SPARK-11246: -- I picked it in branch 1.5. Will update the fix version later. >

[jira] [Resolved] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11246. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11383: -- Shepherd: Xusen Yin > Replace example code in

[jira] [Created] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-10-29 Thread Jarno Seppanen (JIRA)
Jarno Seppanen created SPARK-11405: -- Summary: ROW_NUMBER function does not adhere to window ORDER BY, when joining Key: SPARK-11405 URL: https://issues.apache.org/jira/browse/SPARK-11405 Project:

[jira] [Commented] (SPARK-11140) Replace file server in driver with RPC-based alternative

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980526#comment-14980526 ] Jacek Lewandowski commented on SPARK-11140: --- [~vanzin] it would be better to use SSL key-pair

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980584#comment-14980584 ] Nan Zhu commented on SPARK-11402: - I'm curious about what kind of functionalities you need with a

[jira] [Assigned] (SPARK-11269) Java API support & test cases

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11269: Assignee: Apache Spark > Java API support & test cases > - >

[jira] [Assigned] (SPARK-11269) Java API support & test cases

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11269: Assignee: (was: Apache Spark) > Java API support & test cases >

[jira] [Created] (SPARK-11404) groupBy on column expressions

2015-10-29 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-11404: Summary: groupBy on column expressions Key: SPARK-11404 URL: https://issues.apache.org/jira/browse/SPARK-11404 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980488#comment-14980488 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Assigned] (SPARK-11404) groupBy on column expressions

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11404: Assignee: Michael Armbrust (was: Apache Spark) > groupBy on column expressions >

[jira] [Commented] (SPARK-8655) DataFrameReader#option supports more than String as value

2015-10-29 Thread Tony Cebzanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980672#comment-14980672 ] Tony Cebzanov commented on SPARK-8655: -- I'm running into this limitation as well. >

[jira] [Assigned] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11348: Assignee: (was: Apache Spark) > Replace addOnCompleteCallback with

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-29 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980652#comment-14980652 ] Xin Wu commented on SPARK-11246: [~yhuai] Thank you! > [1.5] Table cache for Parquet broken in 1.5 >

[jira] [Commented] (SPARK-11404) groupBy on column expressions

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980628#comment-14980628 ] Apache Spark commented on SPARK-11404: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Commented] (SPARK-11155) Stage summary json should include stage duration

2015-10-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980802#comment-14980802 ] Xin Ren commented on SPARK-11155: - Hi [~imranr], thank you so much for your detailed explanation, really

[jira] [Updated] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11188: - Assignee: Dilip Biswal (was: Michael Armbrust) > Elide stacktraces in bin/spark-sql for

[jira] [Commented] (SPARK-6043) Error when trying to rename table with alter table after using INSERT OVERWITE to populate the table

2015-10-29 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980899#comment-14980899 ] kevin yu commented on SPARK-6043: - Hello Trystan: I tried your testcase, and it works on spark 1.5, seems

[jira] [Commented] (SPARK-10158) ALS should print better errors when given Long IDs

2015-10-29 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980920#comment-14980920 ] Bryan Cutler commented on SPARK-10158: -- I made a quick fix for this. When using Long values for

[jira] [Assigned] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-11188: Assignee: Michael Armbrust > Elide stacktraces in bin/spark-sql for

[jira] [Resolved] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11188. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9194

[jira] [Updated] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-10-29 Thread Jarno Seppanen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarno Seppanen updated SPARK-11405: --- Priority: Critical (was: Major) Description: The following query produces incorrect

[jira] [Comment Edited] (SPARK-11155) Stage summary json should include stage duration

2015-10-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980789#comment-14980789 ] Imran Rashid edited comment on SPARK-11155 at 10/29/15 5:09 PM: Hi

[jira] [Created] (SPARK-11407) Add documentation on using SparkR from RStudio

2015-10-29 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11407: Summary: Add documentation on using SparkR from RStudio Key: SPARK-11407 URL: https://issues.apache.org/jira/browse/SPARK-11407 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian ONeill updated SPARK-11406: - Comment: was deleted (was: https://github.com/apache/spark/pull/9360) > utf-8 decode issue w/

[jira] [Assigned] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11406: Assignee: (was: Apache Spark) > utf-8 decode issue w/ kinesis >

[jira] [Commented] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981038#comment-14981038 ] Apache Spark commented on SPARK-11406: -- User 'boneill42' has created a pull request for this issue:

[jira] [Resolved] (SPARK-10641) skewness and kurtosis support

2015-10-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10641. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9003

[jira] [Assigned] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11406: Assignee: Apache Spark > utf-8 decode issue w/ kinesis > - >

[jira] [Commented] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981039#comment-14981039 ] Brian ONeill commented on SPARK-11406: -- https://github.com/apache/spark/pull/9360 > utf-8 decode

[jira] [Created] (SPARK-11408) Display scientific notation correctly in DataFrame.show()

2015-10-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11408: - Summary: Display scientific notation correctly in DataFrame.show() Key: SPARK-11408 URL: https://issues.apache.org/jira/browse/SPARK-11408 Project: Spark

[jira] [Updated] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian ONeill updated SPARK-11406: - Priority: Minor (was: Major) > utf-8 decode issue w/ kinesis > - >

[jira] [Created] (SPARK-11406) utf-8 decode issue w/ kinesis

2015-10-29 Thread Brian ONeill (JIRA)
Brian ONeill created SPARK-11406: Summary: utf-8 decode issue w/ kinesis Key: SPARK-11406 URL: https://issues.apache.org/jira/browse/SPARK-11406 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981170#comment-14981170 ] Jacek Lewandowski commented on SPARK-11402: --- [~CodingCat] for example environment, command line

[jira] [Assigned] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11385: Assignee: (was: Apache Spark) > Add foreach API to MLLib's vector API >

[jira] [Commented] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981285#comment-14981285 ] Apache Spark commented on SPARK-11385: -- User 'nakul02' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11385: Assignee: Apache Spark > Add foreach API to MLLib's vector API >

[jira] [Commented] (SPARK-10046) Hive warehouse dir not set in current directory when not providing hive-site.xml

2015-10-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981305#comment-14981305 ] Yin Huai commented on SPARK-10046: -- I feel it is better to not use local dir as the parent dir of

[jira] [Commented] (SPARK-10046) Hive warehouse dir not set in current directory when not providing hive-site.xml

2015-10-29 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981331#comment-14981331 ] Xin Wu commented on SPARK-10046: Ok. Let me update the doc then. > Hive warehouse dir not set in current

[jira] [Commented] (SPARK-11275) [SQL] Regression in rollup/cube

2015-10-29 Thread Andrew Ray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981338#comment-14981338 ] Andrew Ray commented on SPARK-11275: I think that I understand what is happening here. Any expression

  1   2   3   >