[jira] [Updated] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-14323: Description: Show Functions syntax can be found here:

[jira] [Updated] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-14323: Description: Show Functions syntax can be found here:

[jira] [Updated] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-14323: Description: Show Functions syntax can be found here:

[jira] [Commented] (SPARK-14037) count(df) is very slow for dataframe constrcuted using SparkR::createDataFrame

2016-03-31 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221192#comment-15221192 ] Sun Rui commented on SPARK-14037: - Thanks a lot. I will try to figure out another investigation PR. BTW,

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Attachment: threaddump-1459461915668.tdump here is the thread dump taken during the high CPU usage

[jira] [Updated] (SPARK-14303) Refactor SparkRWrappers

2016-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14303: -- Assignee: Yanbo Liang > Refactor SparkRWrappers > --- > >

[jira] [Comment Edited] (SPARK-14303) Refactor SparkRWrappers

2016-03-31 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1522#comment-1522 ] Yanbo Liang edited comment on SPARK-14303 at 4/1/16 4:00 AM: - [~mengxr] I

[jira] [Assigned] (SPARK-14303) Refactor SparkRWrappers

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14303: Assignee: (was: Apache Spark) > Refactor SparkRWrappers > --- > >

[jira] [Commented] (SPARK-14303) Refactor SparkRWrappers

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221114#comment-15221114 ] Apache Spark commented on SPARK-14303: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-14303) Refactor SparkRWrappers

2016-03-31 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1522#comment-1522 ] Yanbo Liang commented on SPARK-14303: - [~mengxr] I have make the refactor for k-means, I will link

[jira] [Commented] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-03-31 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221103#comment-15221103 ] Yanbo Liang commented on SPARK-14313: - Sure, please assign it to me. > AFTSurvivalRegression model

[jira] [Assigned] (SPARK-14322) Use treeReduce instead of reduce in OnlineLDAOptimizer

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14322: Assignee: Apache Spark > Use treeReduce instead of reduce in OnlineLDAOptimizer >

[jira] [Commented] (SPARK-14322) Use treeReduce instead of reduce in OnlineLDAOptimizer

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221088#comment-15221088 ] Apache Spark commented on SPARK-14322: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14322) Use treeReduce instead of reduce in OnlineLDAOptimizer

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14322: Assignee: (was: Apache Spark) > Use treeReduce instead of reduce in

[jira] [Resolved] (SPARK-14242) avoid too many copies in network when a network frame is large

2016-03-31 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14242. -- Resolution: Fixed Assignee: Zhang, Liye Fix Version/s: 2.0.0 > avoid too many

[jira] [Assigned] (SPARK-14321) Reduce date format cost and string-to-date cost in date functions

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14321: Assignee: Apache Spark > Reduce date format cost and string-to-date cost in date

[jira] [Commented] (SPARK-14321) Reduce date format cost and string-to-date cost in date functions

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221074#comment-15221074 ] Apache Spark commented on SPARK-14321: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Assigned] (SPARK-14321) Reduce date format cost and string-to-date cost in date functions

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14321: Assignee: (was: Apache Spark) > Reduce date format cost and string-to-date cost in

[jira] [Updated] (SPARK-14321) Reduce date format cost and string-to-date cost in date functions

2016-03-31 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-14321: - Summary: Reduce date format cost and string-to-date cost in date functions (was: Reduce

[jira] [Commented] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220954#comment-15220954 ] Apache Spark commented on SPARK-14323: -- User 'bomeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14323: Assignee: Apache Spark > [SQL] SHOW FUNCTIONS did not work properly >

[jira] [Assigned] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14323: Assignee: (was: Apache Spark) > [SQL] SHOW FUNCTIONS did not work properly >

[jira] [Created] (SPARK-14323) [SQL] SHOW FUNCTIONS did not work properly

2016-03-31 Thread Bo Meng (JIRA)
Bo Meng created SPARK-14323: --- Summary: [SQL] SHOW FUNCTIONS did not work properly Key: SPARK-14323 URL: https://issues.apache.org/jira/browse/SPARK-14323 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Resolved] (SPARK-14267) Execute multiple Python UDFs in single batch

2016-03-31 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14267. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12057

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Commented] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220864#comment-15220864 ] JESSE CHEN commented on SPARK-14318: Q14 is as follows: {noformat} with cross_items as (select

[jira] [Created] (SPARK-14322) Use treeReduce instead of reduce in OnlineLDAOptimizer

2016-03-31 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14322: - Summary: Use treeReduce instead of reduce in OnlineLDAOptimizer Key: SPARK-14322 URL: https://issues.apache.org/jira/browse/SPARK-14322 Project: Spark

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Created] (SPARK-14321) Reduce DateFormat cost in datetimeExpressions

2016-03-31 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created SPARK-14321: Summary: Reduce DateFormat cost in datetimeExpressions Key: SPARK-14321 URL: https://issues.apache.org/jira/browse/SPARK-14321 Project: Spark Issue

[jira] [Assigned] (SPARK-14320) Make ColumnarBatch.Row mutable

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14320: Assignee: (was: Apache Spark) > Make ColumnarBatch.Row mutable >

[jira] [Assigned] (SPARK-14320) Make ColumnarBatch.Row mutable

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14320: Assignee: Apache Spark > Make ColumnarBatch.Row mutable > --

[jira] [Commented] (SPARK-14320) Make ColumnarBatch.Row mutable

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220834#comment-15220834 ] Apache Spark commented on SPARK-14320: -- User 'sameeragarwal' has created a pull request for this

[jira] [Resolved] (SPARK-14277) Significant amount of CPU is being consumed in SnappyNative arrayCopy method

2016-03-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14277. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12096

[jira] [Created] (SPARK-14320) Make ColumnarBatch.Row mutable

2016-03-31 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14320: -- Summary: Make ColumnarBatch.Row mutable Key: SPARK-14320 URL: https://issues.apache.org/jira/browse/SPARK-14320 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14263) Benchmark Vectorized HashMap for GroupBy Aggregates

2016-03-31 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-14263: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-14319 > Benchmark Vectorized

[jira] [Created] (SPARK-14319) Speed up group-by aggregates

2016-03-31 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14319: -- Summary: Speed up group-by aggregates Key: SPARK-14319 URL: https://issues.apache.org/jira/browse/SPARK-14319 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14137) Conflict between NullPropagation and InferFiltersFromConstraints

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220814#comment-15220814 ] Apache Spark commented on SPARK-14137: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Labels: hangs (was: tpcds-result-mismatch) > TPCDS query 14 causes Spark SQL to hang >

[jira] [Created] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14318: -- Summary: TPCDS query 14 causes Spark SQL to hang Key: SPARK-14318 URL: https://issues.apache.org/jira/browse/SPARK-14318 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Affects Version/s: 2.0.0 > TPCDS query 14 causes Spark SQL to hang >

[jira] [Created] (SPARK-14317) Clean up hash join

2016-03-31 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14317: -- Summary: Clean up hash join Key: SPARK-14317 URL: https://issues.apache.org/jira/browse/SPARK-14317 Project: Spark Issue Type: Improvement Reporter:

[jira] [Closed] (SPARK-14294) Support native execution of ALTER TABLE ... RENAME TO

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-14294. - Resolution: Duplicate Assignee: Andrew Or > Support native execution of ALTER TABLE ... RENAME TO

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220762#comment-15220762 ] Apache Spark commented on SPARK-11327: -- User 'jayv' has created a pull request for this issue:

[jira] [Commented] (SPARK-14316) StateStoreCoordinator should extend ThreadSafeRpcEndpoint

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220754#comment-15220754 ] Apache Spark commented on SPARK-14316: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14316) StateStoreCoordinator should extend ThreadSafeRpcEndpoint

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14316: Assignee: Shixiong Zhu (was: Apache Spark) > StateStoreCoordinator should extend

[jira] [Assigned] (SPARK-14316) StateStoreCoordinator should extend ThreadSafeRpcEndpoint

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14316: Assignee: Apache Spark (was: Shixiong Zhu) > StateStoreCoordinator should extend

[jira] [Created] (SPARK-14316) StateStoreCoordinator should extend ThreadSafeRpcEndpoint

2016-03-31 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-14316: Summary: StateStoreCoordinator should extend ThreadSafeRpcEndpoint Key: SPARK-14316 URL: https://issues.apache.org/jira/browse/SPARK-14316 Project: Spark

[jira] [Commented] (SPARK-14251) Add SQL command for printing out generated code for debugging

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220737#comment-15220737 ] Apache Spark commented on SPARK-14251: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14251) Add SQL command for printing out generated code for debugging

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14251: Assignee: (was: Apache Spark) > Add SQL command for printing out generated code for

[jira] [Assigned] (SPARK-14251) Add SQL command for printing out generated code for debugging

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14251: Assignee: Apache Spark > Add SQL command for printing out generated code for debugging >

[jira] [Commented] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220734#comment-15220734 ] Xiangrui Meng commented on SPARK-14313: --- [~yanboliang] Are you interested working on this? It

[jira] [Commented] (SPARK-14314) K-means model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220732#comment-15220732 ] Xiangrui Meng commented on SPARK-14314: --- Hold until SPARK-14303 is done. > K-means model

[jira] [Commented] (SPARK-14315) GLMs model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220730#comment-15220730 ] Xiangrui Meng commented on SPARK-14315: --- Hold until SPARK-14303 is done. > GLMs model persistence

[jira] [Updated] (SPARK-14311) Model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14311: -- Description: In Spark 2.0, we are going to have 4 ML models in SparkR: GLMs, k-means, naive

[jira] [Created] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-14313: - Summary: AFTSurvivalRegression model persistence in SparkR Key: SPARK-14313 URL: https://issues.apache.org/jira/browse/SPARK-14313 Project: Spark Issue

[jira] [Created] (SPARK-14315) GLMs model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-14315: - Summary: GLMs model persistence in SparkR Key: SPARK-14315 URL: https://issues.apache.org/jira/browse/SPARK-14315 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14314) K-means model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-14314: - Summary: K-means model persistence in SparkR Key: SPARK-14314 URL: https://issues.apache.org/jira/browse/SPARK-14314 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14311) Model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-14311: - Summary: Model persistence in SparkR Key: SPARK-14311 URL: https://issues.apache.org/jira/browse/SPARK-14311 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-14312) NaiveBayes model persistence in SparkR

2016-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-14312: - Summary: NaiveBayes model persistence in SparkR Key: SPARK-14312 URL: https://issues.apache.org/jira/browse/SPARK-14312 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14209) Application failure during preemption.

2016-03-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220716#comment-15220716 ] Marcelo Vanzin commented on SPARK-14209: Those logs show the same weird issues as the previous

[jira] [Updated] (SPARK-14277) Significant amount of CPU is being consumed in SnappyNative arrayCopy method

2016-03-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-14277: Description: While running a Spark job which is spilling a lot of data in reduce phase, we see

[jira] [Updated] (SPARK-14277) Significant amount of CPU is being consumed in SnappyNative arrayCopy method

2016-03-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-14277: Summary: Significant amount of CPU is being consumed in SnappyNative arrayCopy method (was:

[jira] [Assigned] (SPARK-14310) Fix scan whole stage codegen to determine if batches are produced based on schema

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14310: Assignee: Apache Spark > Fix scan whole stage codegen to determine if batches are

[jira] [Commented] (SPARK-14310) Fix scan whole stage codegen to determine if batches are produced based on schema

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220690#comment-15220690 ] Apache Spark commented on SPARK-14310: -- User 'nongli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14310) Fix scan whole stage codegen to determine if batches are produced based on schema

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14310: Assignee: (was: Apache Spark) > Fix scan whole stage codegen to determine if batches

[jira] [Created] (SPARK-14310) Fix scan whole stage codegen to determine if batches are produced based on schema

2016-03-31 Thread Nong Li (JIRA)
Nong Li created SPARK-14310: --- Summary: Fix scan whole stage codegen to determine if batches are produced based on schema Key: SPARK-14310 URL: https://issues.apache.org/jira/browse/SPARK-14310 Project:

[jira] [Assigned] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14308: Assignee: Apache Spark > Remove unused mllib tree classes and move private classes to ML

[jira] [Commented] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220686#comment-15220686 ] Apache Spark commented on SPARK-14308: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14308: Assignee: (was: Apache Spark) > Remove unused mllib tree classes and move private

[jira] [Created] (SPARK-14309) Dataframe returns wrong results due to parsing incorrectly

2016-03-31 Thread Jerry Lam (JIRA)
Jerry Lam created SPARK-14309: - Summary: Dataframe returns wrong results due to parsing incorrectly Key: SPARK-14309 URL: https://issues.apache.org/jira/browse/SPARK-14309 Project: Spark Issue

[jira] [Updated] (SPARK-12381) Copy public decision tree helper classes from spark.mllib to spark.ml and make private

2016-03-31 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Hendrickson updated SPARK-12381: - Summary: Copy public decision tree helper classes from spark.mllib to spark.ml and make

[jira] [Created] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

2016-03-31 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-14308: Summary: Remove unused mllib tree classes and move private classes to ML Key: SPARK-14308 URL: https://issues.apache.org/jira/browse/SPARK-14308 Project:

[jira] [Resolved] (SPARK-14281) Fix the java8-tests profile and run those tests in Jenkins

2016-03-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14281. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12073

[jira] [Commented] (SPARK-14277) UnsafeSorterSpillReader should do buffered read from underlying compression stream

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220631#comment-15220631 ] Apache Spark commented on SPARK-14277: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14129) [Table related commands] Alter table

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14129: - Assignee: Andrew Or > [Table related commands] Alter table >

[jira] [Comment Edited] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2016-03-31 Thread Haohai Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220609#comment-15220609 ] Haohai Ma edited comment on SPARK-4906 at 3/31/16 8:27 PM: --- We just hit the

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2016-03-31 Thread Haohai Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220609#comment-15220609 ] Haohai Ma commented on SPARK-4906: -- We just hit the similar issue recently by Spark Master OOM. A

[jira] [Updated] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2016-03-31 Thread Haohai Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohai Ma updated SPARK-4906: - Attachment: LeakingJobProgressListener2OOM.docx > Spark master OOMs with exception stack trace stored in

[jira] [Commented] (SPARK-14259) Add config to control maximum number of files when coalescing partitions

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220602#comment-15220602 ] Apache Spark commented on SPARK-14259: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14264) Add feature importances for GBTs in Pyspark

2016-03-31 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14264. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12056

[jira] [Commented] (SPARK-14306) PySpark ml.classification OneVsRest support export/import

2016-03-31 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220519#comment-15220519 ] Xusen Yin commented on SPARK-14306: --- start work on it now. > PySpark ml.classification OneVsRest

[jira] [Resolved] (SPARK-14260) Increase default value for maxCharsPerColumn

2016-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14260. --- Resolution: Won't Fix Yeah I think that would be a very rare case. I also suggest we not increase

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2016-03-31 Thread Jo Voordeckers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220508#comment-15220508 ] Jo Voordeckers commented on SPARK-11327: So who should I nudge to get it backported into 1.x ? >

[jira] [Resolved] (SPARK-14304) Fix tests that don't create temp files in the `java.io.tmpdir` folder

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14304. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Fix tests that

[jira] [Updated] (SPARK-14279) Improve the spark build to pick the version information from the pom file instead of package.scala

2016-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14279: -- Issue Type: Improvement (was: Story) > Improve the spark build to pick the version information from

[jira] [Resolved] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13710. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12043

[jira] [Updated] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13710: -- Assignee: Michel Lemay > Spark shell shows ERROR when launching on Windows >

[jira] [Resolved] (SPARK-14278) Initialize columnar batch with proper memory mode

2016-03-31 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14278. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12070

[jira] [Updated] (SPARK-14278) Initialize columnar batch with proper memory mode

2016-03-31 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14278: - Assignee: Sameer Agarwal > Initialize columnar batch with proper memory mode >

[jira] [Commented] (SPARK-13363) Aggregator not working with DataFrame

2016-03-31 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220492#comment-15220492 ] koert kuipers commented on SPARK-13363: --- just doing some digging. the issue seems to be that when

[jira] [Resolved] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11327. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > spark-dispatcher

[jira] [Resolved] (SPARK-14069) Improve SparkStatusTracker to also track executor information

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14069. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Improve

[jira] [Assigned] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14243: Assignee: Apache Spark (was: jeanlyn) > updatedBlockStatuses does not update correctly

[jira] [Resolved] (SPARK-14168) Managed Memory Leak Msg Should Only Be a Warning

2016-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14168. --- Resolution: Duplicate > Managed Memory Leak Msg Should Only Be a Warning >

[jira] [Assigned] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-03-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14243: Assignee: jeanlyn (was: Apache Spark) > updatedBlockStatuses does not update correctly

[jira] [Updated] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14243: -- Fix Version/s: 2.0.0 > updatedBlockStatuses does not update correctly when removing blocks >

[jira] [Reopened] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-14243: --- > updatedBlockStatuses does not update correctly when removing blocks >

[jira] [Resolved] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14243. --- Resolution: Fixed Target Version/s: 1.6.2, 2.0.0 > updatedBlockStatuses does not update

[jira] [Resolved] (SPARK-14182) Parse DDL command: Alter View

2016-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14182. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target

  1   2   3   >