[jira] [Assigned] (SPARK-15960) Audit new SQL confs

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15960: Assignee: Apache Spark (was: Herman van Hovell) > Audit new SQL confs >

[jira] [Commented] (SPARK-15960) Audit new SQL confs

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331244#comment-15331244 ] Apache Spark commented on SPARK-15960: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-15960) Audit new SQL confs

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15960: Assignee: Herman van Hovell (was: Apache Spark) > Audit new SQL confs >

[jira] [Resolved] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

2016-06-14 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang resolved SPARK-15397. - Resolution: Fixed > 'locate' UDF got different result with boundary value case compared to Hive

[jira] [Assigned] (SPARK-15962) Introduce additonal implementation with a dense format for UnsafeArrayData

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15962: Assignee: (was: Apache Spark) > Introduce additonal implementation with a dense format

[jira] [Commented] (SPARK-15962) Introduce additonal implementation with a dense format for UnsafeArrayData

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331222#comment-15331222 ] Apache Spark commented on SPARK-15962: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-15962) Introduce additonal implementation with a dense format for UnsafeArrayData

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15962: Assignee: Apache Spark > Introduce additonal implementation with a dense format for Unsafe

[jira] [Created] (SPARK-15962) Introduce additonal implementation with a dense format for UnsafeArrayData

2016-06-14 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-15962: Summary: Introduce additonal implementation with a dense format for UnsafeArrayData Key: SPARK-15962 URL: https://issues.apache.org/jira/browse/SPARK-15962 Pr

[jira] [Assigned] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15959: Assignee: Yin Huai (was: Apache Spark) > Add the support of hive.metastore.warehouse.dir

[jira] [Commented] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331206#comment-15331206 ] Apache Spark commented on SPARK-15959: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15959: Assignee: Apache Spark (was: Yin Huai) > Add the support of hive.metastore.warehouse.dir

[jira] [Assigned] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-15959: Assignee: Yin Huai > Add the support of hive.metastore.warehouse.dir back > --

[jira] [Closed] (SPARK-15961) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-15961. - Resolution: Duplicate > Audit new SQL confs > > > K

[jira] [Updated] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15959: - Labels: release_notes releasenotes (was: ) > Add the support of hive.metastore.warehouse.dir back >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331168#comment-15331168 ] Jinxia Liu commented on SPARK-12177: Thanks Cody! > Update KafkaDStreams to new Kafk

[jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-06-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331132#comment-15331132 ] Imran Rashid commented on SPARK-15815: -- [~SuYan] is this the same as https://issues.

[jira] [Updated] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-06-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-15815: - Component/s: Scheduler > Hang while enable blacklistExecutor and DynamicExecutorAllocator >

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331119#comment-15331119 ] Reynold Xin commented on SPARK-13928: - It was never meant to be public (the comment h

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331114#comment-15331114 ] Cody Koeninger commented on SPARK-12177: [~jinx...@ebay.com] looks like that test

[jira] [Created] (SPARK-15961) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15961: - Summary: Audit new SQL confs Key: SPARK-15961 URL: https://issues.apache.org/jira/browse/SPARK-15961 Project: Spark Issue Type: Bug Comp

[jira] [Created] (SPARK-15960) Audit new SQL confs

2016-06-14 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15960: - Summary: Audit new SQL confs Key: SPARK-15960 URL: https://issues.apache.org/jira/browse/SPARK-15960 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-15824) Run 'with ... insert ... select' failed when use spark thriftserver

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331027#comment-15331027 ] Apache Spark commented on SPARK-15824: -- User 'hvanhovell' has created a pull request

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331026#comment-15331026 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for the quick reply

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331021#comment-15331021 ] Cody Koeninger commented on SPARK-12177: [~jinx...@ebay.com] 1. I'm already look

[jira] [Created] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-06-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-15959: Summary: Add the support of hive.metastore.warehouse.dir back Key: SPARK-15959 URL: https://issues.apache.org/jira/browse/SPARK-15959 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331007#comment-15331007 ] Jinxia Liu edited comment on SPARK-12177 at 6/15/16 2:29 AM: -

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331007#comment-15331007 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for contributing th

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Jinxia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331005#comment-15331005 ] Jinxia Liu commented on SPARK-12177: [~c...@koeninger.org] thanks for contributing th

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331003#comment-15331003 ] Cody Koeninger commented on SPARK-12177: I had verified basic functionality with

[jira] [Resolved] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15952. - Resolution: Fixed Assignee: Bo Meng Fix Version/s: 2.0.0 > "show databases" does

[jira] [Resolved] (SPARK-15945) Implement conversion utils in Scala/Java

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-15945. - Resolution: Fixed > Implement conversion utils in Scala/Java > --

[jira] [Resolved] (SPARK-15065) HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is flaky

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15065. -- Resolution: Fixed Fix Version/s: 2.0.0 > HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is

[jira] [Commented] (SPARK-15065) HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is flaky

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330999#comment-15330999 ] Yin Huai commented on SPARK-15065: -- Thanks. I took a look at jenkins' history. Looks lik

[jira] [Resolved] (SPARK-15631) Dataset and encoder bug fixes

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15631. -- Resolution: Fixed Fix Version/s: 2.0.0 > Dataset and encoder bug fixes > ---

[jira] [Resolved] (SPARK-12323) Don't assign default value for non-nullable columns of a Dataset

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12323. -- Resolution: Fixed Fix Version/s: 2.0.0 > Don't assign default value for non-nullable columns of

[jira] [Resolved] (SPARK-15011) org.apache.spark.sql.hive.StatisticsSuite.analyze MetastoreRelations fails when hadoop 2.3 or hadoop 2.4 is used

2016-06-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15011. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > org.apache.s

[jira] [Resolved] (SPARK-15933) Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-15933. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13653 [https://g

[jira] [Created] (SPARK-15958) Make initial buffer size for the Sorter configurable

2016-06-14 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-15958: --- Summary: Make initial buffer size for the Sorter configurable Key: SPARK-15958 URL: https://issues.apache.org/jira/browse/SPARK-15958 Project: Spark Issue Type

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Assignee: (was: Yanbo Liang) > RFormula supports forcing to index label > -

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type currently. If the label is nume

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: Apache Spark > When unwrapping ORC avoid pattern matching at runtime > -

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: Apache Spark > When unwrapping ORC avoid pattern matching at runtime > -

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15956: Assignee: (was: Apache Spark) > When unwrapping ORC avoid pattern matching at runtime

[jira] [Commented] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330946#comment-15330946 ] Apache Spark commented on SPARK-15956: -- User 'dafrista' has created a pull request f

[jira] [Commented] (SPARK-3451) spark-submit should support specifying glob wildcards in the --jars CLI option

2016-06-14 Thread Kun Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330945#comment-15330945 ] Kun Liu commented on SPARK-3451: Vote for this feature. If no one will, I may try as my f

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type a

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type a

[jira] [Updated] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15957: Description: RFormula will index label only when it is string type. If the label is numeric type a

[jira] [Resolved] (SPARK-15927) Eliminate redundant code in DAGScheduler's getParentStages and getAncestorShuffleDependencies methods.

2016-06-14 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-15927. Resolution: Fixed Fix Version/s: 2.1.0 Fixed by https://github.com/apache/spark/com

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-15957: --- Assignee: Yanbo Liang (was: Apache Spark) > RFormula supports forcing to index label >

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label > --

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: (was: Apache Spark) > RFormula supports forcing to index label > ---

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label > --

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: Apache Spark > RFormula supports forcing to index label > --

[jira] [Commented] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330896#comment-15330896 ] Apache Spark commented on SPARK-15957: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15957: Assignee: (was: Apache Spark) > RFormula supports forcing to index label > ---

[jira] [Created] (SPARK-15957) RFormula supports forcing to index label

2016-06-14 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15957: --- Summary: RFormula supports forcing to index label Key: SPARK-15957 URL: https://issues.apache.org/jira/browse/SPARK-15957 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

2016-06-14 Thread Brian Cho (JIRA)
Brian Cho created SPARK-15956: - Summary: When unwrapping ORC avoid pattern matching at runtime Key: SPARK-15956 URL: https://issues.apache.org/jira/browse/SPARK-15956 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15954: Assignee: Apache Spark > TestHive has issues being used in PySpark > -

[jira] [Commented] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330822#comment-15330822 ] Apache Spark commented on SPARK-15954: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15954: Assignee: (was: Apache Spark) > TestHive has issues being used in PySpark > --

[jira] [Updated] (SPARK-15955) Failed Spark application returns with exitcode equals to zero

2016-06-14 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-15955: --- Summary: Failed Spark application returns with exitcode equals to zero (was: Failed Spark applicatio

[jira] [Commented] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330821#comment-15330821 ] holdenk commented on SPARK-15954: - See related PR https://github.com/apache/spark/pull/12

[jira] [Created] (SPARK-15955) Failed Spark application returns with client console equals zero

2016-06-14 Thread Yesha Vora (JIRA)
Yesha Vora created SPARK-15955: -- Summary: Failed Spark application returns with client console equals zero Key: SPARK-15955 URL: https://issues.apache.org/jira/browse/SPARK-15955 Project: Spark

[jira] [Created] (SPARK-15954) TestHive has issues being used in PySpark

2016-06-14 Thread holdenk (JIRA)
holdenk created SPARK-15954: --- Summary: TestHive has issues being used in PySpark Key: SPARK-15954 URL: https://issues.apache.org/jira/browse/SPARK-15954 Project: Spark Issue Type: Bug Com

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Apache Spark (was: Tathagata Das) > Renamed ContinuousQuery to StreamingQuery f

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Tathagata Das (was: Apache Spark) > Renamed ContinuousQuery to StreamingQuery f

[jira] [Commented] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330805#comment-15330805 ] Apache Spark commented on SPARK-15953: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Apache Spark (was: Tathagata Das) > Renamed ContinuousQuery to StreamingQuery f

[jira] [Assigned] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15953: Assignee: Tathagata Das (was: Apache Spark) > Renamed ContinuousQuery to StreamingQuery f

[jira] [Updated] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15953: -- Target Version/s: 2.0.0 > Renamed ContinuousQuery to StreamingQuery for simplicity > --

[jira] [Created] (SPARK-15953) Renamed ContinuousQuery to StreamingQuery for simplicity

2016-06-14 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-15953: - Summary: Renamed ContinuousQuery to StreamingQuery for simplicity Key: SPARK-15953 URL: https://issues.apache.org/jira/browse/SPARK-15953 Project: Spark Is

[jira] [Updated] (SPARK-15933) Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer

2016-06-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15933: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-8360 > Refactor reader-writer interface

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330723#comment-15330723 ] Apache Spark commented on SPARK-15046: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15741: Assignee: (was: Apache Spark) > PySpark Cleanup of _setDefault with seed=None > --

[jira] [Assigned] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15741: Assignee: Apache Spark > PySpark Cleanup of _setDefault with seed=None > -

[jira] [Commented] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330696#comment-15330696 ] Apache Spark commented on SPARK-15741: -- User 'BryanCutler' has created a pull reques

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330675#comment-15330675 ] Mark Grover commented on SPARK-12177: - bq. I can rename it to spark-streaming-kafka-0

[jira] [Assigned] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15952: Assignee: (was: Apache Spark) > "show databases" does not get sorted result >

[jira] [Commented] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330663#comment-15330663 ] Apache Spark commented on SPARK-15952: -- User 'bomeng' has created a pull request for

[jira] [Assigned] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15952: Assignee: Apache Spark > "show databases" does not get sorted result > ---

[jira] [Reopened] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reopened SPARK-15741: -- Reopened as I feel this still should be cleaned up. > PySpark Cleanup of _setDefault with seed=Non

[jira] [Updated] (SPARK-15741) PySpark Cleanup of _setDefault with seed=None

2016-06-14 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-15741: - Description: Several places in PySpark ML have Params._setDefault with a seed param equal to {{No

[jira] [Created] (SPARK-15952) "show databases" does not get sorted result

2016-06-14 Thread Bo Meng (JIRA)
Bo Meng created SPARK-15952: --- Summary: "show databases" does not get sorted result Key: SPARK-15952 URL: https://issues.apache.org/jira/browse/SPARK-15952 Project: Spark Issue Type: Bug C

[jira] [Reopened] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-15892: --- > Incorrectly merged AFTAggregator with zero total count > --

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Fix Version/s: (was: 1.6.2) > Incorrectly merged AFTAggregator with zero total coun

[jira] [Assigned] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15951: Assignee: Apache Spark > Change Executors Page to use datatables to support sorting column

[jira] [Commented] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330629#comment-15330629 ] Apache Spark commented on SPARK-15951: -- User 'kishorvpatil' has created a pull reque

[jira] [Assigned] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15951: Assignee: (was: Apache Spark) > Change Executors Page to use datatables to support sor

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330552#comment-15330552 ] Cody Koeninger commented on SPARK-12177: I can rename it to spark-streaming-kafka

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-06-14 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330550#comment-15330550 ] Russell Alexander Spitzer commented on SPARK-13928: --- So users(like me ;

[jira] [Commented] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330529#comment-15330529 ] Shixiong Zhu commented on SPARK-15905: -- Did you happen to block the stdout or stderr

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-14 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330526#comment-15330526 ] Yan Chen commented on SPARK-15716: -- The checkpoint path is on HDFS. The application is a

[jira] [Created] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

2016-06-14 Thread Kishor Patil (JIRA)
Kishor Patil created SPARK-15951: Summary: Change Executors Page to use datatables to support sorting columns and searching Key: SPARK-15951 URL: https://issues.apache.org/jira/browse/SPARK-15951 Proj

[jira] [Updated] (SPARK-15888) Python UDF over aggregate fails

2016-06-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15888: --- Priority: Blocker (was: Major) > Python UDF over aggregate fails > --- >

[jira] [Assigned] (SPARK-15888) Python UDF over aggregate fails

2016-06-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-15888: -- Assignee: Davies Liu > Python UDF over aggregate fails > --- > >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330500#comment-15330500 ] Mark Grover commented on SPARK-12177: - bq. It's worth mentioning that authentication

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330497#comment-15330497 ] Shixiong Zhu commented on SPARK-15716: -- I saw there were a lot of "org.apache.spark

[jira] [Resolved] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15247. -- Resolution: Fixed Fix Version/s: 2.0.0 This issue has been resolved by https://github.com/apache

[jira] [Updated] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-06-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15247: - Assignee: Takeshi Yamamuro > sqlCtx.read.parquet yields at least n_executors * n_cores tasks > --

  1   2   3   >