[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: spark-env.sh spark-defaults.conf config files used by

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: screenshot-Spark_1.6.1.png > Spark 2.0 vs 1.6.1 Query Time(out) >

[jira] [Updated] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Honderdors updated SPARK-14946: --- Attachment: screenshot-spark_2.0.png > Spark 2.0 vs 1.6.1 Query Time(out) >

[jira] [Created] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-04-26 Thread Raymond Honderdors (JIRA)
Raymond Honderdors created SPARK-14946: -- Summary: Spark 2.0 vs 1.6.1 Query Time(out) Key: SPARK-14946 URL: https://issues.apache.org/jira/browse/SPARK-14946 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14945) Python SparkSession API

2016-04-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14945: - Assignee: Andrew Or > Python SparkSession API > --- > >

[jira] [Created] (SPARK-14945) Python SparkSession API

2016-04-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14945: - Summary: Python SparkSession API Key: SPARK-14945 URL: https://issues.apache.org/jira/browse/SPARK-14945 Project: Spark Issue Type: Sub-task Components:

[jira] [Assigned] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14944: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf from HiveTableScanExec and

[jira] [Commented] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259565#comment-15259565 ] Apache Spark commented on SPARK-14944: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14944: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf from HiveTableScanExec and

[jira] [Created] (SPARK-14944) Remove HiveConf from HiveTableScanExec and HiveTableReader

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14944: --- Summary: Remove HiveConf from HiveTableScanExec and HiveTableReader Key: SPARK-14944 URL: https://issues.apache.org/jira/browse/SPARK-14944 Project: Spark

[jira] [Assigned] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14943: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf dependency from

[jira] [Assigned] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14943: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf dependency from

[jira] [Commented] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259560#comment-15259560 ] Apache Spark commented on SPARK-14943: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-14943) Remove HiveConf dependency from ScriptTransformation

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14943: --- Summary: Remove HiveConf dependency from ScriptTransformation Key: SPARK-14943 URL: https://issues.apache.org/jira/browse/SPARK-14943 Project: Spark Issue

[jira] [Resolved] (SPARK-14913) Simplify configuration API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14913. - Resolution: Fixed Fix Version/s: 2.0.0 > Simplify configuration API >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-04-26 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259536#comment-15259536 ] Cody Koeninger commented on SPARK-12177: Well, given that we have working implementations of rdd

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-04-26 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259530#comment-15259530 ] Mario Briggs commented on SPARK-12177: -- what's the thinking on this one with respect to Structured

[jira] [Updated] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13477: Assignee: Andrew Or (was: Reynold Xin) > User-facing catalog API > --- > >

[jira] [Resolved] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13477. - Resolution: Fixed Fix Version/s: 2.0.0 > User-facing catalog API >

[jira] [Assigned] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14942: Assignee: (was: Apache Spark) > First construct a batch then run the batch for

[jira] [Commented] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259498#comment-15259498 ] Apache Spark commented on SPARK-14942: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Created] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14942: - Summary: First construct a batch then run the batch for continuous queries Key: SPARK-14942 URL: https://issues.apache.org/jira/browse/SPARK-14942 Project: Spark

[jira] [Assigned] (SPARK-14942) First construct a batch then run the batch for continuous queries

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14942: Assignee: Apache Spark > First construct a batch then run the batch for continuous

[jira] [Commented] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259466#comment-15259466 ] Apache Spark commented on SPARK-14786: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259464#comment-15259464 ] Apache Spark commented on SPARK-14783: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259434#comment-15259434 ] Apache Spark commented on SPARK-11940: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14941: Assignee: Reynold Xin (was: Apache Spark) > Remove runtime HiveConf >

[jira] [Assigned] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14941: Assignee: Apache Spark (was: Reynold Xin) > Remove runtime HiveConf >

[jira] [Commented] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259380#comment-15259380 ] Apache Spark commented on SPARK-14941: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-14941) Remove runtime HiveConf

2016-04-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14941: --- Summary: Remove runtime HiveConf Key: SPARK-14941 URL: https://issues.apache.org/jira/browse/SPARK-14941 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-14445) Show columns/partitions

2016-04-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14445. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 1

[jira] [Commented] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-04-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259266#comment-15259266 ] Nicholas Chammas commented on SPARK-14932: -- [~marmbrus] - Not sure if you're a good person to

[jira] [Commented] (SPARK-14919) Spark Cannot be used with software that requires jackson-databind 2.6+: RDDOperationScope

2016-04-26 Thread John Ferguson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259247#comment-15259247 ] John Ferguson commented on SPARK-14919: --- So basically no matter what we - Spark, us, the world - as

[jira] [Resolved] (SPARK-14732) spark.ml GaussianMixture should not use spark.mllib MultivariateGaussian

2016-04-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-14732. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12593

[jira] [Assigned] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14940: Assignee: Andrew Or (was: Apache Spark) > Move ExternalCatalog to own file >

[jira] [Commented] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259193#comment-15259193 ] Apache Spark commented on SPARK-14940: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14940: Assignee: Apache Spark (was: Andrew Or) > Move ExternalCatalog to own file >

[jira] [Created] (SPARK-14940) Move ExternalCatalog to own file

2016-04-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14940: - Summary: Move ExternalCatalog to own file Key: SPARK-14940 URL: https://issues.apache.org/jira/browse/SPARK-14940 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14858: Assignee: (was: Apache Spark) > Push predicates with subquery >

[jira] [Commented] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259184#comment-15259184 ] Apache Spark commented on SPARK-14858: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14858) Push predicates with subquery

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14858: Assignee: Apache Spark > Push predicates with subquery > --

[jira] [Updated] (SPARK-14834) Force adding doc for new api in pyspark with @since annotation

2016-04-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-14834: --- Description: This is for enforcing user to add python doc when adding new python api with @since

[jira] [Assigned] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14939: Assignee: Apache Spark > Eliminate No-op Alias SortOrder in Sort >

[jira] [Commented] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259165#comment-15259165 ] Apache Spark commented on SPARK-14939: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14939: Assignee: (was: Apache Spark) > Eliminate No-op Alias SortOrder in Sort >

[jira] [Assigned] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14938: Assignee: Apache Spark > Use Datasets to improve internal implementation >

[jira] [Commented] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259160#comment-15259160 ] Apache Spark commented on SPARK-14938: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14938: Assignee: (was: Apache Spark) > Use Datasets to improve internal implementation >

[jira] [Created] (SPARK-14939) Eliminate No-op Alias SortOrder in Sort

2016-04-26 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14939: - Summary: Eliminate No-op Alias SortOrder in Sort Key: SPARK-14939 URL: https://issues.apache.org/jira/browse/SPARK-14939 Project: Spark Issue Type:

[jira] [Updated] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14938: - Description: As discussed in [https://github.com/apache/spark/pull/11915], we can use

[jira] [Updated] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14938: - Description: As discussed in (GITHUB)[https://github.com/apache/spark/pull/11915], we can use

[jira] [Created] (SPARK-14938) Use Datasets to improve internal implementation

2016-04-26 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-14938: Summary: Use Datasets to improve internal implementation Key: SPARK-14938 URL: https://issues.apache.org/jira/browse/SPARK-14938 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14937: Assignee: (was: Apache Spark) > spark.ml LogisticRegression sqlCtx in scala is

[jira] [Commented] (SPARK-14926) OneVsRest labelMetadata uses incorrect name

2016-04-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259146#comment-15259146 ] zhengruifeng commented on SPARK-14926: -- [~josephkb] I can work on this. > OneVsRest labelMetadata

[jira] [Commented] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259149#comment-15259149 ] Apache Spark commented on SPARK-14937: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14937: Assignee: Apache Spark > spark.ml LogisticRegression sqlCtx in scala is inconsistent with

[jira] [Commented] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259142#comment-15259142 ] Miao Wang commented on SPARK-14937: --- submitting PR now. > spark.ml LogisticRegression sqlCtx in scala

[jira] [Created] (SPARK-14937) spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python

2016-04-26 Thread Miao Wang (JIRA)
Miao Wang created SPARK-14937: - Summary: spark.ml LogisticRegression sqlCtx in scala is inconsistent with java and python Key: SPARK-14937 URL: https://issues.apache.org/jira/browse/SPARK-14937 Project:

[jira] [Comment Edited] (SPARK-5997) Increase partition count without performing a shuffle

2016-04-26 Thread Robert Ormandi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259101#comment-15259101 ] Robert Ormandi edited comment on SPARK-5997 at 4/26/16 10:58 PM: - Does it

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2016-04-26 Thread Robert Ormandi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259101#comment-15259101 ] Robert Ormandi commented on SPARK-5997: --- Does it simply solve the problem if the method split up

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-26 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259100#comment-15259100 ] Jakob Odersky commented on SPARK-14519: --- That sounds reasonable, however should the parent JIRA

[jira] [Created] (SPARK-14936) FlumePollingStreamSuite is slow

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14936: -- Summary: FlumePollingStreamSuite is slow Key: SPARK-14936 URL: https://issues.apache.org/jira/browse/SPARK-14936 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259095#comment-15259095 ] Apache Spark commented on SPARK-14933: -- User 'xwu0226' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14933: Assignee: (was: Apache Spark) > Failed to create view out of a parquet or orc table

[jira] [Assigned] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14933: Assignee: Apache Spark > Failed to create view out of a parquet or orc table >

[jira] [Created] (SPARK-14935) DistributedSuite "local-cluster format" shouldn't actually launch clusters

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14935: -- Summary: DistributedSuite "local-cluster format" shouldn't actually launch clusters Key: SPARK-14935 URL: https://issues.apache.org/jira/browse/SPARK-14935 Project:

[jira] [Updated] (SPARK-13734) SparkR histogram

2016-04-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-13734: -- Assignee: Oscar D. Lara Yejas > SparkR histogram > > >

[jira] [Created] (SPARK-14934) Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files"

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14934: -- Summary: Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files" Key: SPARK-14934 URL: https://issues.apache.org/jira/browse/SPARK-14934

[jira] [Resolved] (SPARK-13734) SparkR histogram

2016-04-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13734. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259084#comment-15259084 ] Xin Wu commented on SPARK-14933: I have a fix for this and will submit a PR soon. > Failed to create

[jira] [Commented] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

2016-04-26 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259079#comment-15259079 ] Jakob Odersky commented on SPARK-14146: --- the reason this fails is because spark-shell sets the

[jira] [Closed] (SPARK-14928) Support variable substitution in SET command

2016-04-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng closed SPARK-14928. --- Resolution: Won't Fix > Support variable substitution in SET command >

[jira] [Commented] (SPARK-14928) Support variable substitution in SET command

2016-04-26 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259069#comment-15259069 ] Bo Meng commented on SPARK-14928: - Parser already handles it. Closing it. > Support variable

[jira] [Created] (SPARK-14933) Failed to create view out of a parquet or orc table

2016-04-26 Thread Xin Wu (JIRA)
Xin Wu created SPARK-14933: -- Summary: Failed to create view out of a parquet or orc table Key: SPARK-14933 URL: https://issues.apache.org/jira/browse/SPARK-14933 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14925) Published POMs should be flattened

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14925. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12706

[jira] [Comment Edited] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2016-04-26 Thread Ben McCann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255122#comment-15255122 ] Ben McCann edited comment on SPARK-7008 at 4/26/16 10:09 PM: - I've found a

[jira] [Created] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-04-26 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-14932: Summary: Allow DataFrame.replace() to replace values with None Key: SPARK-14932 URL: https://issues.apache.org/jira/browse/SPARK-14932 Project: Spark

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258998#comment-15258998 ] Apache Spark commented on SPARK-12154: -- User 'mccheah' has created a pull request for this issue:

[jira] [Commented] (SPARK-14927) DataFrame. saveAsTable creates RDD partitions but not Hive partitions

2016-04-26 Thread Sasha Ovsankin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259014#comment-15259014 ] Sasha Ovsankin commented on SPARK-14927: Seems that the workaround is not to let saveAsTable

[jira] [Resolved] (SPARK-14929) Disable vectorized hashmap for wide schemas and high-precision decimals

2016-04-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14929. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12710

[jira] [Created] (SPARK-14931) Mismatched default values between pipelines in Spark and PySpark

2016-04-26 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-14931: - Summary: Mismatched default values between pipelines in Spark and PySpark Key: SPARK-14931 URL: https://issues.apache.org/jira/browse/SPARK-14931 Project: Spark

[jira] [Assigned] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14130: Assignee: Yin Huai (was: Apache Spark) > [Table related commands] Alter column >

[jira] [Assigned] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14130: Assignee: Apache Spark (was: Yin Huai) > [Table related commands] Alter column >

[jira] [Commented] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258996#comment-15258996 ] Apache Spark commented on SPARK-14130: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-14834) Force adding doc for new api in pyspark with @since annotation

2016-04-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258994#comment-15258994 ] Joseph K. Bradley commented on SPARK-14834: --- Please describe this in the JIRA description >

[jira] [Commented] (SPARK-14130) [Table related commands] Alter column

2016-04-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258991#comment-15258991 ] Yin Huai commented on SPARK-14130: -- We will ban those commands. > [Table related commands] Alter column

[jira] [Resolved] (SPARK-12301) Remove final from classes in spark.ml trees and ensembles where possible

2016-04-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12301. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12711

[jira] [Updated] (SPARK-14511) Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14511: --- Assignee: Jakob Odersky > Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258982#comment-15258982 ] Josh Rosen commented on SPARK-14519: Given that Scala 2.12 hasn't been released yet, I think that our

[jira] [Resolved] (SPARK-14514) Add python example for VectorSlicer

2016-04-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14514. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12282

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-26 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258974#comment-15258974 ] Jakob Odersky commented on SPARK-14519: --- >From a reply in the mailing list archive (14/4/2016):

[jira] [Comment Edited] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-26 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258956#comment-15258956 ] Faisal edited comment on SPARK-14737 at 4/26/16 9:30 PM: - Should we expect the

[jira] [Commented] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258964#comment-15258964 ] Apache Spark commented on SPARK-13477: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13477: Assignee: Reynold Xin (was: Apache Spark) > User-facing catalog API >

[jira] [Assigned] (SPARK-13477) User-facing catalog API

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13477: Assignee: Apache Spark (was: Reynold Xin) > User-facing catalog API >

[jira] [Commented] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-26 Thread Faisal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258956#comment-15258956 ] Faisal commented on SPARK-14737: Should we expect the same behavior if only 1 node of broker is down?

[jira] [Assigned] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-13693: -- Assignee: Josh Rosen (was: Shixiong Zhu) > Flaky test: o.a.s.streaming.MapWithStateSuite >

[jira] [Assigned] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13693: Assignee: Shixiong Zhu (was: Apache Spark) > Flaky test:

[jira] [Commented] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258955#comment-15258955 ] Apache Spark commented on SPARK-13693: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14930) Race condition in CheckpointWriter.stop()

2016-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14930: Assignee: Apache Spark (was: Josh Rosen) > Race condition in CheckpointWriter.stop() >

  1   2   3   >