[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-11-20 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015609#comment-15015609 ] David Sabater commented on SPARK-6613: -- Apologies if I am repeating the same comment but this is

[jira] [Resolved] (SPARK-11461) ObjectFile saving/loading should use configured serializer

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11461. --- Resolution: Not A Problem > ObjectFile saving/loading should use configured serializer >

[jira] [Resolved] (SPARK-11459) Allow configuring checkpoint dir, filenames

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11459. --- Resolution: Not A Problem > Allow configuring checkpoint dir, filenames >

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-20 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018032#comment-15018032 ] sam commented on SPARK-11853: - [~srowen] We are not using --jars or anything like that, just executor cores,

[jira] [Assigned] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11881: Assignee: (was: Apache Spark) > [SQL] JDBC Postgres fetchsize parameter ignored >

[jira] [Created] (SPARK-11880) On Windows spark-env.cmd is not loaded.

2015-11-20 Thread Gaurav Sehgal (JIRA)
Gaurav Sehgal created SPARK-11880: - Summary: On Windows spark-env.cmd is not loaded. Key: SPARK-11880 URL: https://issues.apache.org/jira/browse/SPARK-11880 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-20 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018032#comment-15018032 ] sam edited comment on SPARK-11853 at 11/20/15 1:40 PM: --- [~srowen] We are not using

[jira] [Commented] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

2015-11-20 Thread swetha k (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018051#comment-15018051 ] swetha k commented on SPARK-11620: -- [~hyukjin.kwon] We use Spark 1.5.2 now and it still shows the same

[jira] [Commented] (SPARK-6964) Support Cancellation in the Thrift Server

2015-11-20 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018079#comment-15018079 ] Dominic Ricard commented on SPARK-6964: --- I don't know if my expectations are wrong but this does not

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018036#comment-15018036 ] Sean Owen commented on SPARK-11853: --- How are you getting the code to spark-submit? it does matter. As

[jira] [Commented] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018094#comment-15018094 ] Apache Spark commented on SPARK-11881: -- User 'mariusvniekerk' has created a pull request for this

[jira] [Reopened] (SPARK-11648) IllegalReferenceCountException in Spark workloads

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11648: --- > IllegalReferenceCountException in Spark workloads > -

[jira] [Resolved] (SPARK-11648) IllegalReferenceCountException in Spark workloads

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11648. --- Resolution: Duplicate > IllegalReferenceCountException in Spark workloads >

[jira] [Created] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-20 Thread Marius Van Niekerk (JIRA)
Marius Van Niekerk created SPARK-11881: -- Summary: [SQL] JDBC Postgres fetchsize parameter ignored Key: SPARK-11881 URL: https://issues.apache.org/jira/browse/SPARK-11881 Project: Spark

[jira] [Commented] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-20 Thread Marius Van Niekerk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018086#comment-15018086 ] Marius Van Niekerk commented on SPARK-11881: I have a PR for this incoming > [SQL] JDBC

[jira] [Assigned] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11881: Assignee: Apache Spark > [SQL] JDBC Postgres fetchsize parameter ignored >

[jira] [Commented] (SPARK-11821) Spark-Hive doesn't work with Kerberos in local mode

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015522#comment-15015522 ] Apache Spark commented on SPARK-11821: -- User 'woj-i' has created a pull request for this issue:

[jira] [Updated] (SPARK-11838) Spark SQL query fragment RDD reuse

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11838: -- Component/s: SQL > Spark SQL query fragment RDD reuse > -- > >

[jira] [Updated] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11853: -- Component/s: Spark Core > java.lang.ClassNotFoundException with spray-json on EMR >

[jira] [Updated] (SPARK-10000) Consolidate storage and execution memory management

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1: -- Assignee: Andrew Or > Consolidate storage and execution memory management >

[jira] [Updated] (SPARK-11870) Pyspark Streaming will swallow exceptions in TransformFunction and TransformFunctionSerializer

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11870: -- Component/s: PySpark > Pyspark Streaming will swallow exceptions in TransformFunction and >

[jira] [Updated] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11848: -- Assignee: Xiao Li > [SQL] Support EXPLAIN in DataSet APIs > - > >

[jira] [Created] (SPARK-11879) Checkpoint support for DataFrame

2015-11-20 Thread Cristian (JIRA)
Cristian created SPARK-11879: Summary: Checkpoint support for DataFrame Key: SPARK-11879 URL: https://issues.apache.org/jira/browse/SPARK-11879 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-11841) None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11841. --- Resolution: Not A Problem The docs show these as args to start-slave.sh, not the other scripts you

[jira] [Commented] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15016671#comment-15016671 ] Sean Owen commented on SPARK-11859: --- Are you saying it accepts invalid master URLs, or fails to accept

[jira] [Updated] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11633: -- Assignee: Xiao Li > HiveContext throws TreeNode Exception : Failed to Copy Node >

[jira] [Updated] (SPARK-11829) Model export/import for spark.ml: estimators under ml.feature (II)

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11829: -- Assignee: Yanbo Liang > Model export/import for spark.ml: estimators under ml.feature (II) >

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2015-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015497#comment-15015497 ] Hyukjin Kwon commented on SPARK-11844: -- Just a question.. Does this just happen randomly? if the

[jira] [Commented] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-20 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15016705#comment-15016705 ] Jacek Laskowski commented on SPARK-11859: - Sorry for not being clear - the regex says {{zk://}}

[jira] [Assigned] (SPARK-5106) Make Web UI automatically refresh/update displayed data

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5106: --- Assignee: (was: Apache Spark) > Make Web UI automatically refresh/update displayed data

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015660#comment-15015660 ] Sean Owen commented on SPARK-11853: --- Command line is not irrelevant because it include things like

[jira] [Assigned] (SPARK-5106) Make Web UI automatically refresh/update displayed data

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5106: --- Assignee: Apache Spark > Make Web UI automatically refresh/update displayed data >

[jira] [Commented] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15016715#comment-15016715 ] Sean Owen commented on SPARK-11859: --- OK yeah here's the key bit from

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2015-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015497#comment-15015497 ] Hyukjin Kwon edited comment on SPARK-11844 at 11/20/15 9:45 AM: Just a

[jira] [Commented] (SPARK-5106) Make Web UI automatically refresh/update displayed data

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015661#comment-15015661 ] Apache Spark commented on SPARK-5106: - User 'jbonofre' has created a pull request for this issue:

[jira] [Updated] (SPARK-11861) Feature importances for decision trees

2015-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11861: -- Target Version/s: (was: 1.7.0) Priority: Minor (was: Major) How is this different from

[jira] [Commented] (SPARK-11659) Codegen sporadically fails with same input character

2015-11-20 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018245#comment-15018245 ] Catalin Alexandru Zamfir commented on SPARK-11659: -- For now it seems there are no more

[jira] [Commented] (SPARK-11861) Feature importances for decision trees

2015-11-20 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018309#comment-15018309 ] Seth Hendrickson commented on SPARK-11861: -- It's not really different, except that when feature

[jira] [Resolved] (SPARK-11852) StandardScaler minor refactor

2015-11-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11852. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9839

[jira] [Updated] (SPARK-11852) StandardScaler minor refactor

2015-11-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11852: -- Target Version/s: 1.6.0 > StandardScaler minor refactor > - > >

[jira] [Commented] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018474#comment-15018474 ] Apache Spark commented on SPARK-11884: -- User 'ted-yu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11884: Assignee: (was: Apache Spark) > Drop multiple columns in the DataFrame API >

[jira] [Assigned] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11884: Assignee: Apache Spark > Drop multiple columns in the DataFrame API >

[jira] [Resolved] (SPARK-11689) Add user guide and example code for LDA under spark.ml

2015-11-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11689. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9722

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018445#comment-15018445 ] Yin Huai commented on SPARK-11844: -- It did happen randomly. I only saw it once or twice. The file was

[jira] [Commented] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018503#comment-15018503 ] Yin Huai commented on SPARK-3947: - OK . I can reproduce the issue in 1.5 branch. I have created

[jira] [Created] (SPARK-11882) Allow for running Spark applications against a custom coarse grained scheduler

2015-11-20 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11882: - Summary: Allow for running Spark applications against a custom coarse grained scheduler Key: SPARK-11882 URL: https://issues.apache.org/jira/browse/SPARK-11882

[jira] [Commented] (SPARK-11841) None of start-all.sh, start-master.sh or start-slaves.sh takes -m, -c or -d configuration options as per the document

2015-11-20 Thread Xiangyu Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018428#comment-15018428 ] Xiangyu Li commented on SPARK-11841: Thank you very much! > None of start-all.sh, start-master.sh or

[jira] [Assigned] (SPARK-11880) On Windows spark-env.cmd is not loaded.

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11880: Assignee: Apache Spark > On Windows spark-env.cmd is not loaded. >

[jira] [Created] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-11-20 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11885: Summary: UDAF may nondeterministically generate wrong results Key: SPARK-11885 URL: https://issues.apache.org/jira/browse/SPARK-11885 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018462#comment-15018462 ] Yin Huai commented on SPARK-3947: - Also, for your environment, are you running standalone mode, yarn, or

[jira] [Assigned] (SPARK-11880) On Windows spark-env.cmd is not loaded.

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11880: Assignee: (was: Apache Spark) > On Windows spark-env.cmd is not loaded. >

[jira] [Created] (SPARK-11883) New Parquet reader generate wrong result

2015-11-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11883: -- Summary: New Parquet reader generate wrong result Key: SPARK-11883 URL: https://issues.apache.org/jira/browse/SPARK-11883 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11852) StandardScaler minor refactor

2015-11-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11852: -- Assignee: Yanbo Liang > StandardScaler minor refactor > - > >

[jira] [Commented] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018459#comment-15018459 ] Yin Huai commented on SPARK-3947: - [~milad.bourh...@gmail.com] Is it possible that you can attach the

[jira] [Commented] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018469#comment-15018469 ] Davies Liu commented on SPARK-11700: So there is at most one SQLContext leak per thread, I think it's

[jira] [Created] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-20 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11884: -- Summary: Drop multiple columns in the DataFrame API Key: SPARK-11884 URL: https://issues.apache.org/jira/browse/SPARK-11884 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018459#comment-15018459 ] Yin Huai edited comment on SPARK-3947 at 11/20/15 6:27 PM: ---

[jira] [Commented] (SPARK-11880) On Windows spark-env.cmd is not loaded.

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018497#comment-15018497 ] Apache Spark commented on SPARK-11880: -- User 'toddwan' has created a pull request for this issue:

[jira] [Commented] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-20 Thread Martin Tapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018511#comment-15018511 ] Martin Tapp commented on SPARK-11788: - Any udpate, this seems like an easy fix? > Using

[jira] [Updated] (SPARK-11887) Close PersistenceEngine at end of tests

2015-11-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11887: --- Component/s: Tests > Close PersistenceEngine at end of tests >

[jira] [Assigned] (SPARK-11887) Close PersistenceEngine at end of tests

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11887: Assignee: Josh Rosen (was: Apache Spark) > Close PersistenceEngine at end of tests >

[jira] [Commented] (SPARK-11887) Close PersistenceEngine at end of tests

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018593#comment-15018593 ] Apache Spark commented on SPARK-11887: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11885: Assignee: Yin Huai > UDAF may nondeterministically generate wrong results >

[jira] [Assigned] (SPARK-11801) Notify driver when OOM is thrown before executor JVM is killed

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11801: Assignee: (was: Apache Spark) > Notify driver when OOM is thrown before executor JVM

[jira] [Commented] (SPARK-11801) Notify driver when OOM is thrown before executor JVM is killed

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018627#comment-15018627 ] Apache Spark commented on SPARK-11801: -- User 'vundela' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11801) Notify driver when OOM is thrown before executor JVM is killed

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11801: Assignee: Apache Spark > Notify driver when OOM is thrown before executor JVM is killed

[jira] [Resolved] (SPARK-11819) nice error message for missing encoder

2015-11-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11819. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9810

[jira] [Comment Edited] (SPARK-11822) Add docs for new Netty RPC configuration

2015-11-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018727#comment-15018727 ] Shixiong Zhu edited comment on SPARK-11822 at 11/20/15 8:34 PM: [~vanzin]

[jira] [Commented] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018520#comment-15018520 ] Yin Huai commented on SPARK-11885: -- [~milad.bourh...@gmail.com] I think it is not related to SPARK-9844.

[jira] [Comment Edited] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018520#comment-15018520 ] Yin Huai edited comment on SPARK-11885 at 11/20/15 7:02 PM:

[jira] [Created] (SPARK-11887) Close PersistenceEngine at end of tests

2015-11-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11887: -- Summary: Close PersistenceEngine at end of tests Key: SPARK-11887 URL: https://issues.apache.org/jira/browse/SPARK-11887 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

2015-11-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11876. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9855

[jira] [Updated] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

2015-11-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11873: - Issue Type: Improvement (was: Bug) > Regression for TPC-DS query 63 when used with

[jira] [Updated] (SPARK-11879) Checkpoint support for DataFrame/Dataset

2015-11-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11879: Summary: Checkpoint support for DataFrame/Dataset (was: Checkpoint support for DataFrame) >

[jira] [Updated] (SPARK-11879) Checkpoint support for DataFrame/Dataset

2015-11-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11879: Affects Version/s: (was: 1.5.2) > Checkpoint support for DataFrame/Dataset >

[jira] [Updated] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milad Bourhani updated SPARK-3947: -- Attachment: spark-udaf-adapted-1.5.2.zip > Support Scala/Java UDAF > --- >

[jira] [Commented] (SPARK-3947) Support Scala/Java UDAF

2015-11-20 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018536#comment-15018536 ] Milad Bourhani commented on SPARK-3947: --- I was running standalone mode and the log is identical to

[jira] [Updated] (SPARK-8233) misc function: hash

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8233: Target Version/s: (was: 1.6.0) > misc function: hash > --- > > Key:

[jira] [Updated] (SPARK-11819) nice error message for missing encoder

2015-11-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11819: - Assignee: Wenchen Fan > nice error message for missing encoder >

[jira] [Assigned] (SPARK-11650) "AkkaUtilsSuite.remote fetch ssl on - untrusted server" test is very slow

2015-11-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-11650: -- Assignee: Josh Rosen > "AkkaUtilsSuite.remote fetch ssl on - untrusted server" test is very

[jira] [Commented] (SPARK-11650) "AkkaUtilsSuite.remote fetch ssl on - untrusted server" test is very slow

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018706#comment-15018706 ] Apache Spark commented on SPARK-11650: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018702#comment-15018702 ] Apache Spark commented on SPARK-11716: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-10567) Reducer locality follow-up for Spark 1.6

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018528#comment-15018528 ] Yin Huai commented on SPARK-10567: -- [~matei] told me that the problem has been fixed. Right now, only

[jira] [Resolved] (SPARK-10567) Reducer locality follow-up for Spark 1.6

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10567. -- Resolution: Fixed Fix Version/s: 1.6.0 > Reducer locality follow-up for Spark 1.6 >

[jira] [Created] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11886: Summary: R function name conflicts with base or stats package ones Key: SPARK-11886 URL: https://issues.apache.org/jira/browse/SPARK-11886 Project: Spark

[jira] [Updated] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

2015-11-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11876: - Assignee: Xiao Li > [SQL] Support PrintSchema in DataSet APIs >

[jira] [Assigned] (SPARK-11887) Close PersistenceEngine at end of tests

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11887: Assignee: Apache Spark (was: Josh Rosen) > Close PersistenceEngine at end of tests >

[jira] [Assigned] (SPARK-4424) Clean up all SparkContexts in unit tests so that spark.driver.allowMultipleContexts can be false

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4424: --- Assignee: Apache Spark (was: Josh Rosen) > Clean up all SparkContexts in unit tests so that

[jira] [Commented] (SPARK-8233) misc function: hash

2015-11-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018609#comment-15018609 ] Reynold Xin commented on SPARK-8233: cc [~viirya] are you interested in working on this? > misc

[jira] [Commented] (SPARK-4424) Clean up all SparkContexts in unit tests so that spark.driver.allowMultipleContexts can be false

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018612#comment-15018612 ] Apache Spark commented on SPARK-4424: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11817: - Assignee: Liang-Chi Hsieh > insert of timestamp with factional seconds inserts a NULL >

[jira] [Resolved] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11817. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 Issue resolved by pull request

[jira] [Commented] (SPARK-6990) Add Java linting script

2015-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018675#comment-15018675 ] Apache Spark commented on SPARK-6990: - User 'dskrvk' has created a pull request for this issue:

[jira] [Updated] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11619: - Target Version/s: (was: 1.6.0) > cannot use UDTF in DataFrame.selectExpr >

[jira] [Commented] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

2015-11-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018743#comment-15018743 ] Yin Huai commented on SPARK-11619: -- I think [this line|

[jira] [Comment Edited] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-20 Thread Martin Tapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018511#comment-15018511 ] Martin Tapp edited comment on SPARK-11788 at 11/20/15 6:53 PM: --- Any update,

[jira] [Updated] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11886: - Description: See https://github.com/apache/spark/pull/9785 Currently these are masked:

[jira] [Created] (SPARK-11888) Model export/import for spark.ml: DecisionTreeClassifier,Regressor

2015-11-20 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11888: - Summary: Model export/import for spark.ml: DecisionTreeClassifier,Regressor Key: SPARK-11888 URL: https://issues.apache.org/jira/browse/SPARK-11888

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

2015-11-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018597#comment-15018597 ] Joseph K. Bradley commented on SPARK-6725: -- You can do that as a temp solution, but the

  1   2   3   >