[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-03-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372582#comment-14372582 ] Manoj Kumar commented on SPARK-5981: Great. I won't be able to devote much time to

[jira] [Commented] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372602#comment-14372602 ] Apache Spark commented on SPARK-6443: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Arsenii Krasikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372603#comment-14372603 ] Arsenii Krasikov commented on SPARK-6440: - I have already prepared [this

[jira] [Created] (SPARK-6445) IOException: Filesystem closed is thrown while existing spark-sql console

2015-03-21 Thread Vinod KC (JIRA)
Vinod KC created SPARK-6445: --- Summary: IOException: Filesystem closed is thrown while existing spark-sql console Key: SPARK-6445 URL: https://issues.apache.org/jira/browse/SPARK-6445 Project: Spark

[jira] [Comment Edited] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Arsenii Krasikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372641#comment-14372641 ] Arsenii Krasikov edited comment on SPARK-6440 at 3/21/15 10:27 AM:

[jira] [Comment Edited] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Arsenii Krasikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372641#comment-14372641 ] Arsenii Krasikov edited comment on SPARK-6440 at 3/21/15 10:26 AM:

[jira] [Commented] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Abhishek Chanda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372586#comment-14372586 ] Abhishek Chanda commented on SPARK-6440: I'd like to work on this. Please assign

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372537#comment-14372537 ] Michael Armbrust commented on SPARK-6231: - As a workaround you can explicitly

[jira] [Commented] (SPARK-5961) Allow specific nodes in a Spark Streaming cluster to be dedicated/preferred as Receiver Worker Nodes versus regular Spark Worker Nodes

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372589#comment-14372589 ] Apache Spark commented on SPARK-5961: - User 'ArcherShao' has created a pull request

[jira] [Commented] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372590#comment-14372590 ] Apache Spark commented on SPARK-6440: - User 'achanda' has created a pull request for

[jira] [Comment Edited] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Arsenii Krasikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372603#comment-14372603 ] Arsenii Krasikov edited comment on SPARK-6440 at 3/21/15 8:54 AM:

[jira] [Commented] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Arsenii Krasikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372641#comment-14372641 ] Arsenii Krasikov commented on SPARK-6440: - Sorry that i didn't give my suggestion

[jira] [Resolved] (SPARK-6445) IOException: Filesystem closed is thrown while existing spark-sql console

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6445. -- Resolution: Duplicate (Please search JIRA first) IOException: Filesystem closed is thrown while

[jira] [Commented] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372855#comment-14372855 ] Sean Owen commented on SPARK-6440: -- I would first recommend maybe trying to collaborate

[jira] [Updated] (SPARK-2858) Default log4j configuration no longer seems to work

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2858: - Target Version/s: (was: 1.1.0) Default log4j configuration no longer seems to work

[jira] [Updated] (SPARK-4205) Timestamp and Date objects with comparison operators

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4205: - Target Version/s: (was: 1.1.0) Timestamp and Date objects with comparison operators

[jira] [Updated] (SPARK-4503) The history server is not compatible with HDFS HA

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4503: - Target Version/s: (was: 1.1.0) The history server is not compatible with HDFS HA

[jira] [Updated] (SPARK-4278) SparkSQL job failing with java.lang.ClassCastException

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4278: - Target Version/s: (was: 1.1.0) SparkSQL job failing with java.lang.ClassCastException

[jira] [Updated] (SPARK-2015) Spark UI issues at scale

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2015: - Target Version/s: (was: 1.1.0) Spark UI issues at scale

[jira] [Updated] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2089: - Target Version/s: (was: 1.0.0, 1.0.1) With YARN, preferredNodeLocalityData isn't honored

[jira] [Updated] (SPARK-2064) web ui should not remove executors if they are dead

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2064: - Target Version/s: (was: 1.1.0) web ui should not remove executors if they are dead

[jira] [Updated] (SPARK-3998) Add offset limit to SqlParser.scala

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3998: - Target Version/s: (was: 1.1.0) Add offset limit to SqlParser.scala

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3586: - Target Version/s: (was: 1.1.0) Support nested directories in Spark Streaming

[jira] [Updated] (SPARK-3079) Hive build should depend on parquet serdes

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3079: - Target Version/s: (was: 1.1.1) Hive build should depend on parquet serdes

[jira] [Updated] (SPARK-2032) Add an RDD.samplePartitions method for partition-level sampling

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2032: - Target Version/s: (was: 1.1.0) Add an RDD.samplePartitions method for partition-level sampling

[jira] [Updated] (SPARK-2424) ApplicationState.MAX_NUM_RETRY should be configurable

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2424: - Target Version/s: (was: 1.1.0) ApplicationState.MAX_NUM_RETRY should be configurable

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3107: - Target Version/s: (was: 1.1.1) Don't pass null jar to executor in yarn-client mode

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

2015-03-21 Thread Denis Dus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372566#comment-14372566 ] Denis Dus commented on SPARK-6137: -- [~josephkb] Neither do I G-Means clustering

[jira] [Commented] (SPARK-6445) IOException: Filesystem closed is thrown while existing spark-sql console

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372612#comment-14372612 ] Apache Spark commented on SPARK-6445: - User 'vinodkc' has created a pull request for

[jira] [Commented] (SPARK-5203) union with different decimal type report error

2015-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372847#comment-14372847 ] Cheng Lian commented on SPARK-5203: --- Good point! [This

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Target Version/s: (was: 1.0.0) CassandraTest fails for newer Cassandra due to case insensitive key

[jira] [Updated] (SPARK-1972) Add support for setting and visualizing custom task-related metrics

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1972: - Target Version/s: (was: 1.0.0) Add support for setting and visualizing custom task-related metrics

[jira] [Updated] (SPARK-2991) RDD transforms for scan and scanLeft

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2991: - Target Version/s: (was: 1.1.1) RDD transforms for scan and scanLeft

[jira] [Updated] (SPARK-3919) HiveThriftServer2 fails to start because of Hive 0.12 metastore schema verification failure

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3919: - Target Version/s: (was: 1.1.1) HiveThriftServer2 fails to start because of Hive 0.12 metastore schema

[jira] [Resolved] (SPARK-1086) Some corner case during HA master switching?

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1086. -- Resolution: Duplicate Some corner case during HA master switching?

[jira] [Updated] (SPARK-5203) union with different decimal type report error

2015-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5203: -- Description: Test case like this: {code:sql} create table test (a decimal(10,1)); select a from test

[jira] [Commented] (SPARK-6441) Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-03-21 Thread Stephen Boesch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372818#comment-14372818 ] Stephen Boesch commented on SPARK-6441: --- sure thx Add Deflation/Schur

[jira] [Updated] (SPARK-6441) Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-03-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6441: - Summary: Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to

[jira] [Updated] (SPARK-6441) [MLLIB] Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-03-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6441: - Issue Type: Improvement (was: Bug) [MLLIB] Add Deflation/Schur Complement to Power Iteration

[jira] [Commented] (SPARK-6441) Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-03-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372761#comment-14372761 ] Xiangrui Meng commented on SPARK-6441: -- Let's test subtracting mean first before

[jira] [Updated] (SPARK-6441) Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-03-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6441: - Assignee: Stephen Boesch Add Deflation/Schur Complement to Power Iteration Clustering for

[jira] [Commented] (SPARK-6308) VectorUDT is displayed as `vecto` in dtypes

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372972#comment-14372972 ] Apache Spark commented on SPARK-6308: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-03-21 Thread Allan Douglas R. de Oliveira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372988#comment-14372988 ] Allan Douglas R. de Oliveira commented on SPARK-5928: - We've hit this

[jira] [Comment Edited] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-03-21 Thread Allan Douglas R. de Oliveira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372988#comment-14372988 ] Allan Douglas R. de Oliveira edited comment on SPARK-5928 at 3/21/15 8:23 PM:

[jira] [Resolved] (SPARK-5680) Sum function on all null values, should return zero

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5680. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by

[jira] [Created] (SPARK-6446) Spark Sql hive query is not working on spark1.3 version

2015-03-21 Thread pankaj (JIRA)
pankaj created SPARK-6446: - Summary: Spark Sql hive query is not working on spark1.3 version Key: SPARK-6446 URL: https://issues.apache.org/jira/browse/SPARK-6446 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6229) Support SASL encryption in network/common module

2015-03-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372957#comment-14372957 ] Reynold Xin commented on SPARK-6229: No that's not what I meant. I meant we can expose

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373008#comment-14373008 ] Anand Mohan Tumuluri commented on SPARK-6231: - Just wanted to give some more

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can work.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6409: Description: I run SQL like that {code} CREATE TEMPORARY FUNCTION test_avg AS

[jira] [Commented] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can work.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373040#comment-14373040 ] Michael Armbrust commented on SPARK-6409: - Reasonable. Want to open a PR? It is

[jira] [Updated] (SPARK-6242) Support replace (drop) column for parquet table

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6242: Assignee: Cheng Lian Support replace (drop) column for parquet table

[jira] [Commented] (SPARK-6242) Support replace (drop) column for parquet table

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373042#comment-14373042 ] Michael Armbrust commented on SPARK-6242: - Do you have a code snipit that shows

[jira] [Updated] (SPARK-6242) Support replace (drop) column for parquet table

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6242: Target Version/s: 1.4.0 Support replace (drop) column for parquet table

[jira] [Updated] (SPARK-6124) Support jdbc connection properties in OPTIONS part of the query

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6124: Target Version/s: 1.4.0 Support jdbc connection properties in OPTIONS part of the query

[jira] [Commented] (SPARK-6217) insertInto doesn't work in PySpark

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373044#comment-14373044 ] Michael Armbrust commented on SPARK-6217: - This error (not a very clear one from a

[jira] [Updated] (SPARK-6116) Making DataFrame API non-experimental

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Target Version/s: 1.4.0 Making DataFrame API non-experimental

[jira] [Updated] (SPARK-6116) Making DataFrame API non-experimental

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Priority: Blocker (was: Major) Making DataFrame API non-experimental

[jira] [Resolved] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6213. - Resolution: Won't Fix This is an internal API that is only exposed for experiments. As a

[jira] [Commented] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373048#comment-14373048 ] Michael Armbrust commented on SPARK-6213: - I'll add that everything other than

[jira] [Updated] (SPARK-6440) ipv6 URI for HttpServer

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6440: - Component/s: Spark Core Priority: Minor (was: Major) ipv6 URI for HttpServer

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6443: - Component/s: Spark Submit Do you mean you are not sure if this is actually a problem? Could not submit

[jira] [Commented] (SPARK-6180) Error logged into log4j when use the HiveMetastoreCatalog::tableExists

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373053#comment-14373053 ] Michael Armbrust commented on SPARK-6180: - I didn't realize there was another

[jira] [Updated] (SPARK-6180) Error logged into log4j when use the HiveMetastoreCatalog::tableExists

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6180: Labels: Hive HiveMetastoreCatalog spark starter (was: Hive HiveMetastoreCatalog spark)

[jira] [Commented] (SPARK-6217) insertInto doesn't work in PySpark

2015-03-21 Thread Charles Cloud (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373056#comment-14373056 ] Charles Cloud commented on SPARK-6217: -- If you've built spark with Hive then you'll

[jira] [Created] (SPARK-6448) History server doesn't log exception when failing to replay log file

2015-03-21 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-6448: Summary: History server doesn't log exception when failing to replay log file Key: SPARK-6448 URL: https://issues.apache.org/jira/browse/SPARK-6448 Project: Spark

[jira] [Updated] (SPARK-6072) Enable hash joins for null-safe equality predicates

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6072: Summary: Enable hash joins for null-safe equality predicates (was: Enable hash joins for

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5863: Issue Type: Improvement (was: Bug) Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5863: Target Version/s: 1.4.0 Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5863: Summary: Improve performance of convertToScala codepath. (was: Performance regression in

[jira] [Commented] (SPARK-6447) Add quick-links to StagePage to jump to Accumulator/Task tables

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373081#comment-14373081 ] Apache Spark commented on SPARK-6447: - User 'ryan-williams' has created a pull request

[jira] [Created] (SPARK-6449) Driver OOM results in reported application result SUCCESS

2015-03-21 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-6449: Summary: Driver OOM results in reported application result SUCCESS Key: SPARK-6449 URL: https://issues.apache.org/jira/browse/SPARK-6449 Project: Spark

[jira] [Commented] (SPARK-6446) Spark Sql hive query is not working on spark1.3 version

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373037#comment-14373037 ] Michael Armbrust commented on SPARK-6446: - Thanks for reporting. This should be

[jira] [Resolved] (SPARK-6446) Spark Sql hive query is not working on spark1.3 version

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6446. - Resolution: Duplicate Spark Sql hive query is not working on spark1.3 version

[jira] [Updated] (SPARK-6411) PySpark DataFrames can't be created if any datetimes have timezones

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6411: Target Version/s: 1.4.0 PySpark DataFrames can't be created if any datetimes have

[jira] [Updated] (SPARK-6411) PySpark DataFrames can't be created if any datetimes have timezones

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6411: Assignee: Davies Liu PySpark DataFrames can't be created if any datetimes have timezones

[jira] [Updated] (SPARK-6217) insertInto doesn't work in PySpark

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6217: Target Version/s: 1.4.0 insertInto doesn't work in PySpark

[jira] [Resolved] (SPARK-6210) Generated column name should not include id of column in it.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6210. - Resolution: Fixed Fix Version/s: 1.3.1 Generated column name should not include

[jira] [Updated] (SPARK-6054) SQL UDF returning object of case class; regression from 1.2.0

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6054: Target Version/s: 1.3.1 SQL UDF returning object of case class; regression from 1.2.0

[jira] [Commented] (SPARK-6217) insertInto doesn't work in PySpark

2015-03-21 Thread Charles Cloud (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373054#comment-14373054 ] Charles Cloud commented on SPARK-6217: -- That code segment is an exact copy-paste of

[jira] [Updated] (SPARK-6054) SQL UDF returning object of case class; regression from 1.2.0

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6054: Description: The following code fails with a stack trace beginning with: {code} 15/02/26

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can work.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6409: Target Version/s: 1.3.1 It is not necessary that avoid old inteface of hive that will make

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can work.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6409: Labels: starter (was: ) It is not necessary that avoid old inteface of hive that will

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can work.

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6409: Issue Type: Bug (was: Question) It is not necessary that avoid old inteface of hive that

[jira] [Updated] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6012: Target Version/s: 1.4.0 Deadlock when asking for partitions from CoalescedRDD on top of a

[jira] [Resolved] (SPARK-5903) Add support for Decimal type in SQL Table caching

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5903. - Resolution: Duplicate Fix Version/s: 1.3.0 Add support for Decimal type in SQL

[jira] [Commented] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373038#comment-14373038 ] Michael Armbrust commented on SPARK-6430: - I don't believe this is a bug, but is a

[jira] [Resolved] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6430. - Resolution: Not a Problem Cannot resolve column correctlly when using left semi join

[jira] [Updated] (SPARK-6289) PySpark doesn't maintain SQL date Types

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6289: Assignee: Davies Liu PySpark doesn't maintain SQL date Types

[jira] [Updated] (SPARK-6124) Support jdbc connection properties in OPTIONS part of the query

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6124: Assignee: Volodymyr Lyubinets Support jdbc connection properties in OPTIONS part of the

[jira] [Resolved] (SPARK-6276) beeline client class cast exception on partitioned table Spark SQL

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6276. - Resolution: Duplicate Fix Version/s: 1.3.0 I believe this is fixed in 1.3.0.

[jira] [Resolved] (SPARK-6184) Relocate logDebug to correct location in ResolveSortReferences

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6184. - Resolution: Won't Fix Relocate logDebug to correct location in ResolveSortReferences

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374742#comment-14374742 ] Michael Armbrust commented on SPARK-6231: - [~chinnitv] I don't think that that is

[jira] [Updated] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6231: --- Affects Version/s: (was: 1.4.0) Join on two tables (generated from same one) is broken

[jira] [Comment Edited] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14373008#comment-14373008 ] Reynold Xin edited comment on SPARK-6231 at 3/22/15 1:17 AM: -

[jira] [Created] (SPARK-6450) Self joining query failure

2015-03-21 Thread Anand Mohan Tumuluri (JIRA)
Anand Mohan Tumuluri created SPARK-6450: --- Summary: Self joining query failure Key: SPARK-6450 URL: https://issues.apache.org/jira/browse/SPARK-6450 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6450) Self joining query failure

2015-03-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374760#comment-14374760 ] Michael Armbrust commented on SPARK-6450: - What kind of table are you reading

[jira] [Commented] (SPARK-6450) Self joining query failure

2015-03-21 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374761#comment-14374761 ] Anand Mohan Tumuluri commented on SPARK-6450: - Yes it is from Parquet On Sat,

[jira] [Updated] (SPARK-6437) SQL ExternalSort should use CompletionIterator to clean up temp files

2015-03-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6437: Priority: Critical (was: Major) SQL ExternalSort should use CompletionIterator to clean up temp files

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-21 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374757#comment-14374757 ] Anand Mohan Tumuluri commented on SPARK-6231: - Added SPARK-6450

[jira] [Commented] (SPARK-6448) History server doesn't log exception when failing to replay log file

2015-03-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374759#comment-14374759 ] Apache Spark commented on SPARK-6448: - User 'vinodkc' has created a pull request for

  1   2   >