[jira] [Created] (SPARK-3096) Include parquet hive serde by default in build

2014-08-18 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3096: -- Summary: Include parquet hive serde by default in build Key: SPARK-3096 URL: https://issues.apache.org/jira/browse/SPARK-3096 Project: Spark Issue Type:

[jira] [Created] (SPARK-3097) Word2Vec Performance Improvement

2014-08-18 Thread Liquan Pei (JIRA)
Liquan Pei created SPARK-3097: - Summary: Word2Vec Performance Improvement Key: SPARK-3097 URL: https://issues.apache.org/jira/browse/SPARK-3097 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3097) Word2Vec Performance Improvement

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3097: - Assignee: Liquan Pei Word2Vec Performance Improvement -

[jira] [Resolved] (SPARK-3097) Word2Vec Performance Improvement

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3097. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1932

[jira] [Updated] (SPARK-2839) Documentation for statistical functions

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2839: - Assignee: (was: Doris Xin) Documentation for statistical functions

[jira] [Created] (SPARK-3098) operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3098: -- Summary: operation groupByKey get a wrong results Key: SPARK-3098 URL: https://issues.apache.org/jira/browse/SPARK-3098 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3098) operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100374#comment-14100374 ] Guoqiang Li commented on SPARK-3098: cc [~matei], [~pwendell] operation groupByKey

[jira] [Updated] (SPARK-3098) operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3098: --- Fix Version/s: (was: 1.0.1) operation groupByKey get a wrong results

[jira] [Updated] (SPARK-3098) operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3098: --- Affects Version/s: 1.0.1 operation groupByKey get a wrong results

[jira] [Updated] (SPARK-3098) operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3098: --- Description: I do not know how to reproduce the bug. This is the case. When I was in operating 10

[jira] [Updated] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3098: --- Summary: In some cases, operation groupByKey get a wrong results (was: operation groupByKey get a

[jira] [Commented] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100402#comment-14100402 ] Sean Owen commented on SPARK-3098: -- What are your key types? are you sure they are

[jira] [Commented] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100418#comment-14100418 ] Guoqiang Li commented on SPARK-3098: Int type. Not sure there are no other

[jira] [Commented] (SPARK-3068) when run with jvm 1.8, should not set MaxPermSize

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100510#comment-14100510 ] Apache Spark commented on SPARK-3068: - User 'adrian-wang' has created a pull request

[jira] [Created] (SPARK-3099) Add a shutdown hook for cleanup staging directory to ExecutorLauncher

2014-08-18 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3099: - Summary: Add a shutdown hook for cleanup staging directory to ExecutorLauncher Key: SPARK-3099 URL: https://issues.apache.org/jira/browse/SPARK-3099 Project: Spark

[jira] [Commented] (SPARK-2815) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

2014-08-18 Thread Igor Vikhrov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100601#comment-14100601 ] Igor Vikhrov commented on SPARK-2815: - Hi all, I have the same issue in

[jira] [Commented] (SPARK-3069) Build instructions in README are outdated

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100609#comment-14100609 ] Apache Spark commented on SPARK-3069: - User 'srowen' has created a pull request for

[jira] [Created] (SPARK-3100) Spark RDD partitions are not running in the workers as per locality information given by each partition.

2014-08-18 Thread Ravindra Pesala (JIRA)
Ravindra Pesala created SPARK-3100: -- Summary: Spark RDD partitions are not running in the workers as per locality information given by each partition. Key: SPARK-3100 URL:

[jira] [Commented] (SPARK-3100) Spark RDD partitions are not running in the workers as per locality information given by each partition.

2014-08-18 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100664#comment-14100664 ] Ravindra Pesala commented on SPARK-3100: It seems there is an issue in

[jira] [Created] (SPARK-3101) Flag variable in ApplicationMaster should be declared as volatile

2014-08-18 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3101: - Summary: Flag variable in ApplicationMaster should be declared as volatile Key: SPARK-3101 URL: https://issues.apache.org/jira/browse/SPARK-3101 Project: Spark

[jira] [Commented] (SPARK-3101) Flag variable in ApplicationMaster should be declared as volatile

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100755#comment-14100755 ] Apache Spark commented on SPARK-3101: - User 'sarutak' has created a pull request for

[jira] [Resolved] (SPARK-3093) masterLock in Worker is no longer need

2014-08-18 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-3093. --- Resolution: Fixed Assignee: Chen Chao Target Version/s: 1.2.0

[jira] [Resolved] (SPARK-2862) DoubleRDDFunctions.histogram() throws exception for some inputs

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2862. -- Resolution: Fixed Fix Version/s: 1.1.0 DoubleRDDFunctions.histogram() throws exception

[jira] [Updated] (SPARK-2862) DoubleRDDFunctions.histogram() throws exception for some inputs

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2862: - Assignee: Chandan Kumar DoubleRDDFunctions.histogram() throws exception for some inputs

[jira] [Resolved] (SPARK-3096) Include parquet hive serde by default in build

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3096. - Resolution: Fixed Fix Version/s: 1.1.0 Include parquet hive serde by default in

[jira] [Commented] (SPARK-2929) Rewrite HiveThriftServer2Suite and CliSuite

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100861#comment-14100861 ] Michael Armbrust commented on SPARK-2929: - I'm bumping the severity of this as it

[jira] [Resolved] (SPARK-3084) Collect broadcasted tables in parallel in joins

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3084. - Resolution: Fixed Fix Version/s: 1.1.0 Collect broadcasted tables in parallel in

[jira] [Created] (SPARK-3102) Add tests for yarn-client mode

2014-08-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3102: - Summary: Add tests for yarn-client mode Key: SPARK-3102 URL: https://issues.apache.org/jira/browse/SPARK-3102 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3103) Fix UTF8 encoding in PySpark saveAsTextFile().

2014-08-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3103: - Summary: Fix UTF8 encoding in PySpark saveAsTextFile(). Key: SPARK-3103 URL: https://issues.apache.org/jira/browse/SPARK-3103 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3099) Add a shutdown hook for cleanup staging directory to ExecutorLauncher

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100887#comment-14100887 ] Apache Spark commented on SPARK-3099: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3104) Jenkins failing to test some PRs when asked to

2014-08-18 Thread Erik Erlandson (JIRA)
Erik Erlandson created SPARK-3104: - Summary: Jenkins failing to test some PRs when asked to Key: SPARK-3104 URL: https://issues.apache.org/jira/browse/SPARK-3104 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3015) Removing broadcast in quick successions causes Akka timeout

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100915#comment-14100915 ] Andrew Or commented on SPARK-3015: -- Sure, makes sense. Removing broadcast in quick

[jira] [Resolved] (SPARK-3085) Use compact data structures in SQL joins

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3085. - Resolution: Fixed Fix Version/s: 1.1.0 Use compact data structures in SQL joins

[jira] [Commented] (SPARK-3104) Jenkins failing to test some PRs when asked to

2014-08-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100930#comment-14100930 ] Josh Rosen commented on SPARK-3104: --- Jenkins only listens to commands from users in the

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100936#comment-14100936 ] Michael Armbrust commented on SPARK-2087: - Another thing that should be include in

[jira] [Resolved] (SPARK-3025) Allow JDBC clients to set a fair scheduler pool

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3025. - Resolution: Fixed Fix Version/s: 1.1.0 Allow JDBC clients to set a fair

[jira] [Resolved] (SPARK-3091) Add support for caching metadata on Parquet files

2014-08-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3091. - Resolution: Fixed Fix Version/s: 1.1.0 Add support for caching metadata on

[jira] [Commented] (SPARK-3103) Fix UTF8 encoding in PySpark saveAsTextFile().

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100958#comment-14100958 ] Apache Spark commented on SPARK-3103: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-3105) Calling cache() after RDDs are pipelined has no effect in PySpark

2014-08-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3105: - Summary: Calling cache() after RDDs are pipelined has no effect in PySpark Key: SPARK-3105 URL: https://issues.apache.org/jira/browse/SPARK-3105 Project: Spark

[jira] [Updated] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3098: --- Priority: Critical (was: Blocker) In some cases, operation groupByKey get a wrong results

[jira] [Commented] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101012#comment-14101012 ] Patrick Wendell commented on SPARK-3098: I'm de-escalating this until we have a

[jira] [Commented] (SPARK-3072) Yarn AM not always properly exiting after unregistering from RM

2014-08-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101134#comment-14101134 ] Thomas Graves commented on SPARK-3072: -- Note that this also isn't an issue on hadoop

[jira] [Created] (SPARK-3106) Suppress unwilling Exception and error messages caused by SendingConnection

2014-08-18 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3106: - Summary: Suppress unwilling Exception and error messages caused by SendingConnection Key: SPARK-3106 URL: https://issues.apache.org/jira/browse/SPARK-3106 Project:

[jira] [Commented] (SPARK-3106) Suppress unwilling Exception and error messages caused by SendingConnection

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101151#comment-14101151 ] Apache Spark commented on SPARK-3106: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
Andrew Or created SPARK-3107: Summary: Don't pass null jar to executor in yarn-client mode Key: SPARK-3107 URL: https://issues.apache.org/jira/browse/SPARK-3107 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: {code} 14/08/18 20:52:43 INFO yarn.Client: command: $JAVA_HOME/bin/java -server -Xmx512m

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: {code} 14/08/18 20:52:43 INFO yarn.Client: command: $JAVA_HOME/bin/java -server -Xmx512m

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: {code} 14/08/18 20:52:43 INFO yarn.Client: command: $JAVA_HOME/bin/java -server -Xmx512m

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: {code} 14/08/18 20:52:43 INFO yarn.Client: command: $JAVA_HOME/bin/java -server -Xmx512m

[jira] [Resolved] (SPARK-3103) Fix UTF8 encoding in PySpark saveAsTextFile().

2014-08-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3103. --- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Davies Liu Fix UTF8 encoding in

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: In the following line, ExecutorLauncher's `--jar` takes in null. {code} 14/08/18 20:52:43

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: In the following line, ExecutorLauncher's `--jar` takes in null. {code} 14/08/18 20:52:43

[jira] [Updated] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2014-08-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3107: - Description: In the following line, ExecutorLauncher's `--jar` takes in null. {code} 14/08/18 20:52:43

[jira] [Created] (SPARK-3108) Add predictOnValues to StreamingLR

2014-08-18 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-3108: Summary: Add predictOnValues to StreamingLR Key: SPARK-3108 URL: https://issues.apache.org/jira/browse/SPARK-3108 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2933) Cleanup unnecessary and duplicated code in Yarn module

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101307#comment-14101307 ] Apache Spark commented on SPARK-2933: - User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-3072) Yarn AM not always properly exiting after unregistering from RM

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101331#comment-14101331 ] Apache Spark commented on SPARK-3072: - User 'tgravescs' has created a pull request for

[jira] [Created] (SPARK-3109) Sql query with OR condition should be handled above PhysicalOperation layer

2014-08-18 Thread Alex Liu (JIRA)
Alex Liu created SPARK-3109: --- Summary: Sql query with OR condition should be handled above PhysicalOperation layer Key: SPARK-3109 URL: https://issues.apache.org/jira/browse/SPARK-3109 Project: Spark

[jira] [Commented] (SPARK-3108) Add predictOnValues to StreamingLR

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101360#comment-14101360 ] Apache Spark commented on SPARK-3108: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-3110) Add a ha mode in YARN mode to keep executors in between restarts

2014-08-18 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-3110: --- Summary: Add a ha mode in YARN mode to keep executors in between restarts Key: SPARK-3110 URL: https://issues.apache.org/jira/browse/SPARK-3110 Project: Spark

[jira] [Commented] (SPARK-2921) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

2014-08-18 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101383#comment-14101383 ] Timothy Chen commented on SPARK-2921: - This should be all addressed by the PR from the

[jira] [Commented] (SPARK-3110) Add a ha mode in YARN mode to keep executors in between restarts

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101394#comment-14101394 ] Apache Spark commented on SPARK-3110: - User 'harishreedharan' has created a pull

[jira] [Commented] (SPARK-3045) Make Serializer interface Java friendly

2014-08-18 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101419#comment-14101419 ] Andrew Ash commented on SPARK-3045: --- This issue can be closed since the PR was merged

[jira] [Resolved] (SPARK-3045) Make Serializer interface Java friendly

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3045. Resolution: Fixed Fix Version/s: 1.1.0 Thanks for the reminder, Andrew. Make Serializer

[jira] [Updated] (SPARK-3045) Make Serializer interface Java friendly

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3045: --- Labels: api_compatibility (was: ) Make Serializer interface Java friendly

[jira] [Updated] (SPARK-3045) Make Serializer interface Java friendly

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3045: --- Component/s: Spark Core Make Serializer interface Java friendly

[jira] [Commented] (SPARK-3019) Pluggable block transfer (data plane communication) interface

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101431#comment-14101431 ] Reynold Xin commented on SPARK-3019: I don't think my planned implementation of the

[jira] [Created] (SPARK-3111) Implement the LAST analytic function for sql

2014-08-18 Thread Xinyun Huang (JIRA)
Xinyun Huang created SPARK-3111: --- Summary: Implement the LAST analytic function for sql Key: SPARK-3111 URL: https://issues.apache.org/jira/browse/SPARK-3111 Project: Spark Issue Type:

[jira] [Commented] (SPARK-787) Add EC2 Script Option to Push EC2 Credentials to Spark Nodes

2014-08-18 Thread Dan Osipov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101481#comment-14101481 ] Dan Osipov commented on SPARK-787: -- I added a PR for this bug in

[jira] [Created] (SPARK-3112) Documentation for Streaming Logistic Regression Streaming

2014-08-18 Thread Ameet Talwalkar (JIRA)
Ameet Talwalkar created SPARK-3112: -- Summary: Documentation for Streaming Logistic Regression Streaming Key: SPARK-3112 URL: https://issues.apache.org/jira/browse/SPARK-3112 Project: Spark

[jira] [Commented] (SPARK-3111) Implement the LAST analytic function for sql

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101495#comment-14101495 ] Apache Spark commented on SPARK-3111: - User 'xinyunh' has created a pull request for

[jira] [Updated] (SPARK-3113) Using local spark-submit with an EC2 cluster fails to execute job

2014-08-18 Thread Dan Osipov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Osipov updated SPARK-3113: -- Description: Steps taken: * Start a new cluster using EC2 script. Command: {code} ./spark-ec2 -k

[jira] [Created] (SPARK-3113) Using local spark-submit with an EC2 cluster fails to execute job

2014-08-18 Thread Dan Osipov (JIRA)
Dan Osipov created SPARK-3113: - Summary: Using local spark-submit with an EC2 cluster fails to execute job Key: SPARK-3113 URL: https://issues.apache.org/jira/browse/SPARK-3113 Project: Spark

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2014-08-18 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101541#comment-14101541 ] Yi Tian commented on SPARK-2087: What is the temporary table mean for the thrift server?

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101567#comment-14101567 ] Reynold Xin commented on SPARK-2017: [~carlosfuertes] in your pull request (#1682),

[jira] [Created] (SPARK-3114) Python UDFS broken in Spark SQL

2014-08-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3114: - Summary: Python UDFS broken in Spark SQL Key: SPARK-3114 URL: https://issues.apache.org/jira/browse/SPARK-3114 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3114) Python UDFS broken in Spark SQL

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101625#comment-14101625 ] Apache Spark commented on SPARK-3114: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-2850) Check API consistency for statistical functions

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2850. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1878

[jira] [Resolved] (SPARK-3108) Add predictOnValues to StreamingLR

2014-08-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3108. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2023

[jira] [Commented] (SPARK-3098) In some cases, operation groupByKey get a wrong results

2014-08-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101700#comment-14101700 ] Guoqiang Li commented on SPARK-3098: [~pwendell] In our cluster, spark's version is

[jira] [Commented] (SPARK-2312) Spark Actors do not handle unknown messages in their receive methods

2014-08-18 Thread Isaias Barroso (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101703#comment-14101703 ] Isaias Barroso commented on SPARK-2312: --- Hi Kam, I can fix that issue. Spark

[jira] [Commented] (SPARK-3114) Python UDFS broken in Spark SQL

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101713#comment-14101713 ] Apache Spark commented on SPARK-3114: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-3116) Remove the excessive lockings in TorrentBroadcast

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3116: --- Summary: Remove the excessive lockings in TorrentBroadcast (was: Remove the excessive locking in

[jira] [Created] (SPARK-3116) Remove the excessive locking in TorrentBroadcast

2014-08-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-3116: -- Summary: Remove the excessive locking in TorrentBroadcast Key: SPARK-3116 URL: https://issues.apache.org/jira/browse/SPARK-3116 Project: Spark Issue Type:

[jira] [Created] (SPARK-3117) Avoid serialization for TorrentBroadcast blocks

2014-08-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-3117: -- Summary: Avoid serialization for TorrentBroadcast blocks Key: SPARK-3117 URL: https://issues.apache.org/jira/browse/SPARK-3117 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3116) Remove the excessive lockings in TorrentBroadcast

2014-08-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101761#comment-14101761 ] Apache Spark commented on SPARK-3116: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-3019) Pluggable block transfer (data plane communication) interface

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101767#comment-14101767 ] Reynold Xin commented on SPARK-3019: Also the rebalance of blocks and that should be

[jira] [Resolved] (SPARK-3114) Python UDFS broken in Spark SQL

2014-08-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3114. --- Resolution: Fixed Fix Version/s: 1.1.0 Python UDFS broken in Spark SQL

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-08-18 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101810#comment-14101810 ] Carlos Fuertes commented on SPARK-2017: --- Hi, I addressed the table css rendering

[jira] [Resolved] (SPARK-3116) Remove the excessive lockings in TorrentBroadcast

2014-08-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3116. Resolution: Fixed Fix Version/s: 1.1.0 Remove the excessive lockings in TorrentBroadcast

[jira] [Commented] (SPARK-3061) Maven build fails in Windows OS

2014-08-18 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101845#comment-14101845 ] Masayoshi TSUZUKI commented on SPARK-3061: -- Thank you for your comments. Yes it

[jira] [Created] (SPARK-3118) SHOW COLUMNS shows all the columns in a table including partition columns.

2014-08-18 Thread wangxiaojing (JIRA)
wangxiaojing created SPARK-3118: --- Summary: SHOW COLUMNS shows all the columns in a table including partition columns. Key: SPARK-3118 URL: https://issues.apache.org/jira/browse/SPARK-3118 Project:

[jira] [Updated] (SPARK-3118) SHOW COLUMNS shows all the columns in a table including partition columns.

2014-08-18 Thread wangxiaojing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxiaojing updated SPARK-3118: Description: The SHOW TBLPROPERTIES tblname; and SHOW COLUMNS (FROM|IN) table_name

[jira] [Updated] (SPARK-3118) add SHOW TBLPROPERTIES tblname; and SHOW COLUMNS (FROM|IN) table_name [(FROM|IN) db_name] support

2014-08-18 Thread wangxiaojing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxiaojing updated SPARK-3118: Summary: add SHOW TBLPROPERTIES tblname; and SHOW COLUMNS (FROM|IN) table_name [(FROM|IN) db_name]

[jira] [Updated] (SPARK-3110) Add a ha mode in YARN mode to keep executors in between restarts

2014-08-18 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-3110: Description: The idea is for long running processes like streaming, you'd want the AM to