[jira] [Created] (SPARK-3790) CosineSimilarity via DIMSUM example

2014-10-04 Thread Reza Zadeh (JIRA)
Reza Zadeh created SPARK-3790: - Summary: CosineSimilarity via DIMSUM example Key: SPARK-3790 URL: https://issues.apache.org/jira/browse/SPARK-3790 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3791) HiveThriftServer2 returns 0.12.0 to ODBC SQLGetInfo call

2014-10-04 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3791: - Summary: HiveThriftServer2 returns 0.12.0 to ODBC SQLGetInfo call Key: SPARK-3791 URL: https://issues.apache.org/jira/browse/SPARK-3791 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

2014-10-04 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159059#comment-14159059 ] Nishkam Ravi commented on SPARK-3633: - Quick update: reverting 4fde28c gets rid of the

[jira] [Created] (SPARK-3792) enable JavaHiveQLSuite

2014-10-04 Thread wangfei (JIRA)
wangfei created SPARK-3792: -- Summary: enable JavaHiveQLSuite Key: SPARK-3792 URL: https://issues.apache.org/jira/browse/SPARK-3792 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Commented] (SPARK-3792) enable JavaHiveQLSuite

2014-10-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159093#comment-14159093 ] Apache Spark commented on SPARK-3792: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-3773) Sphinx build warnings

2014-10-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159147#comment-14159147 ] Apache Spark commented on SPARK-3773: - User 'cocoatomo' has created a pull request for

[jira] [Created] (SPARK-3793) add para hiveconf when parse hive ql

2014-10-04 Thread wangfei (JIRA)
wangfei created SPARK-3793: -- Summary: add para hiveconf when parse hive ql Key: SPARK-3793 URL: https://issues.apache.org/jira/browse/SPARK-3793 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3793) use hiveconf when parse hive ql

2014-10-04 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-3793: --- Summary: use hiveconf when parse hive ql (was: add para hiveconf when parse hive ql) use hiveconf when

[jira] [Updated] (SPARK-3793) add para hiveconf when parse hive ql

2014-10-04 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-3793: --- Summary: add para hiveconf when parse hive ql (was: use hiveconf when parse hive ql) add para hiveconf

[jira] [Updated] (SPARK-3793) use hiveconf when parse hive ql

2014-10-04 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-3793: --- Summary: use hiveconf when parse hive ql (was: add para hiveconf when parse hive ql) use hiveconf when

[jira] [Commented] (SPARK-3793) use hiveconf when parse hive ql

2014-10-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159176#comment-14159176 ] Apache Spark commented on SPARK-3793: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-3794) Building spark core fails with specific hadoop version

2014-10-04 Thread cocoatomo (JIRA)
cocoatomo created SPARK-3794: Summary: Building spark core fails with specific hadoop version Key: SPARK-3794 URL: https://issues.apache.org/jira/browse/SPARK-3794 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3794) Building spark core fails with specific hadoop version

2014-10-04 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3794: - Description: At the commit cf1d32e3e1071829b152d4b597bf0a0d7a5629a2, building spark core result in

[jira] [Updated] (SPARK-3174) Provide elastic scaling within a Spark application

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3174: --- Summary: Provide elastic scaling within a Spark application (was: Under YARN, add and remove

[jira] [Commented] (SPARK-3174) Under YARN, add and remove executors based on load

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159250#comment-14159250 ] Patrick Wendell commented on SPARK-3174: Hey all - I'm going to restructure this

[jira] [Updated] (SPARK-3460) Under YARN, discard executors that have been idle

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3460: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-3174) Under YARN, discard

[jira] [Updated] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3464: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-3174) Graceful decommission

[jira] [Resolved] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3464. Resolution: Fixed Graceful decommission of executors --

[jira] [Created] (SPARK-3795) Provide scheduler hooks for adding and removing executors

2014-10-04 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3795: -- Summary: Provide scheduler hooks for adding and removing executors Key: SPARK-3795 URL: https://issues.apache.org/jira/browse/SPARK-3795 Project: Spark

[jira] [Commented] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159252#comment-14159252 ] Sandy Ryza commented on SPARK-3464: --- Did you mean to resolve this as Fixed? Graceful

[jira] [Created] (SPARK-3796) Provide shuffle service for external block storage

2014-10-04 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3796: -- Summary: Provide shuffle service for external block storage Key: SPARK-3796 URL: https://issues.apache.org/jira/browse/SPARK-3796 Project: Spark Issue

[jira] [Updated] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3795: --- Summary: Add scheduler hooks/heuristics for adding and removing executors (was: Provide

[jira] [Updated] (SPARK-3796) Create shuffle service for external block storage

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3796: --- Summary: Create shuffle service for external block storage (was: Provide shuffle service for

[jira] [Created] (SPARK-3797) Integrate shuffle service in YARN's pluggable shuffle

2014-10-04 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3797: -- Summary: Integrate shuffle service in YARN's pluggable shuffle Key: SPARK-3797 URL: https://issues.apache.org/jira/browse/SPARK-3797 Project: Spark

[jira] [Updated] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3795: --- Description: To support dynamic scaling of a Spark application, Spark's scheduler will need

[jira] [Updated] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3795: --- Description: To support dynamic scaling of a Spark application, Spark's scheduler will need

[jira] [Updated] (SPARK-3174) Provide elastic scaling within a Spark application

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3174: --- Component/s: (was: YARN) Provide elastic scaling within a Spark application

[jira] [Comment Edited] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159252#comment-14159252 ] Sandy Ryza edited comment on SPARK-3464 at 10/4/14 7:27 PM:

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159284#comment-14159284 ] Josh Rosen commented on SPARK-922: -- I chatted with someone who had a job that ran ~20x

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-922: - Fix Version/s: (was: 1.2.0) Update Spark AMI to Python 2.7 --

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-922: - Affects Version/s: 1.1.0 Update Spark AMI to Python 2.7 --

[jira] [Created] (SPARK-3798) Corrupted projection in Generator

2014-10-04 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-3798: --- Summary: Corrupted projection in Generator Key: SPARK-3798 URL: https://issues.apache.org/jira/browse/SPARK-3798 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3798) Corrupted projection in Generator

2014-10-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159294#comment-14159294 ] Apache Spark commented on SPARK-3798: - User 'marmbrus' has created a pull request for

[jira] [Updated] (SPARK-3794) Building spark core fails with specific hadoop version

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3794: --- Fix Version/s: (was: 1.2.0) Building spark core fails with specific hadoop version

[jira] [Created] (SPARK-3799) Enable String ID's for GraphX

2014-10-04 Thread Andrew Fitzgerald (JIRA)
Andrew Fitzgerald created SPARK-3799: Summary: Enable String ID's for GraphX Key: SPARK-3799 URL: https://issues.apache.org/jira/browse/SPARK-3799 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3794) Building spark core fails with specific hadoop version

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159330#comment-14159330 ] Patrick Wendell commented on SPARK-3794: Are you trying to build from within the

[jira] [Reopened] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-3464: Graceful decommission of executors -- Key:

[jira] [Resolved] (SPARK-3464) Graceful decommission of executors

2014-10-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3464. Resolution: Invalid This is going to be subsumed by a separate JIRA. Graceful

[jira] [Commented] (SPARK-1860) Standalone Worker cleanup should not clean up running executors

2014-10-04 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159343#comment-14159343 ] Aaron Davidson commented on SPARK-1860: --- Agreed, that sounds good. Would you or

[jira] [Commented] (SPARK-3794) Building spark core fails with specific hadoop version

2014-10-04 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159384#comment-14159384 ] cocoatomo commented on SPARK-3794: -- Thank you for the comment. Building from the root

[jira] [Created] (SPARK-3800) BindingException when grouping on nested fields

2014-10-04 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-3800: --- Summary: BindingException when grouping on nested fields Key: SPARK-3800 URL: https://issues.apache.org/jira/browse/SPARK-3800 Project: Spark Issue

[jira] [Commented] (SPARK-3800) BindingException when grouping on nested fields

2014-10-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159413#comment-14159413 ] Apache Spark commented on SPARK-3800: - User 'marmbrus' has created a pull request for