[jira] [Resolved] (SPARK-4108) Fix uses of @deprecated in catalyst dataTypes

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4108. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2970

[jira] [Commented] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-10-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191457#comment-14191457 ] Patrick Wendell commented on SPARK-4079: Yeah that sounds like a good call. Did

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191459#comment-14191459 ] Xiangrui Meng commented on SPARK-3987: -- Please check the condition number of the

[jira] [Updated] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-10-31 Thread Jarred Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarred Li updated SPARK-4164: - Remaining Estimate: 2h Original Estimate: 2h spark.kryo.registrator shall use comma separated value

[jira] [Commented] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-10-31 Thread Jarred Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191475#comment-14191475 ] Jarred Li commented on SPARK-4164: -- I can work on this issue. Could somebody assign this

[jira] [Created] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

2014-10-31 Thread Shiti Saxena (JIRA)
Shiti Saxena created SPARK-4165: --- Summary: Actor with Companion throws ambiguous reference error in REPL Key: SPARK-4165 URL: https://issues.apache.org/jira/browse/SPARK-4165 Project: Spark

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191502#comment-14191502 ] Debasish Das commented on SPARK-3987: - Nope...standard ALS...same as netflix

[jira] [Created] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

2014-10-31 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-4166: --- Summary: Display the executor ID in the Web UI when ExecutorLostFailure happens Key: SPARK-4166 URL: https://issues.apache.org/jira/browse/SPARK-4166 Project: Spark

[jira] [Resolved] (SPARK-4143) Move inner class DeferredObjectAdapter to top level

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4143. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3007

[jira] [Created] (SPARK-4167) Schedule task on Executor will be Imbalance while task run less than local-wait time

2014-10-31 Thread SuYan (JIRA)
SuYan created SPARK-4167: Summary: Schedule task on Executor will be Imbalance while task run less than local-wait time Key: SPARK-4167 URL: https://issues.apache.org/jira/browse/SPARK-4167 Project: Spark

[jira] [Commented] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191519#comment-14191519 ] Apache Spark commented on SPARK-4166: - User 'zsxwing' has created a pull request for

[jira] [Updated] (SPARK-4167) Schedule task on Executor will be Imbalance while task run less than local-wait time

2014-10-31 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-4167: - Description: Recently, when run a spark on yarn job. it occurs executor schedules imbalance. the procedure is

[jira] [Updated] (SPARK-4167) Schedule task on Executor will be Imbalance while task run less than local-wait time

2014-10-31 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-4167: - Description: Recently, when run a spark on yarn job. it occurs executor schedules imbalance. the procedure is

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191551#comment-14191551 ] Debasish Das commented on SPARK-2426: - [~mengxr] The matlab comparison scripts are

[jira] [Comment Edited] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191551#comment-14191551 ] Debasish Das edited comment on SPARK-2426 at 10/31/14 8:04 AM:

[jira] [Resolved] (SPARK-4162) Make scripts symlinkable

2014-10-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4162. -- Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/SPARK-3482 and

[jira] [Closed] (SPARK-4167) Schedule task on Executor will be Imbalance while task run less than local-wait time

2014-10-31 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan closed SPARK-4167. Resolution: Not a Problem Schedule task on Executor will be Imbalance while task run less than local-wait time

[jira] [Created] (SPARK-4168) Completed Stages Number are misleading webUI when stages are more than 1000

2014-10-31 Thread Zhang, Liye (JIRA)
Zhang, Liye created SPARK-4168: -- Summary: Completed Stages Number are misleading webUI when stages are more than 1000 Key: SPARK-4168 URL: https://issues.apache.org/jira/browse/SPARK-4168 Project: Spark

[jira] [Commented] (SPARK-4168) Completed Stages Number are misleading webUI when stages are more than 1000

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191643#comment-14191643 ] Apache Spark commented on SPARK-4168: - User 'liyezhang556520' has created a pull

[jira] [Created] (SPARK-4169) [Core] Locale dependent code

2014-10-31 Thread Niklas Wilcke (JIRA)
Niklas Wilcke created SPARK-4169: Summary: [Core] Locale dependent code Key: SPARK-4169 URL: https://issues.apache.org/jira/browse/SPARK-4169 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4170) Closure problems when running Scala app that extends App

2014-10-31 Thread Sean Owen (JIRA)
Sean Owen created SPARK-4170: Summary: Closure problems when running Scala app that extends App Key: SPARK-4170 URL: https://issues.apache.org/jira/browse/SPARK-4170 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4169) [Core] Locale dependent code

2014-10-31 Thread Niklas Wilcke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niklas Wilcke updated SPARK-4169: - Description: With a non english locale the method isBindCollision in

[jira] [Updated] (SPARK-4169) [Core] Locale dependent code

2014-10-31 Thread Niklas Wilcke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niklas Wilcke updated SPARK-4169: - Labels: patch test (was: ) [Core] Locale dependent code

[jira] [Commented] (SPARK-4169) [Core] Locale dependent code

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191700#comment-14191700 ] Apache Spark commented on SPARK-4169: - User 'numbnut' has created a pull request for

[jira] [Updated] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4165: Affects Version/s: 1.2.0 1.0.1 1.1.0 Actor with

[jira] [Created] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
Shiti Saxena created SPARK-4171: --- Summary: StreamingContext.actorStream throws serializationError Key: SPARK-4171 URL: https://issues.apache.org/jira/browse/SPARK-4171 Project: Spark Issue

[jira] [Updated] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4171: Description: I encountered this issue when StreamingContext.actorStream throws serializationError

[jira] [Updated] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4171: Description: I encountered this issue when I was working on

[jira] [Updated] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4171: Description: I encountered this issue when I was working on

[jira] [Commented] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191736#comment-14191736 ] Shiti Saxena commented on SPARK-4171: - After applying the patch from

[jira] [Updated] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-10-31 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4171: Description: I encountered this issue when I was working on

[jira] [Commented] (SPARK-3183) Add option for requesting full YARN cluster

2014-10-31 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191781#comment-14191781 ] Gen TANG commented on SPARK-3183: - The same workaround for --num-executors. For the

[jira] [Resolved] (SPARK-3780) YarnAllocator should look at the container completed diagnostic message

2014-10-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-3780. -- Resolution: Fixed Fix Version/s: 1.2.0 YarnAllocator should look at the container

[jira] [Commented] (SPARK-2220) Fix remaining Hive Commands

2014-10-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191841#comment-14191841 ] Cheng Lian commented on SPARK-2220: --- It turned out that {{ShellCommand}} and

[jira] [Commented] (SPARK-2220) Fix remaining Hive Commands

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191873#comment-14191873 ] Apache Spark commented on SPARK-2220: - User 'liancheng' has created a pull request for

[jira] [Comment Edited] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095232#comment-14095232 ] Debasish Das edited comment on SPARK-2426 at 10/31/14 4:20 PM:

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191997#comment-14191997 ] Debasish Das commented on SPARK-2426: - Matlab comparisons of MOSEK, ECOS, PDCO and

[jira] [Commented] (SPARK-4080) IOException: unexpected exception type while deserializing tasks

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192005#comment-14192005 ] Josh Rosen commented on SPARK-4080: --- Hi [~kul], Thanks for trying this out! I'm glad

[jira] [Commented] (SPARK-2189) Method for removing temp tables created by registerAsTable

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192084#comment-14192084 ] Apache Spark commented on SPARK-2189: - User 'liancheng' has created a pull request for

[jira] [Created] (SPARK-4172) Progress API in Python

2014-10-31 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4172: - Summary: Progress API in Python Key: SPARK-4172 URL: https://issues.apache.org/jira/browse/SPARK-4172 Project: Spark Issue Type: New Feature Components:

[jira] [Commented] (SPARK-4172) Progress API in Python

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192106#comment-14192106 ] Apache Spark commented on SPARK-4172: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-4016) Allow user to optionally show additional, advanced metrics in the UI

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4016. --- Resolution: Fixed Issue resolved by pull request 2867 [https://github.com/apache/spark/pull/2867]

[jira] [Updated] (SPARK-4141) Hide Accumulators column on stage page when no accumulators exist

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4141: -- Assignee: (was: Josh Rosen) Hide Accumulators column on stage page when no accumulators exist

[jira] [Assigned] (SPARK-4141) Hide Accumulators column on stage page when no accumulators exist

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4141: - Assignee: Josh Rosen Hide Accumulators column on stage page when no accumulators exist

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-31 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192165#comment-14192165 ] Shuo Xiang commented on SPARK-3987: --- [~debasish83][~mengxr] The condition number for the

[jira] [Commented] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-10-31 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192188#comment-14192188 ] Kostas Sakellis commented on SPARK-4079: yes, I'm taking this over from Marcelo.

[jira] [Resolved] (SPARK-3826) Support JDBC/ODBC server with Hive 0.13.1

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3826. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2685

[jira] [Resolved] (SPARK-4077) A broken string timestamp value can Spark SQL return wrong values for valid string timestamp values

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4077. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3019

[jira] [Resolved] (SPARK-4154) Query does not work if it has not between in Spark SQL and HQL

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4154. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3017

[jira] [Resolved] (SPARK-2220) Fix remaining Hive Commands

2014-10-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2220. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3038

[jira] [Created] (SPARK-4173) EdgePartitionBuilder uses wrong value for first clustered index

2014-10-31 Thread Ankur Dave (JIRA)
Ankur Dave created SPARK-4173: - Summary: EdgePartitionBuilder uses wrong value for first clustered index Key: SPARK-4173 URL: https://issues.apache.org/jira/browse/SPARK-4173 Project: Spark

[jira] [Resolved] (SPARK-4141) Hide Accumulators column on stage page when no accumulators exist

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4141. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3031

[jira] [Created] (SPARK-4174) Optionally provide notifications to Receivers when DStream has been generated

2014-10-31 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-4174: --- Summary: Optionally provide notifications to Receivers when DStream has been generated Key: SPARK-4174 URL: https://issues.apache.org/jira/browse/SPARK-4174

[jira] [Updated] (SPARK-4174) Streaming: Optionally provide notifications to Receivers when DStream has been generated

2014-10-31 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-4174: Summary: Streaming: Optionally provide notifications to Receivers when DStream has been

[jira] [Updated] (SPARK-4174) Streaming: Optionally provide notifications to Receivers when DStream has been generated

2014-10-31 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-4174: Issue Type: Improvement (was: Bug) Streaming: Optionally provide notifications to

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2014-10-31 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192273#comment-14192273 ] Nicholas Chammas commented on SPARK-3821: - Hey folks, I was hoping to post a

[jira] [Resolved] (SPARK-4150) rdd.setName returns None in PySpark

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4150. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3011

[jira] [Commented] (SPARK-1267) Add a pip installer for PySpark

2014-10-31 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192279#comment-14192279 ] Davies Liu commented on SPARK-1267: --- Because PySpark depends on Spark packages, Python

[jira] [Resolved] (SPARK-3870) EOL character enforcement

2014-10-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3870. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2726

[jira] [Commented] (SPARK-3640) KinesisUtils should accept a credentials object instead of forcing DefaultCredentialsProvider

2014-10-31 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192411#comment-14192411 ] Chris Fregly commented on SPARK-3640: - Agreed that this was no ideal when i first

[jira] [Commented] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-10-31 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192448#comment-14192448 ] RJ Nowling commented on SPARK-4158: --- I verified that the associated patch fixes this

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192491#comment-14192491 ] Zhijie Shen commented on SPARK-1537: bq. BTW, if you want a list of things I think are

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192502#comment-14192502 ] Marcelo Vanzin commented on SPARK-1537: --- bq. This is proposed to improve the Java

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192538#comment-14192538 ] Zhijie Shen commented on SPARK-1537: bq. Spark needs both to put and read data It's

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192561#comment-14192561 ] Marcelo Vanzin commented on SPARK-1537: --- bq. It's again a vague statement. I don't

[jira] [Created] (SPARK-4175) Exception on stage page

2014-10-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-4175: - Summary: Exception on stage page Key: SPARK-4175 URL: https://issues.apache.org/jira/browse/SPARK-4175 Project: Spark Issue Type: Bug Affects Versions: 1.2.0

[jira] [Commented] (SPARK-4016) Allow user to optionally show additional, advanced metrics in the UI

2014-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192604#comment-14192604 ] Sandy Ryza commented on SPARK-4016: --- It looks like after this change, stage-level

[jira] [Commented] (SPARK-4016) Allow user to optionally show additional, advanced metrics in the UI

2014-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192609#comment-14192609 ] Sandy Ryza commented on SPARK-4016: --- Also, it looks like this can cause an exception:

[jira] [Commented] (SPARK-4175) Exception on stage page

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192608#comment-14192608 ] Apache Spark commented on SPARK-4175: - User 'sryza' has created a pull request for

[jira] [Updated] (SPARK-3561) Allow for pluggable execution contexts in Spark

2014-10-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3561: - Fix Version/s: (was: 1.2.0) Allow for pluggable execution contexts in Spark

[jira] [Commented] (SPARK-4016) Allow user to optionally show additional, advanced metrics in the UI

2014-10-31 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192653#comment-14192653 ] Kay Ousterhout commented on SPARK-4016: --- [~sandyr] definitely not intentional to

[jira] [Commented] (SPARK-4016) Allow user to optionally show additional, advanced metrics in the UI

2014-10-31 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192655#comment-14192655 ] Kay Ousterhout commented on SPARK-4016: --- (I think the summary table was always for

[jira] [Created] (SPARK-4176) Support decimals with precision 18 in Parquet

2014-10-31 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-4176: Summary: Support decimals with precision 18 in Parquet Key: SPARK-4176 URL: https://issues.apache.org/jira/browse/SPARK-4176 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-3652) upgrade spark sql hive version to 0.13.1

2014-10-31 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei resolved SPARK-3652. Resolution: Fixed upgrade spark sql hive version to 0.13.1

[jira] [Commented] (SPARK-3322) ConnectionManager logs an error when the application ends

2014-10-31 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192701#comment-14192701 ] wangfei commented on SPARK-3322: yes, to close this. ConnectionManager logs an error

[jira] [Closed] (SPARK-2460) Optimize SparkContext.hadoopFile api

2014-10-31 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei closed SPARK-2460. -- Resolution: Fixed Optimize SparkContext.hadoopFile api -

[jira] [Created] (SPARK-4177) update build doc for JDBC/CLI already supporting hive 13

2014-10-31 Thread wangfei (JIRA)
wangfei created SPARK-4177: -- Summary: update build doc for JDBC/CLI already supporting hive 13 Key: SPARK-4177 URL: https://issues.apache.org/jira/browse/SPARK-4177 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4177) update build doc for already supporting hive 13 in jdbc/cli

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192707#comment-14192707 ] Apache Spark commented on SPARK-4177: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-3974) Block matrix abstracitons and partitioners

2014-10-31 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192731#comment-14192731 ] Burak Yavuz commented on SPARK-3974: Hi everyone, The design doc for Block Matrix

[jira] [Created] (SPARK-4178) Hadoop input metrics ignore bytes read in RecordReader instantiation

2014-10-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-4178: - Summary: Hadoop input metrics ignore bytes read in RecordReader instantiation Key: SPARK-4178 URL: https://issues.apache.org/jira/browse/SPARK-4178 Project: Spark

[jira] [Commented] (SPARK-4178) Hadoop input metrics ignore bytes read in RecordReader instantiation

2014-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192773#comment-14192773 ] Sandy Ryza commented on SPARK-4178: --- Thanks [~kostas] for noticing this. Hadoop input

[jira] [Commented] (SPARK-4178) Hadoop input metrics ignore bytes read in RecordReader instantiation

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192775#comment-14192775 ] Apache Spark commented on SPARK-4178: - User 'sryza' has created a pull request for

[jira] [Resolved] (SPARK-4175) Exception on stage page

2014-10-31 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-4175. --- Resolution: Fixed Fix Version/s: 1.2.0 Exception on stage page

[jira] [Resolved] (SPARK-2329) Add multi-label evaluation metrics

2014-10-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2329. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 1270

[jira] [Resolved] (SPARK-3838) Python code example for Word2Vec in user guide

2014-10-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3838. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2952

[jira] [Resolved] (SPARK-1547) Add gradient boosting algorithm to MLlib

2014-10-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1547. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2607

[jira] [Updated] (SPARK-4127) Streaming Linear Regression- Python bindings

2014-10-31 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4127: --- Summary: Streaming Linear Regression- Python bindings (was: Streaming Linear

[jira] [Commented] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192931#comment-14192931 ] Apache Spark commented on SPARK-3787: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-31 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192935#comment-14192935 ] Debasish Das commented on SPARK-2426: - Refactored QuadraticMinimizer and NNLS from

[jira] [Resolved] (SPARK-3254) Streaming K-Means

2014-10-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3254. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2942

[jira] [Resolved] (SPARK-1847) Pushdown filters on non-required parquet columns

2014-10-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1847. -- Resolution: Fixed Fix Version/s: 1.2.0 Pushdown filters on non-required parquet columns

[jira] [Updated] (SPARK-3968) Use parquet-mr filter2 api in spark sql

2014-10-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3968: - Assignee: Yash Datta Use parquet-mr filter2 api in spark sql

[jira] [Updated] (SPARK-1847) Pushdown filters on non-required parquet columns

2014-10-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1847: - Assignee: Yash Datta Pushdown filters on non-required parquet columns