[jira] [Commented] (SPARK-6325) YarnAllocator crash with dynamic allocation on

[ https://issues.apache.org/jira/browse/SPARK-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360894#comment-14360894 ] Wing Yew Poon commented on SPARK-6325: -- The testcase actually came from a similar

[jira] [Assigned] (SPARK-3735) Sending the factor directly or AtA based on the cost in ALS

[ https://issues.apache.org/jira/browse/SPARK-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-3735: Assignee: Xiangrui Meng Sending the factor directly or AtA based on the cost in ALS

[jira] [Updated] (SPARK-6324) Clean up usage code in command-line scripts

[ https://issues.apache.org/jira/browse/SPARK-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-6324: -- Description: With SPARK-4924, most of the logic to launch Spark classes is in a new Java

[jira] [Updated] (SPARK-4704) SparkSubmitDriverBootstrap doesn't flush output

[ https://issues.apache.org/jira/browse/SPARK-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4704: - Labels: (was: backport-needed) SparkSubmitDriverBootstrap doesn't flush output

[jira] [Resolved] (SPARK-6087) Provide actionable exception if Kryo buffer is not large enough

[ https://issues.apache.org/jira/browse/SPARK-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6087. -- Resolution: Fixed Fix Version/s: 1.3.1 Target Version/s: (was: 1.4.0, 1.3.1)

[jira] [Updated] (SPARK-6087) Provide actionable exception if Kryo buffer is not large enough

[ https://issues.apache.org/jira/browse/SPARK-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6087: - Labels: starter (was: backport-needed starter) Provide actionable exception if Kryo buffer is not large

[jira] [Resolved] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6133. -- Resolution: Fixed Fix Version/s: 1.3.1 SparkContext#stop is not idempotent

[jira] [Updated] (SPARK-6326) Improve castStruct to be faster

[ https://issues.apache.org/jira/browse/SPARK-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-6326: --- Summary: Improve castStruct to be faster (was: Make castStruct faster) Improve castStruct

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360937#comment-14360937 ] Iulian Dragos commented on SPARK-6285: -- Thanks, [~lian cheng] Duplicated code leads

[jira] [Updated] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4964: --- Assignee: Cody Koeninger Exactly-once + WAL-free Kafka Support in Spark Streaming

[jira] [Resolved] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4300. -- Resolution: Fixed Fix Version/s: 1.3.1 Target Version/s: (was: 1.3.0, 1.2.2, 1.4.0)

[jira] [Updated] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4300: - Labels: (was: backport-needed) Race condition during SparkWorker shutdown

[jira] [Commented] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360956#comment-14360956 ] Debasish Das commented on SPARK-6323: - g(z) is not regularization...we support

[jira] [Updated] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6288: - Attachment: Screen Shot 2015-03-13 at 10.45.35 AM.png Attached a screenshot of YourKit profiling

[jira] [Updated] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6133: - Labels: (was: backport-needed) SparkContext#stop is not idempotent

[jira] [Commented] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360883#comment-14360883 ] Xiangrui Meng commented on SPARK-6288: -- Yes, `memo` is a private variable. I sent a

[jira] [Comment Edited] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360679#comment-14360679 ] Xiangrui Meng edited comment on SPARK-6323 at 3/13/15 5:13 PM:

[jira] [Created] (SPARK-6324) Clean up usage code in command-line scripts

Marcelo Vanzin created SPARK-6324: - Summary: Clean up usage code in command-line scripts Key: SPARK-6324 URL: https://issues.apache.org/jira/browse/SPARK-6324 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360784#comment-14360784 ] Xiangrui Meng commented on SPARK-6288: -- [~joshrosen] The memoLookup cost is actually

[jira] [Commented] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360799#comment-14360799 ] Josh Rosen commented on SPARK-6288: --- Do we have to modify Pyrolite in order to disable

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6132: - Fix Version/s: 1.3.1 Also in 1.3.1 now; Andrew mentioned he'd like to back-port after seeing how this

[jira] [Updated] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6275: - Fix Version/s: 1.3.1 Miss toDF() function in docs/sql-programming-guide.md

[jira] [Resolved] (SPARK-4600) org.apache.spark.graphx.VertexRDD.diff does not work

[ https://issues.apache.org/jira/browse/SPARK-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4600. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5015

[jira] [Commented] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360679#comment-14360679 ] Xiangrui Meng commented on SPARK-6323: -- [~debasish83] Please help me understand some

[jira] [Updated] (SPARK-6278) Mention the change of step size in the migration guide

[ https://issues.apache.org/jira/browse/SPARK-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6278: - Fix Version/s: 1.4.0 Mention the change of step size in the migration guide

[jira] [Resolved] (SPARK-4704) SparkSubmitDriverBootstrap doesn't flush output

[ https://issues.apache.org/jira/browse/SPARK-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4704. -- Resolution: Fixed Fix Version/s: 1.3.1 Target Version/s: (was: 1.2.2, 1.4.0, 1.3.1)

[jira] [Updated] (SPARK-6194) collect() in PySpark will cause memory leak in JVM

[ https://issues.apache.org/jira/browse/SPARK-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6194: -- Fix Version/s: 1.3.1 1.4.0 1.2.2 I've merged this into `master`

[jira] [Created] (SPARK-6325) YarnAllocator crash with dynamic allocation on

Marcelo Vanzin created SPARK-6325: - Summary: YarnAllocator crash with dynamic allocation on Key: SPARK-6325 URL: https://issues.apache.org/jira/browse/SPARK-6325 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-6036) EventLog process logic has race condition with Akka actor system

[ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6036. -- Resolution: Fixed Fix Version/s: 1.3.1 Target Version/s: (was: 1.4.0, 1.3.1)

[jira] [Updated] (SPARK-6036) EventLog process logic has race condition with Akka actor system

[ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6036: - Labels: (was: backport-needed) EventLog process logic has race condition with Akka actor system

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360842#comment-14360842 ] Josh Rosen commented on SPARK-6313: --- Could you update this ticket with more details on

[jira] [Created] (SPARK-6326) Make castStruct faster

Liang-Chi Hsieh created SPARK-6326: -- Summary: Make castStruct faster Key: SPARK-6326 URL: https://issues.apache.org/jira/browse/SPARK-6326 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4600) org.apache.spark.graphx.VertexRDD.diff does not work

[ https://issues.apache.org/jira/browse/SPARK-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4600: - Component/s: Documentation Priority: Minor (was: Major) Issue Type: Improvement (was: Bug)

[jira] [Resolved] (SPARK-6278) Mention the change of step size in the migration guide

[ https://issues.apache.org/jira/browse/SPARK-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6278. -- Resolution: Fixed Fix Version/s: 1.3.1 Issue resolved by pull request 4978

[jira] [Resolved] (SPARK-6252) Scala NaiveBayes should expose getLambda

[ https://issues.apache.org/jira/browse/SPARK-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6252. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4969

[jira] [Commented] (SPARK-4044) Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

[ https://issues.apache.org/jira/browse/SPARK-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360816#comment-14360816 ] Sean Owen commented on SPARK-4044: -- Note that this is also fixed, by being obsoleted, in

[jira] [Resolved] (SPARK-4044) Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

[ https://issues.apache.org/jira/browse/SPARK-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4044. -- Resolution: Fixed Fix Version/s: 1.3.1 Issue resolved by pull request 4981

[jira] [Commented] (SPARK-6229) Support encryption in network/common module

[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360808#comment-14360808 ] Aaron Davidson commented on SPARK-6229: --- The reason we did not originally put the

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360896#comment-14360896 ] Josh Rosen commented on SPARK-6313: --- Thanks for the pointer to the Lucene lock factory

[jira] [Commented] (SPARK-6325) YarnAllocator crash with dynamic allocation on

[ https://issues.apache.org/jira/browse/SPARK-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360898#comment-14360898 ] Apache Spark commented on SPARK-6325: - User 'vanzin' has created a pull request for

[jira] [Comment Edited] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361005#comment-14361005 ] Debasish Das edited comment on SPARK-6323 at 3/13/15 7:48 PM: --

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361030#comment-14361030 ] Davies Liu commented on SPARK-6282: --- [~laskov] The following code runs fine here (master

[jira] [Commented] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361037#comment-14361037 ] Xiangrui Meng commented on SPARK-6288: -- Test the following code: {code} from

[jira] [Created] (SPARK-6328) Python API for StreamingListener

Yifan Wang created SPARK-6328: - Summary: Python API for StreamingListener Key: SPARK-6328 URL: https://issues.apache.org/jira/browse/SPARK-6328 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6330) newParquetRelation gets incorrect FileSystem

[ https://issues.apache.org/jira/browse/SPARK-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361168#comment-14361168 ] Apache Spark commented on SPARK-6330: - User 'vlyubin' has created a pull request for

[jira] [Created] (SPARK-6331) New Spark Master URL is not picked up when streaming context is started from checkpoint

Tathagata Das created SPARK-6331: Summary: New Spark Master URL is not picked up when streaming context is started from checkpoint Key: SPARK-6331 URL: https://issues.apache.org/jira/browse/SPARK-6331

[jira] [Commented] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361005#comment-14361005 ] Debasish Das commented on SPARK-6323: - There are some other interesting cases for

[jira] [Created] (SPARK-6327) Run PySpark with python directly is broken

Davies Liu created SPARK-6327: - Summary: Run PySpark with python directly is broken Key: SPARK-6327 URL: https://issues.apache.org/jira/browse/SPARK-6327 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6330) newParquetRelation gets incorrect FileSystem

Volodymyr Lyubinets created SPARK-6330: -- Summary: newParquetRelation gets incorrect FileSystem Key: SPARK-6330 URL: https://issues.apache.org/jira/browse/SPARK-6330 Project: Spark Issue

[jira] [Commented] (SPARK-6327) Run PySpark with python directly is broken

[ https://issues.apache.org/jira/browse/SPARK-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361104#comment-14361104 ] Apache Spark commented on SPARK-6327: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-6329) Minor doc changes for Mesos and TOC

Brennon York created SPARK-6329: --- Summary: Minor doc changes for Mesos and TOC Key: SPARK-6329 URL: https://issues.apache.org/jira/browse/SPARK-6329 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6317. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5011

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6317: -- Description: {{build/sbt hive/console}} is failing {noformat} [info] Starting scala interpreter...

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6317: -- Description: {{build/sbt hive/console}} is failing {noformat{ [info] Starting scala interpreter...

[jira] [Updated] (SPARK-6315) SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6315: Target Version/s: 1.3.1 (was: 1.3.0) SparkSQL 1.3.0 (RC3) fails to read parquet file

[jira] [Created] (SPARK-6332) cmpute calibration curve for binary classifiers

Robert Dodier created SPARK-6332: Summary: cmpute calibration curve for binary classifiers Key: SPARK-6332 URL: https://issues.apache.org/jira/browse/SPARK-6332 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361518#comment-14361518 ] Apache Spark commented on SPARK-6332: - User 'robert-dodier' has created a pull request

[jira] [Commented] (SPARK-4819) Remove Guava's Optional from public API

[ https://issues.apache.org/jira/browse/SPARK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361558#comment-14361558 ] Marcelo Vanzin commented on SPARK-4819: --- Java 8 has {{java.lang.Optional}} which

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361525#comment-14361525 ] Robert Dodier commented on SPARK-6332: -- I've opened a PR for this:

[jira] [Commented] (SPARK-6331) New Spark Master URL is not picked up when streaming context is started from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361501#comment-14361501 ] Apache Spark commented on SPARK-6331: - User 'tdas' has created a pull request for this

[jira] [Updated] (SPARK-6332) compute calibration curve for binary classifiers

[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dodier updated SPARK-6332: - Summary: compute calibration curve for binary classifiers (was: cmpute calibration curve for

[jira] [Created] (SPARK-6333) saveAsObjectFile support for compression codec

Deenar Toraskar created SPARK-6333: -- Summary: saveAsObjectFile support for compression codec Key: SPARK-6333 URL: https://issues.apache.org/jira/browse/SPARK-6333 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1363) Add streaming support for Spark SQL module

[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dai updated SPARK-1363: - Assignee: Saisai Shao Add streaming support for Spark SQL module

[jira] [Resolved] (SPARK-3643) Add cluster-specific config settings to configuration page

[ https://issues.apache.org/jira/browse/SPARK-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3643. -- Resolution: Fixed I know this is a little aggressive, but if the suggestion is to duplicate all of the

[jira] [Commented] (SPARK-1301) Add UI elements to collapse Aggregated Metrics by Executor pane on stage page

[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361204#comment-14361204 ] Apache Spark commented on SPARK-1301: - User 'shankervalipireddy' has created a pull

[jira] [Resolved] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6285. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5010

[jira] [Commented] (SPARK-5790) VertexRDD's won't zip properly for `diff` capability

[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361319#comment-14361319 ] Apache Spark commented on SPARK-5790: - User 'brennonyork' has created a pull request

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6317: - Assignee: Vinod KC Interactive HIVE scala console is not starting

[jira] [Commented] (SPARK-6279) Miss expressions flag s at logging string

[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360013#comment-14360013 ] zzc commented on SPARK-6279: [~srowen], I am new to Spark and JIRA, Sorry for this Miss

[jira] [Commented] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360012#comment-14360012 ] zzc commented on SPARK-6275: [~srowen], I am new to Spark and JIRA, Sorry for this Miss

[jira] [Reopened] (SPARK-6145) ORDER BY fails to resolve nested fields

[ https://issues.apache.org/jira/browse/SPARK-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-6145: - Assignee: Michael Armbrust ORDER BY fails to resolve nested fields

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6313: --- Priority: Critical (was: Major) Fetch File Lock file creation doesnt work when Spark

[jira] [Updated] (SPARK-6316) add a parameter for SparkContext(conf).textFile() method , support for multi-language hdfs file , e.g. gbk

[ https://issues.apache.org/jira/browse/SPARK-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunzhi.lyz updated SPARK-6316: -- Description: add a parameter for SparkContext(conf).textFile() method , support for

[jira] [Commented] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360050#comment-14360050 ] saurabh bansal commented on SPARK-6273: --- there's a similar jira that is in resolved

[jira] [Created] (SPARK-6316) add a parameter for SparkContext(conf).textFile() method , support for multi-language hdfs file , e.g. gbk

yunzhi.lyz created SPARK-6316: - Summary: add a parameter for SparkContext(conf).textFile() method , support for multi-language hdfs file , e.g. gbk Key: SPARK-6316 URL:

[jira] [Created] (SPARK-6314) Failed to load application log data from FileStatus

zzc created SPARK-6314: -- Summary: Failed to load application log data from FileStatus Key: SPARK-6314 URL: https://issues.apache.org/jira/browse/SPARK-6314 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6315) SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1

Michael Armbrust created SPARK-6315: --- Summary: SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1 Key: SPARK-6315 URL: https://issues.apache.org/jira/browse/SPARK-6315 Project:

[jira] [Resolved] (SPARK-6316) add a parameter for SparkContext(conf).textFile() method , support for multi-language hdfs file , e.g. gbk

[ https://issues.apache.org/jira/browse/SPARK-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6316. -- Resolution: Duplicate add a parameter for SparkContext(conf).textFile() method , support for

[jira] [Commented] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360127#comment-14360127 ] Sean Owen commented on SPARK-6273: -- Yes, if it's really the same underlying cause, then

[jira] [Assigned] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6285: - Assignee: Cheng Lian Duplicated code leads to errors ---

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360147#comment-14360147 ] Cheng Lian commented on SPARK-6285: --- [~fiberit] and [~srowen], thanks for reporting

[jira] [Commented] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360073#comment-14360073 ] Apache Spark commented on SPARK-6113: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360142#comment-14360142 ] Apache Spark commented on SPARK-6285: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360105#comment-14360105 ] Pavel Laskov commented on SPARK-6282: - Hi Nicholas, I am using the local driver to

[jira] [Created] (SPARK-6317) Interactive HIVE scala console is not starting

Vinod KC created SPARK-6317: --- Summary: Interactive HIVE scala console is not starting Key: SPARK-6317 URL: https://issues.apache.org/jira/browse/SPARK-6317 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6319) DISTINCT doesn't work for binary type

Cheng Lian created SPARK-6319: - Summary: DISTINCT doesn't work for binary type Key: SPARK-6319 URL: https://issues.apache.org/jira/browse/SPARK-6319 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6307) Executers fetches the same rdd-block 100's or 1000's of times

[ https://issues.apache.org/jira/browse/SPARK-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Bertelsen updated SPARK-6307: Affects Version/s: 1.2.0 Executers fetches the same rdd-block 100's or 1000's of times

[jira] [Updated] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4820: - Priority: Minor (was: Major) Yes, it is not resolved. I am not sure it is worth modifying the build for

[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360443#comment-14360443 ] Óscar Puertas commented on SPARK-4820: -- I see, but I have no an encrypted file system

[jira] [Updated] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5281: -- Description: Application crashes on this line {{rdd.registerTempTable(temp)}} in 1.2 version when

[jira] [Commented] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360301#comment-14360301 ] raju patel commented on SPARK-6301: --- I am attaching a sample program that to demostrate

[jira] [Created] (SPARK-6320) Extending SparkSQL Strategy

Youssef Hatem created SPARK-6320: Summary: Extending SparkSQL Strategy Key: SPARK-6320 URL: https://issues.apache.org/jira/browse/SPARK-6320 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360301#comment-14360301 ] raju patel edited comment on SPARK-6301 at 3/13/15 1:02 PM: I

[jira] [Resolved] (SPARK-6314) Failed to load application log data from FileStatus

[ https://issues.apache.org/jira/browse/SPARK-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6314. -- Resolution: Duplicate Failed to load application log data from FileStatus

[jira] [Commented] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360254#comment-14360254 ] Apache Spark commented on SPARK-6317: - User 'vinodkc' has created a pull request for

[jira] [Comment Edited] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360301#comment-14360301 ] raju patel edited comment on SPARK-6301 at 3/13/15 1:05 PM: I

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6317: - Priority: Major (was: Blocker) (Let's reserve Blocker for confirmed issues that committers have decided

[jira] [Commented] (SPARK-6307) Executers fetches the same rdd-block 100's or 1000's of times

[ https://issues.apache.org/jira/browse/SPARK-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360311#comment-14360311 ] Tobias Bertelsen commented on SPARK-6307: - Meant 1.2.0 sorry. Thanks for adding

[jira] [Resolved] (SPARK-5845) Time to cleanup spilled shuffle files not included in shuffle write time

[ https://issues.apache.org/jira/browse/SPARK-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5845. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4965

[jira] [Comment Edited] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360301#comment-14360301 ] raju patel edited comment on SPARK-6301 at 3/13/15 1:05 PM: I

  1   2   >