[jira] [Created] (SPARK-3399) Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR

Kousuke Saruta created SPARK-3399: - Summary: Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR Key: SPARK-3399 URL: https://issues.apache.org/jira/browse/SPARK-3399 Project: Spark

[jira] [Commented] (SPARK-3399) Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR

[ https://issues.apache.org/jira/browse/SPARK-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121016#comment-14121016 ] Apache Spark commented on SPARK-3399: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3400) GraphX unit tests fail nondeterministically

Ankur Dave created SPARK-3400: - Summary: GraphX unit tests fail nondeterministically Key: SPARK-3400 URL: https://issues.apache.org/jira/browse/SPARK-3400 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3401) Wrong usage of tee command in python/run-tests

Kousuke Saruta created SPARK-3401: - Summary: Wrong usage of tee command in python/run-tests Key: SPARK-3401 URL: https://issues.apache.org/jira/browse/SPARK-3401 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3401) Wrong usage of tee command in python/run-tests

[ https://issues.apache.org/jira/browse/SPARK-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121033#comment-14121033 ] Apache Spark commented on SPARK-3401: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-3400) GraphX unit tests fail nondeterministically

[ https://issues.apache.org/jira/browse/SPARK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121032#comment-14121032 ] Apache Spark commented on SPARK-3400: - User 'ankurdave' has created a pull request for

[jira] [Resolved] (SPARK-3400) GraphX unit tests fail nondeterministically

[ https://issues.apache.org/jira/browse/SPARK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3400. --- Resolution: Fixed Fix Version/s: 1.1.0 1.3.0 1.0.1 Issue

[jira] [Reopened] (SPARK-2823) GraphX jobs throw IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reopened SPARK-2823: --- I had to revert this because of SPARK-3400. GraphX jobs throw IllegalArgumentException

[jira] [Commented] (SPARK-3353) Stage id monotonicity (parent stage should have lower stage id)

[ https://issues.apache.org/jira/browse/SPARK-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121075#comment-14121075 ] Apache Spark commented on SPARK-3353: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-2321) Design a proper progress reporting event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121085#comment-14121085 ] Chengxiang Li commented on SPARK-2321: -- I collect some hive side requirement here,

[jira] [Commented] (SPARK-2321) Design a proper progress reporting event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121094#comment-14121094 ] Reynold Xin commented on SPARK-2321: What about pull vs push? i.e. should this be a

[jira] [Commented] (SPARK-2978) Provide an MR-style shuffle transformation

[ https://issues.apache.org/jira/browse/SPARK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121115#comment-14121115 ] Apache Spark commented on SPARK-2978: - User 'sryza' has created a pull request for

[jira] [Updated] (SPARK-3377) Don't mix metrics from different applications

[ https://issues.apache.org/jira/browse/SPARK-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3377: -- Summary: Don't mix metrics from different applications (was: codahale base Metrics data

[jira] [Resolved] (SPARK-640) Update Hadoop 1 version to 1.1.0 (especially on AMIs)

[ https://issues.apache.org/jira/browse/SPARK-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-640. - Resolution: Fixed This looks stale right? Hadoop 1 version has been at 1.2.1 for some time. Update

[jira] [Resolved] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-529. - Resolution: Won't Fix This looks obsolete and/or fixed, as variables like SPARK_MEM are deprecated, and I

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121160#comment-14121160 ] Saisai Shao commented on SPARK-3129: Hi [~hshreedharan], one more question: Is your

[jira] [Commented] (SPARK-2321) Design a proper progress reporting event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121173#comment-14121173 ] Chengxiang Li commented on SPARK-2321: -- I'm not sure whether i understand you right,

[jira] [Created] (SPARK-3402) Library for Natural Language Processing over Spark.

Nagamallikarjuna created SPARK-3402: --- Summary: Library for Natural Language Processing over Spark. Key: SPARK-3402 URL: https://issues.apache.org/jira/browse/SPARK-3402 Project: Spark

[jira] [Commented] (SPARK-3402) Library for Natural Language Processing over Spark.

[ https://issues.apache.org/jira/browse/SPARK-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121190#comment-14121190 ] Nagamallikarjuna commented on SPARK-3402: - We have gone through Spark and its

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121276#comment-14121276 ] David commented on SPARK-1473: -- Hi you all, I am Dr. David Martinez and this is my first

[jira] [Commented] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121324#comment-14121324 ] Helena Edelson commented on SPARK-2892: --- I see the same with 1.0.2 streaming: ERROR

[jira] [Comment Edited] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121324#comment-14121324 ] Helena Edelson edited comment on SPARK-2892 at 9/4/14 1:12 PM:

[jira] [Assigned] (SPARK-3375) spark on yarn container allocation issues

[ https://issues.apache.org/jira/browse/SPARK-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-3375: Assignee: Thomas Graves spark on yarn container allocation issues

[jira] [Commented] (SPARK-3375) spark on yarn container allocation issues

[ https://issues.apache.org/jira/browse/SPARK-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121451#comment-14121451 ] Apache Spark commented on SPARK-3375: - User 'tgravescs' has created a pull request for

[jira] [Created] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

Alexander Ulanov created SPARK-3403: --- Summary: NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java) Key: SPARK-3403 URL: https://issues.apache.org/jira/browse/SPARK-3403

[jira] [Updated] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-3403: Attachment: NativeNN.scala The file contains example that produces the same issue

[jira] [Commented] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121516#comment-14121516 ] Xiangrui Meng commented on SPARK-3403: -- Did you test the setup of netlib-java with

[jira] [Created] (SPARK-3404) SparkSubmitSuite fails in Maven (only) - spark-submit exits with code 1

Sean Owen created SPARK-3404: Summary: SparkSubmitSuite fails in Maven (only) - spark-submit exits with code 1 Key: SPARK-3404 URL: https://issues.apache.org/jira/browse/SPARK-3404 Project: Spark

[jira] [Commented] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121561#comment-14121561 ] Helena Edelson commented on SPARK-2892: --- I wonder if the ERROR should be a WARN or

[jira] [Commented] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121563#comment-14121563 ] Alexander Ulanov commented on SPARK-3403: - Yes, I tried using netlib-java

[jira] [Comment Edited] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121561#comment-14121561 ] Helena Edelson edited comment on SPARK-2892 at 9/4/14 5:01 PM:

[jira] [Commented] (SPARK-3286) Cannot view ApplicationMaster UI when Yarn’s url scheme is https

[ https://issues.apache.org/jira/browse/SPARK-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121608#comment-14121608 ] Apache Spark commented on SPARK-3286: - User 'benoyantony' has created a pull request

[jira] [Commented] (SPARK-3404) SparkSubmitSuite fails in Maven (only) - spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121646#comment-14121646 ] Andrew Or commented on SPARK-3404: -- Thanks for looking into this Sean. Does this happen

[jira] [Updated] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3404: - Priority: Critical (was: Major) SparkSubmitSuite fails with spark-submit exits with code 1

[jira] [Updated] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3404: - Summary: SparkSubmitSuite fails with spark-submit exits with code 1 (was: SparkSubmitSuite fails in

[jira] [Commented] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121650#comment-14121650 ] Andrew Or commented on SPARK-3404: -- I have updated the title to reflect this.

[jira] [Updated] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3404: - Target Version/s: 1.1.1 SparkSubmitSuite fails with spark-submit exits with code 1

[jira] [Updated] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3404: - Affects Version/s: 1.1.0 SparkSubmitSuite fails with spark-submit exits with code 1

[jira] [Commented] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121653#comment-14121653 ] Sean Owen commented on SPARK-3404: -- It's 100% repeatable in Maven for me locally, which

[jira] [Resolved] (SPARK-1078) Replace lift-json with json4s-jackson

[ https://issues.apache.org/jira/browse/SPARK-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1078. --- Resolution: Fixed Fix Version/s: 1.0.0 It looks like this was fixed in SPARK-1132 / Spark

[jira] [Updated] (SPARK-3286) Cannot view ApplicationMaster UI when Yarn’s url scheme is https

[ https://issues.apache.org/jira/browse/SPARK-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3286: -- Component/s: Web UI Cannot view ApplicationMaster UI when Yarn’s url scheme is https

[jira] [Updated] (SPARK-3284) saveAsParquetFile not working on windows

[ https://issues.apache.org/jira/browse/SPARK-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pravesh Jain updated SPARK-3284: Description: {code} object parquet { case class Person(name: String, age: Int) def main(args:

[jira] [Updated] (SPARK-2015) Spark UI issues at scale

[ https://issues.apache.org/jira/browse/SPARK-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2015: -- Component/s: Web UI Spark UI issues at scale Key:

[jira] [Assigned] (SPARK-3061) Maven build fails in Windows OS

[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-3061: - Assignee: Andrew Or (was: Josh Rosen) Re-assigning to Andrew, who's going to backport it.

[jira] [Updated] (SPARK-2334) Attribute Error calling PipelinedRDD.id() in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2334: -- Affects Version/s: 1.1.0 Attribute Error calling PipelinedRDD.id() in pyspark

[jira] [Commented] (SPARK-640) Update Hadoop 1 version to 1.1.0 (especially on AMIs)

[ https://issues.apache.org/jira/browse/SPARK-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121883#comment-14121883 ] Matei Zaharia commented on SPARK-640: - [~pwendell] what is our Hadoop 1 version on AMIs

[jira] [Created] (SPARK-3405) EC2 cluster creation on VPC

Dawson Reid created SPARK-3405: -- Summary: EC2 cluster creation on VPC Key: SPARK-3405 URL: https://issues.apache.org/jira/browse/SPARK-3405 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122006#comment-14122006 ] Hari Shreedharan commented on SPARK-3129: - Yes, so my initial goal is to be able

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122017#comment-14122017 ] Hari Shreedharan commented on SPARK-3129: - [~tgraves] - Am I correct in assuming

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122064#comment-14122064 ] Thomas Graves commented on SPARK-3129: -- On yarn, it generates the secret

[jira] [Resolved] (SPARK-3378) Replace the word SparkSQL with right word Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3378. - Resolution: Fixed Fix Version/s: 1.2.0 Replace the word SparkSQL with right word

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122103#comment-14122103 ] Hari Shreedharan commented on SPARK-3129: - I am less worried about client mode,

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122114#comment-14122114 ] Hari Shreedharan commented on SPARK-3129: - Looks like simply moving the code that

[jira] [Updated] (SPARK-3405) EC2 cluster creation on VPC

[ https://issues.apache.org/jira/browse/SPARK-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3405: --- Component/s: (was: PySpark) EC2 cluster creation on VPC ---

[jira] [Commented] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122219#comment-14122219 ] Xiangrui Meng commented on SPARK-3403: -- I don't have a Windows system to test. There

[jira] [Created] (SPARK-3406) Python persist API does not have a default storage level

holdenk created SPARK-3406: -- Summary: Python persist API does not have a default storage level Key: SPARK-3406 URL: https://issues.apache.org/jira/browse/SPARK-3406 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3390) sqlContext.jsonRDD fails on a complex structure of JSON array and JSON object nesting

[ https://issues.apache.org/jira/browse/SPARK-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-3390: Summary: sqlContext.jsonRDD fails on a complex structure of JSON array and JSON object nesting (was:

[jira] [Commented] (SPARK-3390) sqlContext.jsonRDD fails on a complex structure of array and hashmap nesting

[ https://issues.apache.org/jira/browse/SPARK-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122235#comment-14122235 ] Yin Huai commented on SPARK-3390: - Oh, I see the problem. I am out of town this week. Will

[jira] [Commented] (SPARK-2430) Standarized Clustering Algorithm API and Framework

[ https://issues.apache.org/jira/browse/SPARK-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122242#comment-14122242 ] Yu Ishikawa commented on SPARK-2430: Hi [~rnowling] , I am very interested in this

[jira] [Commented] (SPARK-2966) Add an approximation algorithm for hierarchical clustering to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122249#comment-14122249 ] Yu Ishikawa commented on SPARK-2966: I'm sorry for not checking community discussion

[jira] [Resolved] (SPARK-3310) Directly use currentTable without unnecessary implicit conversion

[ https://issues.apache.org/jira/browse/SPARK-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3310. - Resolution: Fixed Fix Version/s: 1.2.0 Directly use currentTable without

[jira] [Resolved] (SPARK-2219) AddJar doesn't work

[ https://issues.apache.org/jira/browse/SPARK-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2219. - Resolution: Fixed Fix Version/s: 1.2.0 AddJar doesn't work ---

[jira] [Commented] (SPARK-2966) Add an approximation algorithm for hierarchical clustering to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122266#comment-14122266 ] RJ Nowling commented on SPARK-2966: --- No worries. Based on my reading of the Spark

[jira] [Commented] (SPARK-2430) Standarized Clustering Algorithm API and Framework

[ https://issues.apache.org/jira/browse/SPARK-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122273#comment-14122273 ] RJ Nowling commented on SPARK-2430: --- Hi Yu, The community had suggested looking into

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122274#comment-14122274 ] Saisai Shao commented on SPARK-3129: Hi [~hshreedharan]], thanks for your reply, is

[jira] [Created] (SPARK-3407) Add Date type support

Cheng Hao created SPARK-3407: Summary: Add Date type support Key: SPARK-3407 URL: https://issues.apache.org/jira/browse/SPARK-3407 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122292#comment-14122292 ] Saisai Shao commented on SPARK-2926: Hi Matei, sorry for late response, I will test

[jira] [Resolved] (SPARK-3392) Set command always get undefined for key mapred.reduce.tasks

[ https://issues.apache.org/jira/browse/SPARK-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3392. - Resolution: Fixed Fix Version/s: 1.2.0 Set command always get undefined for key

[jira] [Created] (SPARK-3408) Limit operator doesn't work with sort based shuffle

Reynold Xin created SPARK-3408: -- Summary: Limit operator doesn't work with sort based shuffle Key: SPARK-3408 URL: https://issues.apache.org/jira/browse/SPARK-3408 Project: Spark Issue Type:

[jira] [Created] (SPARK-3409) Avoid pulling in Exchange operator itself in Exchange's closures

Reynold Xin created SPARK-3409: -- Summary: Avoid pulling in Exchange operator itself in Exchange's closures Key: SPARK-3409 URL: https://issues.apache.org/jira/browse/SPARK-3409 Project: Spark

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122386#comment-14122386 ] sam commented on SPARK-1473: Good paper, the theory is very solid. My only concern is that the

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122390#comment-14122390 ] sam commented on SPARK-1473: [~dmm...@gmail.com] mentioning also (i cant work which david is

[jira] [Commented] (SPARK-3408) Limit operator doesn't work with sort based shuffle

[ https://issues.apache.org/jira/browse/SPARK-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122407#comment-14122407 ] Apache Spark commented on SPARK-3408: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-3409) Avoid pulling in Exchange operator itself in Exchange's closures

[ https://issues.apache.org/jira/browse/SPARK-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122408#comment-14122408 ] Apache Spark commented on SPARK-3409: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-3410) The priority of shutdownhook for ApplicationMaster should not be integer literal, rather than refer constant.

[ https://issues.apache.org/jira/browse/SPARK-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3410: -- Issue Type: Improvement (was: Bug) The priority of shutdownhook for ApplicationMaster should

[jira] [Commented] (SPARK-3410) The priority of shutdownhook for ApplicationMaster should not be integer literal, rather than refer constant.

[ https://issues.apache.org/jira/browse/SPARK-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122465#comment-14122465 ] Apache Spark commented on SPARK-3410: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3411) Optimize the schedule procedure in Master

WangTaoTheTonic created SPARK-3411: -- Summary: Optimize the schedule procedure in Master Key: SPARK-3411 URL: https://issues.apache.org/jira/browse/SPARK-3411 Project: Spark Issue Type: