[jira] [Commented] (SPARK-10294) When Parquet writer's close method throws an exception, we will call close again and trigger a NPE

[ https://issues.apache.org/jira/browse/SPARK-10294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944887#comment-15944887 ] Steve Loughran commented on SPARK-10294: consider it a failure in the exception logic; it tries

[jira] [Comment Edited] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945051#comment-15945051 ] Denis Bolshakov edited comment on SPARK-20127 at 3/28/17 12:32 PM: --- I

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945051#comment-15945051 ] Denis Bolshakov commented on SPARK-20127: - I applied you first comments (just by reverting

[jira] [Commented] (SPARK-20126) Remove HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-20126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945072#comment-15945072 ] Apache Spark commented on SPARK-20126: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20126) Remove HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-20126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20126: Assignee: Herman van Hovell (was: Apache Spark) > Remove HiveSessionState >

[jira] [Assigned] (SPARK-20126) Remove HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-20126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20126: Assignee: Apache Spark (was: Herman van Hovell) > Remove HiveSessionState >

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944771#comment-15944771 ] Jacek Laskowski commented on SPARK-20122: - [~hvanhovell] Already did in the initial issue report.

[jira] [Comment Edited] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944829#comment-15944829 ] Oliver Koeth edited comment on SPARK-20044 at 3/28/17 9:09 AM: --- The field

[jira] [Updated] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-20123: Description: If $SPARK_HOME or $FWDIR variable contains spaces, then use

[jira] [Comment Edited] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945002#comment-15945002 ] Denis Bolshakov edited comment on SPARK-20127 at 3/28/17 11:46 AM: ---

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945002#comment-15945002 ] Denis Bolshakov commented on SPARK-20127: - Hello [~srowen], thanks for quick feedback. Could you

[jira] [Created] (SPARK-20127) Minor code cleanup

Denis Bolshakov created SPARK-20127: --- Summary: Minor code cleanup Key: SPARK-20127 URL: https://issues.apache.org/jira/browse/SPARK-20127 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-20094) Should Prevent push down of IN subquery to Join operator

[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20094. --- Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.2.0 >

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945058#comment-15945058 ] Sean Owen commented on SPARK-20127: --- We use pull requests to suggest changes, but before you do, I

[jira] [Commented] (SPARK-14228) Lost executor of RPC disassociated, and occurs exception: Could not find CoarseGrainedScheduler or it has been stopped

[ https://issues.apache.org/jira/browse/SPARK-14228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944912#comment-15944912 ] Amitabh commented on SPARK-14228: - Hi, can you specify the version you were working with? I have received

[jira] [Created] (SPARK-20126) Remove HiveSessionState

Herman van Hovell created SPARK-20126: - Summary: Remove HiveSessionState Key: SPARK-20126 URL: https://issues.apache.org/jira/browse/SPARK-20126 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944984#comment-15944984 ] Sean Owen commented on SPARK-20127: --- I am a fan of improving code style and static inspection. However

[jira] [Updated] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20127: -- Affects Version/s: (was: 2.3.0) 2.1.0 Labels: (was:

[jira] [Updated] (SPARK-20094) Should Prevent push down of IN subquery to Join operator

[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-20094: - Summary: Should Prevent push down of IN subquery to Join operator (was: Putting predicate with

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945014#comment-15945014 ] Denis Bolshakov commented on SPARK-20127: - You can review changes shortly here

[jira] [Commented] (SPARK-20120) spark-sql CLI support silent mode

[ https://issues.apache.org/jira/browse/SPARK-20120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944635#comment-15944635 ] Jinhua Fu commented on SPARK-20120: --- Good idea.I agree with you! > spark-sql CLI support silent mode >

[jira] [Resolved] (SPARK-20119) Flaky Test: org.apache.spark.sql.execution. DataSourceScanExecRedactionSuite

[ https://issues.apache.org/jira/browse/SPARK-20119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20119. --- Resolution: Fixed Fix Version/s: 2.2.0 > Flaky Test:

[jira] [Created] (SPARK-20124) Join reorder should keep the same order of final project attributes

Zhenhua Wang created SPARK-20124: Summary: Join reorder should keep the same order of final project attributes Key: SPARK-20124 URL: https://issues.apache.org/jira/browse/SPARK-20124 Project: Spark

[jira] [Assigned] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20044: Assignee: Apache Spark > Support Spark UI behind front-end reverse proxy using a path

[jira] [Created] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

Jacek Laskowski created SPARK-20122: --- Summary: Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications Key: SPARK-20122 URL: https://issues.apache.org/jira/browse/SPARK-20122

[jira] [Commented] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944629#comment-15944629 ] Saisai Shao commented on SPARK-20079: - What is the specific symptom you met? I believe there's bunch

[jira] [Assigned] (SPARK-19866) Add local version of Word2Vec findSynonyms for spark.ml: Python API

[ https://issues.apache.org/jira/browse/SPARK-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19866: Assignee: Apache Spark > Add local version of Word2Vec findSynonyms for spark.ml: Python

[jira] [Assigned] (SPARK-19866) Add local version of Word2Vec findSynonyms for spark.ml: Python API

[ https://issues.apache.org/jira/browse/SPARK-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19866: Assignee: (was: Apache Spark) > Add local version of Word2Vec findSynonyms for

[jira] [Commented] (SPARK-19866) Add local version of Word2Vec findSynonyms for spark.ml: Python API

[ https://issues.apache.org/jira/browse/SPARK-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944657#comment-15944657 ] Apache Spark commented on SPARK-19866: -- User 'keypointt' has created a pull request for this issue:

[jira] [Commented] (SPARK-20124) Join reorder should keep the same order of final project attributes

[ https://issues.apache.org/jira/browse/SPARK-20124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944717#comment-15944717 ] Apache Spark commented on SPARK-20124: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20125) Dataset of type option of map does not work

[ https://issues.apache.org/jira/browse/SPARK-20125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20125: Assignee: Wenchen Fan (was: Apache Spark) > Dataset of type option of map does not work

[jira] [Assigned] (SPARK-20124) Join reorder should keep the same order of final project attributes

[ https://issues.apache.org/jira/browse/SPARK-20124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20124: Assignee: Apache Spark > Join reorder should keep the same order of final project

[jira] [Assigned] (SPARK-20124) Join reorder should keep the same order of final project attributes

[ https://issues.apache.org/jira/browse/SPARK-20124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20124: Assignee: (was: Apache Spark) > Join reorder should keep the same order of final

[jira] [Comment Edited] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944778#comment-15944778 ] Oliver Koeth edited comment on SPARK-20044 at 3/28/17 8:43 AM: --- Added a

[jira] [Created] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

zuotingbing created SPARK-20123: --- Summary: $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed. Key: SPARK-20123 URL:

[jira] [Created] (SPARK-20125) Dataset of type option of map does not work

Wenchen Fan created SPARK-20125: --- Summary: Dataset of type option of map does not work Key: SPARK-20125 URL: https://issues.apache.org/jira/browse/SPARK-20125 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944763#comment-15944763 ] Apache Spark commented on SPARK-20044: -- User 'okoethibm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20044: Assignee: (was: Apache Spark) > Support Spark UI behind front-end reverse proxy using

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944799#comment-15944799 ] Herman van Hovell commented on SPARK-20122: --- Yeah, I totally missed that. Anyway, you need to

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944819#comment-15944819 ] Jacek Laskowski commented on SPARK-20122: - Sounds simple (= I know where and what not necessarily

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944694#comment-15944694 ] Herman van Hovell commented on SPARK-20122: --- [~jlaskowski] Could you also post the query that

[jira] [Comment Edited] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944778#comment-15944778 ] Oliver Koeth edited comment on SPARK-20044 at 3/28/17 8:41 AM: --- Added a

[jira] [Assigned] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20123: Assignee: (was: Apache Spark) > $SPARK_HOME variable might have spaces in it(e.g.

[jira] [Commented] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944676#comment-15944676 ] Apache Spark commented on SPARK-20123: -- User 'zuotingbing' has created a pull request for this

[jira] [Assigned] (SPARK-20123) $SPARK_HOME variable might have spaces in it(e.g. $SPARK_HOME=/home/spark build/spark), then build spark failed.

[ https://issues.apache.org/jira/browse/SPARK-20123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20123: Assignee: Apache Spark > $SPARK_HOME variable might have spaces in it(e.g.

[jira] [Commented] (SPARK-20125) Dataset of type option of map does not work

[ https://issues.apache.org/jira/browse/SPARK-20125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944759#comment-15944759 ] Apache Spark commented on SPARK-20125: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20125) Dataset of type option of map does not work

[ https://issues.apache.org/jira/browse/SPARK-20125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20125: Assignee: Apache Spark (was: Wenchen Fan) > Dataset of type option of map does not work

[jira] [Comment Edited] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944778#comment-15944778 ] Oliver Koeth edited comment on SPARK-20044 at 3/28/17 8:43 AM: --- Added a

[jira] [Updated] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-20122: Description: {{Analyzer}} should be more elaborate on the root cause of the

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944631#comment-15944631 ] Jacek Laskowski commented on SPARK-20122: - Once agreed it's an issue, I'd appreciate any guidance

[jira] [Comment Edited] (SPARK-20120) spark-sql CLI support silent mode

[ https://issues.apache.org/jira/browse/SPARK-20120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944635#comment-15944635 ] Jinhua Fu edited comment on SPARK-20120 at 3/28/17 6:51 AM: Good idea.I agree

[jira] [Commented] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944778#comment-15944778 ] Oliver Koeth commented on SPARK-20044: -- Added a pull request. Works for me with the following

[jira] [Commented] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944829#comment-15944829 ] Oliver Koeth commented on SPARK-20044: -- The field "webuiaddress" in the /json response does not

[jira] [Commented] (SPARK-20107) Speed up HadoopMapReduceCommitProtocol#commitJob for many output files

[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945177#comment-15945177 ] Imran Rashid commented on SPARK-20107: -- >From Marcelo's comment on the PR: bq. We shouldn't set the

[jira] [Assigned] (SPARK-20124) Join reorder should keep the same order of final project attributes

[ https://issues.apache.org/jira/browse/SPARK-20124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20124: --- Assignee: Zhenhua Wang > Join reorder should keep the same order of final project

[jira] [Resolved] (SPARK-20124) Join reorder should keep the same order of final project attributes

[ https://issues.apache.org/jira/browse/SPARK-20124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20124. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17453

[jira] [Assigned] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20127: Assignee: Apache Spark > Minor code cleanup > -- > > Key:

[jira] [Assigned] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20127: Assignee: (was: Apache Spark) > Minor code cleanup > -- > >

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 1:34 PM: - As I mentioned on the

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 1:34 PM: - As I mentioned on the

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 1:34 PM: - As I mentioned on the

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 1:33 PM: - As I mentioned on the

[jira] [Commented] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh commented on SPARK-19981: As I mentioned on the PR, this seems like it should be handled here:

[jira] [Created] (SPARK-20128) MetricsSystem not always killed in SparkContext.stop()

Imran Rashid created SPARK-20128: Summary: MetricsSystem not always killed in SparkContext.stop() Key: SPARK-20128 URL: https://issues.apache.org/jira/browse/SPARK-20128 Project: Spark Issue

[jira] [Updated] (SPARK-20128) MetricsSystem not always killed in SparkContext.stop()

[ https://issues.apache.org/jira/browse/SPARK-20128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-20128: - Description: One Jenkins run failed due to the MetricsSystem never getting killed after a

[jira] [Commented] (SPARK-20127) Minor code cleanup

[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945107#comment-15945107 ] Apache Spark commented on SPARK-20127: -- User 'dbolshak' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 1:35 PM: - As I mentioned on the

[jira] [Commented] (SPARK-20107) Speed up HadoopMapReduceCommitProtocol#commitJob for many output files

[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945379#comment-15945379 ] Yuming Wang commented on SPARK-20107: - OK, I will add

[jira] [Updated] (SPARK-20109) Need a way to convert from IndexedRowMatrix to Dense Block Matrices

[ https://issues.apache.org/jira/browse/SPARK-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Compitello updated SPARK-20109: Summary: Need a way to convert from IndexedRowMatrix to Dense Block Matrices (was: Need a

[jira] [Commented] (SPARK-20109) Need a way to convert from IndexedRowMatrix to Dense Block Matrices

[ https://issues.apache.org/jira/browse/SPARK-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945388#comment-15945388 ] Apache Spark commented on SPARK-20109: -- User 'johnc1231' has created a pull request for this issue:

[jira] [Commented] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945389#comment-15945389 ] Kazuaki Ishizaki commented on SPARK-20112: -- SPARK-18745 fixed integer overflow issues in

[jira] [Assigned] (SPARK-20109) Need a way to convert from IndexedRowMatrix to Dense Block Matrices

[ https://issues.apache.org/jira/browse/SPARK-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20109: Assignee: (was: Apache Spark) > Need a way to convert from IndexedRowMatrix to Dense

[jira] [Updated] (SPARK-20109) Need a way to convert from IndexedRowMatrix to Dense Block Matrices

[ https://issues.apache.org/jira/browse/SPARK-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Compitello updated SPARK-20109: Description: The current implementation of toBlockMatrix on IndexedRowMatrix is

[jira] [Assigned] (SPARK-20109) Need a way to convert from IndexedRowMatrix to Dense Block Matrices

[ https://issues.apache.org/jira/browse/SPARK-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20109: Assignee: Apache Spark > Need a way to convert from IndexedRowMatrix to Dense Block

[jira] [Comment Edited] (SPARK-20107) Speed up HadoopMapReduceCommitProtocol#commitJob for many output files

[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945379#comment-15945379 ] Yuming Wang edited comment on SPARK-20107 at 3/28/17 3:37 PM: -- OK, I will

[jira] [Comment Edited] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945399#comment-15945399 ] Mitesh edited comment on SPARK-20112 at 3/28/17 3:46 PM: - [~kiszk] I can try out

[jira] [Comment Edited] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945399#comment-15945399 ] Mitesh edited comment on SPARK-20112 at 3/28/17 3:46 PM: - [~kiszk] I can try out

[jira] [Updated] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-20112: --- Attachment: hs_err_pid22870.log > SIGSEGV in GeneratedIterator.sort_addToSorter >

[jira] [Commented] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945399#comment-15945399 ] Mitesh commented on SPARK-20112: [~kiszk] I can try out spark 2.0.3+ or 2.1. Actually I disabled

[jira] [Resolved] (SPARK-20126) Remove HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-20126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20126. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17457

[jira] [Comment Edited] (SPARK-19981) Sort-Merge join inserts shuffles when joining dataframes with aliased columns

[ https://issues.apache.org/jira/browse/SPARK-19981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945166#comment-15945166 ] Mitesh edited comment on SPARK-19981 at 3/28/17 3:21 PM: - As I mentioned on the

[jira] [Comment Edited] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945399#comment-15945399 ] Mitesh edited comment on SPARK-20112 at 3/28/17 3:40 PM: - [~kiszk] I can try out

[jira] [Commented] (SPARK-20112) SIGSEGV in GeneratedIterator.sort_addToSorter

[ https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1594#comment-1594 ] Kazuaki Ishizaki commented on SPARK-20112: -- [~MasterDDT] Thank you for preparing additional

[jira] [Updated] (SPARK-16929) Speculation-related synchronization bottleneck in checkSpeculatableTasks

[ https://issues.apache.org/jira/browse/SPARK-16929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-16929: - Issue Type: Improvement (was: Bug) > Speculation-related synchronization bottleneck in

[jira] [Assigned] (SPARK-20129) JavaSparkContext should use SparkContext.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-20129: - Assignee: Xiangrui Meng > JavaSparkContext should use SparkContext.getOrCreate >

[jira] [Created] (SPARK-20129) JavaSparkContext should use SparkContext.getOrCreate

Xiangrui Meng created SPARK-20129: - Summary: JavaSparkContext should use SparkContext.getOrCreate Key: SPARK-20129 URL: https://issues.apache.org/jira/browse/SPARK-20129 Project: Spark Issue

[jira] [Resolved] (SPARK-20125) Dataset of type option of map does not work

[ https://issues.apache.org/jira/browse/SPARK-20125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20125. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 > Dataset of type option of map

[jira] [Commented] (SPARK-20050) Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946098#comment-15946098 ] Apache Spark commented on SPARK-20050: -- User 'sasakitoa' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20050) Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20050: Assignee: (was: Apache Spark) > Kafka 0.10 DirectStream doesn't commit last processed

[jira] [Assigned] (SPARK-20050) Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20050: Assignee: Apache Spark > Kafka 0.10 DirectStream doesn't commit last processed batch's

[jira] [Commented] (SPARK-20132) Add documentation for column string functions

[ https://issues.apache.org/jira/browse/SPARK-20132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946130#comment-15946130 ] Michael Patterson commented on SPARK-20132: --- I have a commit with the documentation:

[jira] [Resolved] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20043. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Assigned] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-20043: - Assignee: Yan Facai (颜发才) > Decision Tree loader does not handle uppercase

[jira] [Created] (SPARK-20132) Add documentation for column string functions

Michael Patterson created SPARK-20132: - Summary: Add documentation for column string functions Key: SPARK-20132 URL: https://issues.apache.org/jira/browse/SPARK-20132 Project: Spark

[jira] [Commented] (SPARK-16288) Implement inline table generating function

[ https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946176#comment-15946176 ] Guilherme Braccialli commented on SPARK-16288: -- Is it possible to call this function direct

[jira] [Comment Edited] (SPARK-20093) Exception when Joining dataframe with another dataframe generated by applying groupBy transformation on original one

[ https://issues.apache.org/jira/browse/SPARK-20093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946375#comment-15946375 ] Yong Zhang edited comment on SPARK-20093 at 3/29/17 1:34 AM: - This problem

[jira] [Created] (SPARK-20133) User guide for spark.ml.stat.ChiSquareTest

Joseph K. Bradley created SPARK-20133: - Summary: User guide for spark.ml.stat.ChiSquareTest Key: SPARK-20133 URL: https://issues.apache.org/jira/browse/SPARK-20133 Project: Spark Issue

[jira] [Commented] (SPARK-20128) MetricsSystem not always killed in SparkContext.stop()

[ https://issues.apache.org/jira/browse/SPARK-20128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946486#comment-15946486 ] Imran Rashid commented on SPARK-20128: -- Thanks [~jerryshao], that is helpful, definitely good to

[jira] [Commented] (SPARK-20131) Flaky Test: org.apache.spark.streaming.StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-20131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946522#comment-15946522 ] Apache Spark commented on SPARK-20131: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20131) Flaky Test: org.apache.spark.streaming.StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-20131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20131: Assignee: (was: Apache Spark) > Flaky Test:

  1   2   >