[jira] [Commented] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551527#comment-16551527 ] Apache Spark commented on SPARK-24873: -- User 'wangyum' has created a pull request for this issue:

[jira] [Resolved] (SPARK-24836) New option - ignoreExtension

[ https://issues.apache.org/jira/browse/SPARK-24836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24836. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > New option -

[jira] [Resolved] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24879. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.2 > NPE in Hive partition filter

[jira] [Assigned] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-24879: --- Assignee: William Sheu > NPE in Hive partition filter pushdown for `partCol IN (NULL, )` >

[jira] [Comment Edited] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label

[ https://issues.apache.org/jira/browse/SPARK-24875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551457#comment-16551457 ] Liang-Chi Hsieh edited comment on SPARK-24875 at 7/21/18 12:21 AM: ---

[jira] [Commented] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label

[ https://issues.apache.org/jira/browse/SPARK-24875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551457#comment-16551457 ] Liang-Chi Hsieh commented on SPARK-24875: - hmm, I think for calculation of precision, recall and

[jira] [Commented] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists

[ https://issues.apache.org/jira/browse/SPARK-24862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551416#comment-16551416 ] Liang-Chi Hsieh commented on SPARK-24862: - Isn't it inconsistent between the schema and the

[jira] [Resolved] (SPARK-24488) Analyzer throws when generator is aliased multiple times

[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24488. --- Resolution: Fixed Assignee: Brandon Krieger Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

[ https://issues.apache.org/jira/browse/SPARK-24880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-24880. -- Resolution: Fixed Fix Version/s: 2.4.0 > Fix the group id for

[jira] [Resolved] (SPARK-24876) Simplify schema serialization

[ https://issues.apache.org/jira/browse/SPARK-24876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24876. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 > Simplify schema

[jira] [Commented] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists

[ https://issues.apache.org/jira/browse/SPARK-24862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551312#comment-16551312 ] Antonio Murgia commented on SPARK-24862: Yeah, they are definitely not supported. Therefore I

[jira] [Commented] (SPARK-23128) A new approach to do adaptive execution in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551299#comment-16551299 ] Thomas Graves commented on SPARK-23128: --- [~carsonwang]  I'm curious if you are still running with

[jira] [Commented] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551296#comment-16551296 ] Abhishek Madav commented on SPARK-24864: Thanks for the reply. The views are currently crated by

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551240#comment-16551240 ] Thomas Graves commented on SPARK-24615: --- the other thing which I think I mentioned above is could

[jira] [Updated] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24879: Shepherd: Xiao Li (was: William Sheu) > NPE in Hive partition filter pushdown for `partCol IN (NULL,

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551233#comment-16551233 ] Thomas Graves commented on SPARK-24615: --- Ok so thinking about this a bit more I slightly misread

[jira] [Assigned] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24879: Assignee: (was: Apache Spark) > NPE in Hive partition filter pushdown for `partCol

[jira] [Commented] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551200#comment-16551200 ] Apache Spark commented on SPARK-24879: -- User 'PenguinToast' has created a pull request for this

[jira] [Assigned] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

[ https://issues.apache.org/jira/browse/SPARK-24879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24879: Assignee: Apache Spark > NPE in Hive partition filter pushdown for `partCol IN (NULL,

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551198#comment-16551198 ] Mridul Muralidharan commented on SPARK-24615: - [~tgraves] This was indeed a recurring issue

[jira] [Resolved] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22880. - Resolution: Fixed Assignee: Daniel van der Ende Fix Version/s: 2.4.0 > Add option to

[jira] [Updated] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

[ https://issues.apache.org/jira/browse/SPARK-24880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-24880: - Description: The correct group id should be `org.apache.spark`. This is causing the nightly

[jira] [Assigned] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

[ https://issues.apache.org/jira/browse/SPARK-24880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24880: Assignee: Shixiong Zhu (was: Apache Spark) > Fix the group id for

[jira] [Commented] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

[ https://issues.apache.org/jira/browse/SPARK-24880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551191#comment-16551191 ] Apache Spark commented on SPARK-24880: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

[ https://issues.apache.org/jira/browse/SPARK-24880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24880: Assignee: Apache Spark (was: Shixiong Zhu) > Fix the group id for

[jira] [Created] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests

Shixiong Zhu created SPARK-24880: Summary: Fix the group id for spark-kubernetes-integration-tests Key: SPARK-24880 URL: https://issues.apache.org/jira/browse/SPARK-24880 Project: Spark

[jira] [Commented] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists

[ https://issues.apache.org/jira/browse/SPARK-24862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551174#comment-16551174 ] Liang-Chi Hsieh commented on SPARK-24862: - Even we only retrieve the first parameter list at

[jira] [Resolved] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs.

[ https://issues.apache.org/jira/browse/SPARK-24852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-24852. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21799

[jira] [Resolved] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24864. - Resolution: Won't Fix > Cannot resolve auto-generated column ordinals in a hive view >

[jira] [Commented] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551123#comment-16551123 ] Xiao Li commented on SPARK-24864: - Yeah, our generated alias names are different from the ones generated

[jira] [Created] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)`

William Sheu created SPARK-24879: Summary: NPE in Hive partition filter pushdown for `partCol IN (NULL, )` Key: SPARK-24879 URL: https://issues.apache.org/jira/browse/SPARK-24879 Project: Spark

[jira] [Commented] (SPARK-24878) Fix reverse function for array type of primitive type containing null.

[ https://issues.apache.org/jira/browse/SPARK-24878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550981#comment-16550981 ] Apache Spark commented on SPARK-24878: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24878) Fix reverse function for array type of primitive type containing null.

[ https://issues.apache.org/jira/browse/SPARK-24878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24878: Assignee: Apache Spark > Fix reverse function for array type of primitive type

[jira] [Assigned] (SPARK-24878) Fix reverse function for array type of primitive type containing null.

[ https://issues.apache.org/jira/browse/SPARK-24878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24878: Assignee: (was: Apache Spark) > Fix reverse function for array type of primitive

[jira] [Created] (SPARK-24878) Fix reverse function for array type of primitive type containing null.

Takuya Ueshin created SPARK-24878: - Summary: Fix reverse function for array type of primitive type containing null. Key: SPARK-24878 URL: https://issues.apache.org/jira/browse/SPARK-24878 Project:

[jira] [Commented] (SPARK-24792) Add API `.avro` in DataFrameReader/DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-24792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550949#comment-16550949 ] Xiao Li commented on SPARK-24792: - Since AVRO is an external modules, this does not make sense to have

[jira] [Resolved] (SPARK-24792) Add API `.avro` in DataFrameReader/DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-24792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24792. - Resolution: Won't Fix > Add API `.avro` in DataFrameReader/DataFrameWriter >

[jira] [Resolved] (SPARK-24811) Add function `from_avro` and `to_avro`

[ https://issues.apache.org/jira/browse/SPARK-24811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24811. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 > Add function

[jira] [Resolved] (SPARK-23451) Deprecate KMeans computeCost

[ https://issues.apache.org/jira/browse/SPARK-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-23451. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 > Deprecate KMeans

[jira] [Created] (SPARK-24877) Ignore the task completion event from a zombie barrier task

Jiang Xingbo created SPARK-24877: Summary: Ignore the task completion event from a zombie barrier task Key: SPARK-24877 URL: https://issues.apache.org/jira/browse/SPARK-24877 Project: Spark

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550803#comment-16550803 ] Thomas Graves commented on SPARK-24615: --- yes if any requirement can't be satisfied it would use

[jira] [Commented] (SPARK-24876) Simplify schema serialization

[ https://issues.apache.org/jira/browse/SPARK-24876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550763#comment-16550763 ] Apache Spark commented on SPARK-24876: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-24876) Simplify schema serialization

[ https://issues.apache.org/jira/browse/SPARK-24876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24876: Assignee: Apache Spark > Simplify schema serialization > - >

[jira] [Assigned] (SPARK-24876) Simplify schema serialization

[ https://issues.apache.org/jira/browse/SPARK-24876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24876: Assignee: (was: Apache Spark) > Simplify schema serialization >

[jira] [Updated] (SPARK-24876) Simplify schema serialization

[ https://issues.apache.org/jira/browse/SPARK-24876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-24876: --- Summary: Simplify schema serialization (was: Remove SerializableSchema and use json format

[jira] [Created] (SPARK-24876) Remove SerializableSchema and use json format string schema

Gengliang Wang created SPARK-24876: -- Summary: Remove SerializableSchema and use json format string schema Key: SPARK-24876 URL: https://issues.apache.org/jira/browse/SPARK-24876 Project: Spark

[jira] [Assigned] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-23731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23731: --- Assignee: Hyukjin Kwon > FileSourceScanExec throws NullPointerException in subexpression

[jira] [Updated] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24864: -- Fix Version/s: (was: 2.4.0) > Cannot resolve auto-generated column ordinals in a hive view >

[jira] [Resolved] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-23731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23731. - Resolution: Fixed Fix Version/s: 2.3.2 2.4.0 Issue resolved by pull

[jira] [Assigned] (SPARK-24551) Add Integration tests for Secrets

[ https://issues.apache.org/jira/browse/SPARK-24551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24551: - Assignee: Stavros Kontopoulos > Add Integration tests for Secrets >

[jira] [Resolved] (SPARK-24551) Add Integration tests for Secrets

[ https://issues.apache.org/jira/browse/SPARK-24551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24551. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21652

[jira] [Created] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label

Antoine Galataud created SPARK-24875: Summary: MulticlassMetrics should offer a more efficient way to compute count by label Key: SPARK-24875 URL: https://issues.apache.org/jira/browse/SPARK-24875

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550738#comment-16550738 ] Takeshi Yamamuro commented on SPARK-24869: -- In the example above, cache() is not called

[jira] [Created] (SPARK-24874) Allow hybrid of both barrier tasks and regular tasks in a stage

Jiang Xingbo created SPARK-24874: Summary: Allow hybrid of both barrier tasks and regular tasks in a stage Key: SPARK-24874 URL: https://issues.apache.org/jira/browse/SPARK-24874 Project: Spark

[jira] [Assigned] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row.

[ https://issues.apache.org/jira/browse/SPARK-24871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24871: --- Assignee: Takuya Ueshin > Refactor Concat and MapConcat to avoid creating concatenator

[jira] [Resolved] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row.

[ https://issues.apache.org/jira/browse/SPARK-24871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24871. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21824

[jira] [Updated] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JieFang.He updated SPARK-24873: --- Description: There is too much frequent interaction reports when i use spark shell commend which 

[jira] [Updated] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JieFang.He updated SPARK-24873: --- Attachment: pic.jpg > increase switch to shielding frequent interaction reports with yarn >

[jira] [Assigned] (SPARK-24868) add sequence function in Python

[ https://issues.apache.org/jira/browse/SPARK-24868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24868: Assignee: Huaxin Gao > add sequence function in Python > ---

[jira] [Resolved] (SPARK-24868) add sequence function in Python

[ https://issues.apache.org/jira/browse/SPARK-24868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24868. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21820

[jira] [Assigned] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24873: Assignee: (was: Apache Spark) > increase switch to shielding frequent interaction

[jira] [Commented] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550583#comment-16550583 ] Apache Spark commented on SPARK-24873: -- User 'hejiefang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

[ https://issues.apache.org/jira/browse/SPARK-24873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24873: Assignee: Apache Spark > increase switch to shielding frequent interaction reports with

[jira] [Assigned] (SPARK-24872) Remove the symbol “||” of the “OR” operation

[ https://issues.apache.org/jira/browse/SPARK-24872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24872: Assignee: (was: Apache Spark) > Remove the symbol “||” of the “OR” operation >

[jira] [Assigned] (SPARK-24872) Remove the symbol “||” of the “OR” operation

[ https://issues.apache.org/jira/browse/SPARK-24872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24872: Assignee: Apache Spark > Remove the symbol “||” of the “OR” operation >

[jira] [Commented] (SPARK-24872) Remove the symbol “||” of the “OR” operation

[ https://issues.apache.org/jira/browse/SPARK-24872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550567#comment-16550567 ] Apache Spark commented on SPARK-24872: -- User 'httfighter' has created a pull request for this

[jira] [Updated] (SPARK-24872) Remove the symbol “||” of the “OR” operation

[ https://issues.apache.org/jira/browse/SPARK-24872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hantiantian updated SPARK-24872: Description: “||” will perform the function of STRING concat, and it is also the symbol of the

[jira] [Created] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn

JieFang.He created SPARK-24873: -- Summary: increase switch to shielding frequent interaction reports with yarn Key: SPARK-24873 URL: https://issues.apache.org/jira/browse/SPARK-24873 Project: Spark

[jira] [Commented] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs

[ https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550551#comment-16550551 ] Szilard Nemeth commented on SPARK-20327: Pull request is updated with the latest fixes > Add

[jira] [Updated] (SPARK-24872) Remove the symbol “||” of the “OR” operation

[ https://issues.apache.org/jira/browse/SPARK-24872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hantiantian updated SPARK-24872: Description: “||” will perform the function of STRING concat, and it is also the symbol of the

[jira] [Created] (SPARK-24872) Remove the symbol “||” of the “OR” operation

hantiantian created SPARK-24872: --- Summary: Remove the symbol “||” of the “OR” operation Key: SPARK-24872 URL: https://issues.apache.org/jira/browse/SPARK-24872 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24859) Predicates pushdown on outer joins

[ https://issues.apache.org/jira/browse/SPARK-24859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Mayer updated SPARK-24859: --- Description: I have two AVRO tables in Hive called FAct and DIm. Both are partitioned by a

[jira] [Commented] (SPARK-24859) Predicates pushdown on outer joins

[ https://issues.apache.org/jira/browse/SPARK-24859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550541#comment-16550541 ] Johannes Mayer commented on SPARK-24859: Ok, i added the example > Predicates pushdown on outer

[jira] [Updated] (SPARK-24859) Predicates pushdown on outer joins

[ https://issues.apache.org/jira/browse/SPARK-24859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Mayer updated SPARK-24859: --- Description: I have two AVRO tables in Hive called FAct and DIm. Both are partitioned by a

[jira] [Updated] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-23731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23731: - Priority: Major (was: Minor) > FileSourceScanExec throws NullPointerException in subexpression

[jira] [Commented] (SPARK-24859) Predicates pushdown on outer joins

[ https://issues.apache.org/jira/browse/SPARK-24859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550359#comment-16550359 ] Johannes Mayer commented on SPARK-24859: I will provide an example. Could you test it on the

[jira] [Commented] (SPARK-18188) Add checksum for block of broadcast

[ https://issues.apache.org/jira/browse/SPARK-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550354#comment-16550354 ] Apache Spark commented on SPARK-18188: -- User '10110346' has created a pull request for this issue:

[jira] [Resolved] (SPARK-24424) Support ANSI-SQL compliant syntax for GROUPING SET

[ https://issues.apache.org/jira/browse/SPARK-24424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24424. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 > Support ANSI-SQL

[jira] [Updated] (SPARK-24424) Support ANSI-SQL compliant syntax for GROUPING SET

[ https://issues.apache.org/jira/browse/SPARK-24424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24424: Summary: Support ANSI-SQL compliant syntax for GROUPING SET (was: Support ANSI-SQL compliant syntax for

[jira] [Resolved] (SPARK-24268) DataType in error messages are not coherent

[ https://issues.apache.org/jira/browse/SPARK-24268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24268. - Resolution: Fixed Fix Version/s: 2.4.0 > DataType in error messages are not coherent >

[jira] [Comment Edited] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550289#comment-16550289 ] Dilip Biswal edited comment on SPARK-24864 at 7/20/18 6:23 AM: ---

[jira] [Commented] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view

[ https://issues.apache.org/jira/browse/SPARK-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550289#comment-16550289 ] Dilip Biswal commented on SPARK-24864: -- [~abhimadav] I don't see a problem here. The generated