[jira] [Commented] (SPARK-33445) Can't parse decimal type from csv file

2020-11-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234773#comment-17234773 ] Dongjoon Hyun commented on SPARK-33445: --- [~bullsoverbears]. I asked you to reopen with the valid

[jira] [Resolved] (SPARK-33445) Can't parse decimal type from csv file

2020-11-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33445. --- Resolution: Cannot Reproduce > Can't parse decimal type from csv file >

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-11-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234765#comment-17234765 ] Yang Jie commented on SPARK-33044: -- Gentle ping, [~shaneknapp].  > Add a Jenkins build and test job

[jira] [Assigned] (SPARK-33476) Generalize ExecutorSource to expose user-given file system schemes

2020-11-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33476: - Assignee: Dongjoon Hyun > Generalize ExecutorSource to expose user-given file system

[jira] [Resolved] (SPARK-33476) Generalize ExecutorSource to expose user-given file system schemes

2020-11-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33476. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30405

[jira] [Created] (SPARK-33480) support char/varchar type

2020-11-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-33480: --- Summary: support char/varchar type Key: SPARK-33480 URL: https://issues.apache.org/jira/browse/SPARK-33480 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-19256) Hive bucketing write support

2020-11-18 Thread Piotr Findeisen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234723#comment-17234723 ] Piotr Findeisen commented on SPARK-19256: - >  1.for Hive 3.x.y, writing Hive bucketed table with

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-11-18 Thread Bongani Shongwe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234686#comment-17234686 ] Bongani Shongwe commented on SPARK-31800: - I'm also hitting the same issue as OP. I tested using

[jira] [Commented] (SPARK-31962) Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234596#comment-17234596 ] Apache Spark commented on SPARK-31962: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33475. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30404

[jira] [Assigned] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33475: Assignee: Takeshi Yamamuro > Bump ANTLR runtime version to 4.8-1 >

[jira] [Resolved] (SPARK-24554) Add MapType Support for Arrow in PySpark

2020-11-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24554. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30393

[jira] [Assigned] (SPARK-24554) Add MapType Support for Arrow in PySpark

2020-11-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24554: Assignee: Bryan Cutler > Add MapType Support for Arrow in PySpark >

[jira] [Commented] (SPARK-33478) Allow overwrite a path that is also being read under dynamic partition overwrite

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234488#comment-17234488 ] Apache Spark commented on SPARK-33478: -- User 'manbuyun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33478) Allow overwrite a path that is also being read under dynamic partition overwrite

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33478: Assignee: Apache Spark > Allow overwrite a path that is also being read under dynamic

[jira] [Commented] (SPARK-33478) Allow overwrite a path that is also being read under dynamic partition overwrite

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234489#comment-17234489 ] Apache Spark commented on SPARK-33478: -- User 'manbuyun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33478) Allow overwrite a path that is also being read under dynamic partition overwrite

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33478: Assignee: (was: Apache Spark) > Allow overwrite a path that is also being read under

[jira] [Assigned] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33479: Assignee: Gengliang Wang (was: Apache Spark) > Make apiKey of docsearch configurable >

[jira] [Assigned] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33479: Assignee: Apache Spark (was: Gengliang Wang) > Make apiKey of docsearch configurable >

[jira] [Commented] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234484#comment-17234484 ] Apache Spark commented on SPARK-33479: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-18 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-33479: -- Summary: Make apiKey of docsearch configurable Key: SPARK-33479 URL: https://issues.apache.org/jira/browse/SPARK-33479 Project: Spark Issue Type:

[jira] [Created] (SPARK-33478) Allow overwrite a path that is also being read under dynamic partition overwrite

2020-11-18 Thread jinhai (Jira)
jinhai created SPARK-33478: -- Summary: Allow overwrite a path that is also being read under dynamic partition overwrite Key: SPARK-33478 URL: https://issues.apache.org/jira/browse/SPARK-33478 Project: Spark

[jira] [Commented] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234386#comment-17234386 ] Apache Spark commented on SPARK-33477: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33477: Assignee: Yuming Wang (was: Apache Spark) > Hive partition pruning support date type >

[jira] [Assigned] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33477: Assignee: Apache Spark (was: Yuming Wang) > Hive partition pruning support date type >

[jira] [Updated] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33477: Fix Version/s: (was: 3.1.0) > Hive partition pruning support date type >

[jira] [Updated] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33477: Description: Hive partition pruning can support date type:

[jira] [Updated] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33477: Description: Hive partition pruning can support date type:

[jira] [Created] (SPARK-33477) Hive partition pruning support date type

2020-11-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33477: --- Summary: Hive partition pruning support date type Key: SPARK-33477 URL: https://issues.apache.org/jira/browse/SPARK-33477 Project: Spark Issue Type:

<    1   2