[jira] [Resolved] (SPARK-34742) ANSI mode: Abs throws exception if input is out of range

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34742. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31836 [https://gith

[jira] [Created] (SPARK-34771) Support UDT for Pandas

2021-03-16 Thread Darcy Shen (Jira)
Darcy Shen created SPARK-34771: -- Summary: Support UDT for Pandas Key: SPARK-34771 URL: https://issues.apache.org/jira/browse/SPARK-34771 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34699. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31825 [https://gith

[jira] [Assigned] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34699: --- Assignee: Terry Kim > 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store te

[jira] [Assigned] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34770: Assignee: Apache Spark > InMemoryCatalog.tableExists should not fail if database doesn't

[jira] [Commented] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303122#comment-17303122 ] Apache Spark commented on SPARK-34770: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34770: Assignee: (was: Apache Spark) > InMemoryCatalog.tableExists should not fail if databa

[jira] [Commented] (SPARK-34739) Add an year-month interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303121#comment-17303121 ] Apache Spark commented on SPARK-34739: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-16 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34770: --- Summary: InMemoryCatalog.tableExists should not fail if database doesn't exist Key: SPARK-34770 URL: https://issues.apache.org/jira/browse/SPARK-34770 Project: Spark

[jira] [Assigned] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34768: Assignee: Apache Spark > Respect the default input buffer size in Univocity > ---

[jira] [Assigned] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34769: Assignee: Gengliang Wang (was: Apache Spark) > AnsiTypeCoercion: return narrowest conver

[jira] [Assigned] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34768: Assignee: (was: Apache Spark) > Respect the default input buffer size in Univocity >

[jira] [Assigned] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34769: Assignee: Apache Spark (was: Gengliang Wang) > AnsiTypeCoercion: return narrowest conver

[jira] [Commented] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303095#comment-17303095 ] Apache Spark commented on SPARK-34769: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303094#comment-17303094 ] Apache Spark commented on SPARK-34768: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-34769) AnsiTypeCoercion: return narrowest convertible type among TypeCollection

2021-03-16 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34769: -- Summary: AnsiTypeCoercion: return narrowest convertible type among TypeCollection Key: SPARK-34769 URL: https://issues.apache.org/jira/browse/SPARK-34769 Project:

[jira] [Updated] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34768: - Issue Type: Bug (was: Improvement) > Respect the default input buffer size in Univocity > -

[jira] [Updated] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34768: - Affects Version/s: 3.0.2 > Respect the default input buffer size in Univocity >

[jira] [Created] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34768: Summary: Respect the default input buffer size in Univocity Key: SPARK-34768 URL: https://issues.apache.org/jira/browse/SPARK-34768 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-10697) Lift Calculation in Association Rule mining

2021-03-16 Thread Yashwanth Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303086#comment-17303086 ] Yashwanth Kumar edited comment on SPARK-10697 at 3/17/21, 4:36 AM: ---

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

2021-03-16 Thread Yashwanth Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303086#comment-17303086 ] Yashwanth Kumar commented on SPARK-10697: - Glad that the change proposed by me 5

[jira] [Resolved] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34767. -- Resolution: Incomplete > sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法 > --

[jira] [Commented] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303082#comment-17303082 ] Hyukjin Kwon commented on SPARK-34767: -- 1. Please use English to communicate other

[jira] [Resolved] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34504. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34504: --- Assignee: Wenchen Fan > Avoid unnecessary view resolving and remove the `performCheck` flag

[jira] [Created] (SPARK-34767) sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法

2021-03-16 Thread MrYang (Jira)
MrYang created SPARK-34767: -- Summary: sparkstreaming对接kafka数据,在idea程序上出现警告信息并卡住不动的解决办法 Key: SPARK-34767 URL: https://issues.apache.org/jira/browse/SPARK-34767 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-28220) join foldable condition not pushed down when parent filter is totally pushed down

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303058#comment-17303058 ] Apache Spark commented on SPARK-28220: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-28220) join foldable condition not pushed down when parent filter is totally pushed down

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303057#comment-17303057 ] Apache Spark commented on SPARK-28220: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303053#comment-17303053 ] Yang Jie commented on SPARK-34762: -- [~dongjoon]  It seems that the problem still exists

[jira] [Commented] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303022#comment-17303022 ] Apache Spark commented on SPARK-34766: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34766: Assignee: Apache Spark > Do not capture maven config for views >

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34766: Assignee: (was: Apache Spark) > Do not capture maven config for views > -

[jira] [Updated] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34766: Description: Due to the bad network, we always use the thirdparty maven repo to run test. e.g., {

[jira] [Updated] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34766: Environment: (was: Due to the bad network, we always use the thirdparty maven repo to run test

[jira] [Created] (SPARK-34766) Do not capture maven config for views

2021-03-16 Thread ulysses you (Jira)
ulysses you created SPARK-34766: --- Summary: Do not capture maven config for views Key: SPARK-34766 URL: https://issues.apache.org/jira/browse/SPARK-34766 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Description: Existing impl of standardization in linear models does *NOT* center the vectors by

[jira] [Updated] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-34765: - Issue Type: Umbrella (was: Improvement) > Linear Models standardization optimization >

[jira] [Resolved] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34714. -- Fix Version/s: 3.1.2 Resolution: Fixed > collect_list(struct()) fails when used

[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303009#comment-17303009 ] Takeshi Yamamuro commented on SPARK-34714: -- Ah, I've checked the latest branch-

[jira] [Created] (SPARK-34765) Linear Models standardization optimization

2021-03-16 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-34765: Summary: Linear Models standardization optimization Key: SPARK-34765 URL: https://issues.apache.org/jira/browse/SPARK-34765 Project: Spark Issue Type: Improv

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303001#comment-17303001 ] Nivas Umapathy edited comment on SPARK-34751 at 3/17/21, 12:53 AM: ---

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303001#comment-17303001 ] Nivas Umapathy edited comment on SPARK-34751 at 3/17/21, 12:52 AM: ---

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303001#comment-17303001 ] Nivas Umapathy commented on SPARK-34751: the schema is extracted from the same f

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302988#comment-17302988 ] Takeshi Yamamuro commented on SPARK-34751: -- Could you describe more to reproduc

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Affects Version/s: 3.1.1 > Parquet with invalid chars on column name reads double as nul

[jira] [Comment Edited] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302672#comment-17302672 ] Nivas Umapathy edited comment on SPARK-34751 at 3/16/21, 7:56 PM:

[jira] [Commented] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302796#comment-17302796 ] Dongjoon Hyun commented on SPARK-25935: --- Please let me know if the previous status

[jira] [Comment Edited] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302792#comment-17302792 ] Dongjoon Hyun edited comment on SPARK-25935 at 3/16/21, 6:38 PM: -

[jira] [Commented] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302792#comment-17302792 ] Dongjoon Hyun commented on SPARK-25935: --- I removed the `Fix Version = 3.0.0` from

[jira] [Updated] (SPARK-25935) Prevent null rows from JSON parser

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25935: -- Fix Version/s: (was: 3.0.0) > Prevent null rows from JSON parser > ---

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-03-16 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302777#comment-17302777 ] Shane Knapp commented on SPARK-34738: - i'll be doing this next tuesday (3/23) and te

[jira] [Created] (SPARK-34764) Propagate reason for executor loss to the UI

2021-03-16 Thread Holden Karau (Jira)
Holden Karau created SPARK-34764: Summary: Propagate reason for executor loss to the UI Key: SPARK-34764 URL: https://issues.apache.org/jira/browse/SPARK-34764 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302731#comment-17302731 ] Apache Spark commented on SPARK-34761: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34761: Assignee: Max Gekk (was: Apache Spark) > Add a day-time interval to a timestamp > --

[jira] [Assigned] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34761: Assignee: Apache Spark (was: Max Gekk) > Add a day-time interval to a timestamp > --

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302729#comment-17302729 ] Dongjoon Hyun commented on SPARK-34762: --- Thank you for reporting, [~LuciferYang] .

[jira] [Updated] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33428: -- Fix Version/s: (was: 3.2.0) > conv UDF returns incorrect value > -

[jira] [Reopened] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-33428: --- Assignee: (was: angerszhu) > conv UDF returns incorrect value > --

[jira] [Commented] (SPARK-33428) conv UDF returns incorrect value

2021-03-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302694#comment-17302694 ] Dongjoon Hyun commented on SPARK-33428: --- The commit is reverted. > conv UDF retur

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Nivas Umapathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302672#comment-17302672 ] Nivas Umapathy commented on SPARK-34751: I ran it on 3.1.1 and it still has the

[jira] [Commented] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302622#comment-17302622 ] Apache Spark commented on SPARK-34763: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302621#comment-17302621 ] Apache Spark commented on SPARK-34763: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34763: Assignee: Kousuke Saruta (was: Apache Spark) > col(), $"" and df("name") should handle q

[jira] [Assigned] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34763: Assignee: Apache Spark (was: Kousuke Saruta) > col(), $"" and df("name") should handle q

[jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34763: --- Summary: col(), $"" and df("name") should handle quoted column names properly. (was: col(),

[jira] [Created] (SPARK-34763) col(), $"" and df("name") should handle quoted column name properly.

2021-03-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34763: -- Summary: col(), $"" and df("name") should handle quoted column name properly. Key: SPARK-34763 URL: https://issues.apache.org/jira/browse/SPARK-34763 Project: Spa

[jira] [Commented] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302584#comment-17302584 ] Apache Spark commented on SPARK-34504: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34504: Assignee: (was: Apache Spark) > Avoid unnecessary view resolving and remove the `perf

[jira] [Assigned] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34504: Assignee: Apache Spark > Avoid unnecessary view resolving and remove the `performCheck` f

[jira] [Commented] (SPARK-34504) Avoid unnecessary view resolving and remove the `performCheck` flag

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302583#comment-17302583 ] Apache Spark commented on SPARK-34504: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-34762: - Description: PR with Scala 2.13 build failure includes  * [https://github.com/apache/spark/pull/31849]

[jira] [Resolved] (SPARK-34680) Spark hangs when out of diskspace

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34680. -- Resolution: Not A Problem > Spark hangs when out of diskspace > --

[jira] [Commented] (SPARK-34680) Spark hangs when out of diskspace

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302578#comment-17302578 ] Takeshi Yamamuro commented on SPARK-34680: -- Not enough information to reproduce

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Target Version/s: (was: 2.4.3) > Parquet with invalid chars on column name reads doubl

[jira] [Updated] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34751: - Fix Version/s: (was: 2.4.8) > Parquet with invalid chars on column name reads double

[jira] [Commented] (SPARK-34751) Parquet with invalid chars on column name reads double as null when a clean schema is applied

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302573#comment-17302573 ] Takeshi Yamamuro commented on SPARK-34751: -- Could you try newer Spark, e.g., 2.

[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302570#comment-17302570 ] Takeshi Yamamuro commented on SPARK-34714: -- I've checked that branch-3.1 still

[jira] [Updated] (SPARK-34694) Improve Spark SQL Source Filter to allow pushdown of filters span multiple columns

2021-03-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34694: - Component/s: (was: Spark Core) SQL > Improve Spark SQL Source Filte

[jira] [Updated] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-34661: - Description: {{OriginalType}} and {{DecimalMetadata}} has been marked as {{@Deprecated}} in new Parquet

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302544#comment-17302544 ] Yang Jie commented on SPARK-34762: -- Maven compilation seems not failed cc [~dongjoon]

[jira] [Created] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-34762: Summary: Many PR's Scala 2.13 build action failed Key: SPARK-34762 URL: https://issues.apache.org/jira/browse/SPARK-34762 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302502#comment-17302502 ] Apache Spark commented on SPARK-34759: -- User 'zengruios' has created a pull request

[jira] [Assigned] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34759: Assignee: (was: Apache Spark) > run JavaSparkSQLExample failed with Exception. >

[jira] [Commented] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302501#comment-17302501 ] Apache Spark commented on SPARK-34759: -- User 'zengruios' has created a pull request

[jira] [Assigned] (SPARK-34759) run JavaSparkSQLExample failed with Exception.

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34759: Assignee: Apache Spark > run JavaSparkSQLExample failed with Exception. > ---

[jira] [Commented] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302497#comment-17302497 ] Apache Spark commented on SPARK-34760: -- User 'zengruios' has created a pull request

[jira] [Assigned] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34760: Assignee: Apache Spark > run JavaSQLDataSourceExample failed with Exception in > runBasi

[jira] [Commented] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302496#comment-17302496 ] Apache Spark commented on SPARK-34760: -- User 'zengruios' has created a pull request

[jira] [Assigned] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34760: Assignee: (was: Apache Spark) > run JavaSQLDataSourceExample failed with Exception in

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Description: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). when excecute

[jira] [Updated] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-34760: Summary: run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample(). (was: run Jav

[jira] [Commented] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302439#comment-17302439 ] Apache Spark commented on SPARK-21449: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302438#comment-17302438 ] Apache Spark commented on SPARK-21449: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
Max Gekk created SPARK-34761: Summary: Add a day-time interval to a timestamp Key: SPARK-34761 URL: https://issues.apache.org/jira/browse/SPARK-34761 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34761) Add a day-time interval to a timestamp

2021-03-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34761: - Description: Support adding of DayTimeIntervalType values to TIMESTAMP values. (was: Support adding of

[jira] [Updated] (SPARK-34754) sparksql 'add jar' not support hdfs ha mode in k8s

2021-03-16 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-34754: -- Description: Submit app to K8S,  the executors meet exception  "java.net.UnknownHostException

[jira] [Created] (SPARK-34760) run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample().

2021-03-16 Thread zengrui (Jira)
zengrui created SPARK-34760: --- Summary: run JavaSparkSQLExample failed with Exception in runBasicDataSourceExample(). Key: SPARK-34760 URL: https://issues.apache.org/jira/browse/SPARK-34760 Project: Spark

[jira] [Assigned] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34757: Assignee: (was: Apache Spark) > Spark submit should ignore cache for SNAPSHOT depende

[jira] [Commented] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302373#comment-17302373 ] Apache Spark commented on SPARK-34757: -- User 'bozhang2820' has created a pull reque

[jira] [Assigned] (SPARK-34757) Spark submit should ignore cache for SNAPSHOT dependencies

2021-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34757: Assignee: Apache Spark > Spark submit should ignore cache for SNAPSHOT dependencies > ---

  1   2   >