Anton Daitche created SPARK-30632:
-
Summary: to_timestamp() doesn't work with certain timezones
Key: SPARK-30632
URL: https://issues.apache.org/jira/browse/SPARK-30632
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Cording updated SPARK-30633:
Description:
If the seed for xxHash is not an integer the generated code does not
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022850#comment-17022850
]
Dongjoon Hyun edited comment on SPARK-30421 at 1/24/20 10:44 AM:
-
While
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022850#comment-17022850
]
Dongjoon Hyun commented on SPARK-30421:
---
While rethinking about this, the original column's index
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022900#comment-17022900
]
Tobias Hermann commented on SPARK-30421:
[~dongjoon] I'm glad we are aligned now. :)
For future
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022869#comment-17022869
]
weiwenda commented on SPARK-30617:
--
[~dongjoon] Thanks for your advise. I will write Fix versions /
[
https://issues.apache.org/jira/browse/SPARK-30634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yurii Oleynikov updated SPARK-30634:
Description:
Hi ,
I have an application that makes Arbitrary Stateful Processing in
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022835#comment-17022835
]
Dongjoon Hyun commented on SPARK-30421:
---
Nope. Your example is different. I illustrated what I
[
https://issues.apache.org/jira/browse/SPARK-30635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022966#comment-17022966
]
jobit mathew commented on SPARK-30635:
--
I will work on this
> Document PARTITIONED BY Clause of
jobit mathew created SPARK-30635:
Summary: Document PARTITIONED BY Clause of CREATE statement in
SQL Reference
Key: SPARK-30635
URL: https://issues.apache.org/jira/browse/SPARK-30635
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yurii Oleynikov updated SPARK-30634:
Attachment: Capture1.PNG
> Delta Merge and Arbitrary Stateful Processing in Structured
Yurii Oleynikov created SPARK-30634:
---
Summary: Delta Merge and Arbitrary Stateful Processing in
Structured streaming (foreachBatch)
Key: SPARK-30634
URL: https://issues.apache.org/jira/browse/SPARK-30634
Patrick Cording created SPARK-30633:
---
Summary: Codegen fails when xxHash seed is not an integer
Key: SPARK-30633
URL: https://issues.apache.org/jira/browse/SPARK-30633
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022969#comment-17022969
]
Rahul Kumar Challapalli commented on SPARK-30218:
-
[~dongjoon] I am not sure but I was
[
https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shane Knapp updated SPARK-30637:
Parent: SPARK-23435
Issue Type: Sub-task (was: Task)
> upgrade testthat on jenkins
Shane Knapp created SPARK-30637:
---
Summary: upgrade testthat on jenkins workers to 2.0.0
Key: SPARK-30637
URL: https://issues.apache.org/jira/browse/SPARK-30637
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023202#comment-17023202
]
Shane Knapp commented on SPARK-30637:
-
ok, i was able to easily uninstall 1.0.2 and reinstall 2.0.0
[
https://issues.apache.org/jira/browse/SPARK-29924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-29924:
-
Assignee: Dongjoon Hyun
> Document Arrow requirement in JDK9+
>
[
https://issues.apache.org/jira/browse/SPARK-29924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29924.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27356
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30626:
--
Summary: Add SPARK_APPLICATION_ID into driver pod env (was: [K8S] Spark
driver pod doesn't
[
https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023250#comment-17023250
]
Shane Knapp commented on SPARK-28900:
-
FYI: i will be OOO next week (mon-thur) with VERY limited
[
https://issues.apache.org/jira/browse/SPARK-29924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29924:
--
Description: At least, we need to mention
`io.netty.tryReflectionSetAccessible=true` is
[
https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023224#comment-17023224
]
Dongjoon Hyun commented on SPARK-28900:
---
Hi, All.
Can we restart this before `branch-3.0` cut
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30626:
--
Affects Version/s: (was: 2.4.4)
> Add SPARK_APPLICATION_ID into driver pod env
>
[
https://issues.apache.org/jira/browse/SPARK-30630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30630.
---
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-30630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30630:
-
Assignee: Huaxin Gao
> Deprecate numTrees in GBT
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-30630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30630:
--
Summary: Deprecate numTrees in GBT at 2.4.5 and remove it at 3.0.0 (was:
Deprecate numTrees
Dongjoon Hyun created SPARK-30639:
-
Summary: Upgrade Jersey to 2.30
Key: SPARK-30639
URL: https://issues.apache.org/jira/browse/SPARK-30639
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28704:
--
Target Version/s: 3.1.0
> Test backward compatibility on JDK9+ once we have a version
[
https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28704:
--
Labels: 3.1.0 (was: )
> Test backward compatibility on JDK9+ once we have a version supports
[
https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28704:
--
Parent: (was: SPARK-29194)
Issue Type: Test (was: Sub-task)
> Test backward
[
https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28704:
--
Labels: (was: 3.1.0)
> Test backward compatibility on JDK9+ once we have a version supports
[
https://issues.apache.org/jira/browse/SPARK-30632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023263#comment-17023263
]
Maxim Gekk commented on SPARK-30632:
Spark 2.4 and earlier versions use SimpleDateFormat to parse
Thomas Graves created SPARK-30638:
-
Summary: add resources as parameter to the PluginContext
Key: SPARK-30638
URL: https://issues.apache.org/jira/browse/SPARK-30638
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-25382:
-
Docs Text: In Spark 3.0.0, the deprecated ImageSchema class and its
readImages methods have
[
https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-25382:
-
Docs Text: In Spark 3.0.0, the deprecated ImageSchema class and its
readImages methods have
[
https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023194#comment-17023194
]
Shane Knapp commented on SPARK-23435:
-
since we can't have different R environments for different
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30626.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27347
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30626:
-
Assignee: Jiaxin Shan
> [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID env
>
[
https://issues.apache.org/jira/browse/SPARK-30632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023263#comment-17023263
]
Maxim Gekk edited comment on SPARK-30632 at 1/24/20 9:12 PM:
-
Spark 2.4 and
[
https://issues.apache.org/jira/browse/SPARK-30639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30639:
--
Parent: SPARK-29194
Issue Type: Sub-task (was: Improvement)
> Upgrade Jersey to 2.30
[
https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-30636:
---
Assignee: Burak Yavuz
> Unable to add packages on spark-packages.org
>
[
https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-30636:
Affects Version/s: (was: 3.0.0)
2.4.4
> Unable to add packages on
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023036#comment-17023036
]
Wenchen Fan commented on SPARK-30612:
-
I think the example from [~brkyvz] is right. The column name
Xiao Li created SPARK-30636:
---
Summary: Unable to add packages on spark-packages.org
Key: SPARK-30636
URL: https://issues.apache.org/jira/browse/SPARK-30636
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023118#comment-17023118
]
Dongjoon Hyun edited comment on SPARK-30218 at 1/24/20 5:10 PM:
No, this
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023118#comment-17023118
]
Dongjoon Hyun commented on SPARK-30218:
---
No, this is fixed. The following is the same case. User
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023118#comment-17023118
]
Dongjoon Hyun edited comment on SPARK-30218 at 1/24/20 5:10 PM:
No, this
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30617.
---
Resolution: Duplicate
> Is there any possible that spark no longer restrict enumerate types
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-30617:
---
> Is there any possible that spark no longer restrict enumerate types of
>
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-30617.
-
> Is there any possible that spark no longer restrict enumerate types of
>
[
https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29721.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26978
[
https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-29721:
-
Assignee: L. C. Hsieh
> Spark SQL reads unnecessary nested fields from Parquet after
[
https://issues.apache.org/jira/browse/SPARK-25330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25330:
--
Fix Version/s: 2.3.2
> Permission issue after upgrade hadoop version to 2.7.7
>
[
https://issues.apache.org/jira/browse/SPARK-25330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25330:
-
Assignee: Yuming Wang
> Permission issue after upgrade hadoop version to 2.7.7
>
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023439#comment-17023439
]
Mathew Wicks commented on SPARK-28921:
--
[~dongjoon], it's just very bad practice to not update all
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023019#comment-17023019
]
Jeff Evans commented on SPARK-19248:
I'm not a Spark maintainer, so can't answer definitively.
[
https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-30636:
Priority: Critical (was: Blocker)
> Unable to add packages on spark-packages.org
>
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
weiwenda resolved SPARK-30617.
--
Resolution: Pending Closed
> Is there any possible that spark no longer restrict enumerate types of
[
https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29721:
--
Summary: Spark SQL reads unnecessary nested fields after using explode
(was: Spark SQL reads
[
https://issues.apache.org/jira/browse/SPARK-25330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-25330.
---
Resolution: Fixed
> Permission issue after upgrade hadoop version to 2.7.7
>
[
https://issues.apache.org/jira/browse/SPARK-25330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25330:
--
Fix Version/s: 2.4.0
> Permission issue after upgrade hadoop version to 2.7.7
>
[
https://issues.apache.org/jira/browse/SPARK-27117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-27117:
Summary: current_date/current_timestamp should be reserved keywords in ansi
parser mode (was:
[
https://issues.apache.org/jira/browse/SPARK-27117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023317#comment-17023317
]
Reynold Xin commented on SPARK-27117:
-
I changed the title to make it more clear to end users what's
[
https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023340#comment-17023340
]
Reynold Xin commented on SPARK-29189:
-
This is great, but how would users know when to set this?
[
https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023354#comment-17023354
]
Dongjoon Hyun commented on SPARK-28900:
---
Thank you for update.
> Test Pyspark, SparkR on JDK 11
Bryan Cutler created SPARK-30640:
Summary: Prevent unnessary copies of data in Arrow to Pandas
conversion with Timestamps
Key: SPARK-30640
URL: https://issues.apache.org/jira/browse/SPARK-30640
67 matches
Mail list logo