[
https://issues.apache.org/jira/browse/SPARK-27420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jerome Gagnon updated SPARK-27420:
--
Priority: Major (was: Minor)
> KinesisInputDStream should expose a way to disable CloudWatch
Eric Maynard created SPARK-27421:
Summary: RuntimeException when querying a view on a partitioned
parquet table
Key: SPARK-27421
URL: https://issues.apache.org/jira/browse/SPARK-27421
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813883#comment-16813883
]
Shivu Sondur commented on SPARK-27421:
--
i am checking this issue
> RuntimeException when querying
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813880#comment-16813880
]
shane knapp edited comment on SPARK-27389 at 4/9/19 10:54 PM:
--
btw, the
[
https://issues.apache.org/jira/browse/SPARK-27387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27387.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Fixed in
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp resolved SPARK-27389.
-
Resolution: Fixed
> pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"
>
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813896#comment-16813896
]
Bryan Cutler commented on SPARK-27389:
--
Thanks [~shaneknapp] for the fix. I couldn't come up with
Jerome Gagnon created SPARK-27420:
-
Summary: KinesisInputDStream should expose a way to disable
CloudWatch metrics
Key: SPARK-27420
URL: https://issues.apache.org/jira/browse/SPARK-27420
Project:
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813812#comment-16813812
]
shane knapp commented on SPARK-27389:
-
ok, this should be fixed now... i got all the workers to
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-25348:
-
Assignee: Weichen Xu
> Data source for binary files
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp reassigned SPARK-27389:
---
Assignee: shane knapp
> pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813812#comment-16813812
]
shane knapp edited comment on SPARK-27389 at 4/9/19 9:09 PM:
-
ok, this
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813873#comment-16813873
]
shane knapp commented on SPARK-27389:
-
we are most definitely good to go... this build is running
Maxim Gekk created SPARK-27422:
--
Summary: CurrentDate should return local date
Key: SPARK-27422
URL: https://issues.apache.org/jira/browse/SPARK-27422
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-25348:
--
Description:
It would be useful to have a data source implementation for binary files, which
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813832#comment-16813832
]
Xiangrui Meng commented on SPARK-25348:
---
Updated the description and proposed APIs.
> Data source
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-25348:
--
Description:
It would be useful to have a data source implementation for binary files, which
Maxim Gekk created SPARK-27423:
--
Summary: Cast DATE to/from TIMESTAMP according to SQL standard
Key: SPARK-27423
URL: https://issues.apache.org/jira/browse/SPARK-27423
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27401.
---
Resolution: Fixed
Assignee: Maxim Gekk
Fix Version/s: 3.0.0
This is
[
https://issues.apache.org/jira/browse/SPARK-27357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk resolved SPARK-27357.
Resolution: Not A Problem
> Cast timestamps to/from dates independently from time zones
>
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813834#comment-16813834
]
Xiangrui Meng commented on SPARK-25348:
---
Sampling could be supported later.
> Data source for
[
https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Maynard updated SPARK-27421:
-
Environment: Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server
VM, Java 1.8.0_141)
>
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813880#comment-16813880
]
shane knapp commented on SPARK-27389:
-
btw, the total impact of this problem "only" failed 73 builds
[
https://issues.apache.org/jira/browse/SPARK-27410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27410.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24320
[
https://issues.apache.org/jira/browse/SPARK-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814061#comment-16814061
]
Ruslan Dautkhanov commented on SPARK-15719:
---
[~lian cheng] quick question on this part from
[
https://issues.apache.org/jira/browse/SPARK-27410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-27410:
--
Docs Text: In Spark 3.0, the methods getRuns and setRuns in
org.apache.spark.mllib.cluster.KMeans
[
https://issues.apache.org/jira/browse/SPARK-27412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chendi.Xue updated SPARK-27412:
---
Labels: core (was: shuffle)
> Add a new shuffle manager to use Persistent Memory as shuffle and
[
https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813158#comment-16813158
]
ketan kunde commented on SPARK-9858:
[~aroberts] : did this exchangecordinator suite test cases pass
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813094#comment-16813094
]
Gabor Somogyi commented on SPARK-27409:
---
It would definitely help if you can provide your
[
https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813156#comment-16813156
]
Martin Junghanns commented on SPARK-25994:
--
[~kanjilal] Thanks for the initial comments on the
Chendi.Xue created SPARK-27412:
--
Summary: Add a new shuffle manager to use Persistent Memory as
shuffle and spilling storage
Key: SPARK-27412
URL: https://issues.apache.org/jira/browse/SPARK-27412
Mingcong Han created SPARK-27411:
Summary: DataSourceV2Strategy should not eliminate subquery
Key: SPARK-27411
URL: https://issues.apache.org/jira/browse/SPARK-27411
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chendi.Xue updated SPARK-27412:
---
External issue URL: (was: https://github.com/apache/spark/pull/24322)
> Add a new shuffle manager
[
https://issues.apache.org/jira/browse/SPARK-27412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chendi.Xue updated SPARK-27412:
---
External issue URL: https://github.com/apache/spark/pull/24322
> Add a new shuffle manager to use
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813126#comment-16813126
]
ketan kunde commented on SPARK-20984:
-
Hi
I understand that ORC file format is not well read on
[
https://issues.apache.org/jira/browse/SPARK-27411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27411:
---
Assignee: Mingcong Han
> DataSourceV2Strategy should not eliminate subquery
>
[
https://issues.apache.org/jira/browse/SPARK-27411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27411.
-
Resolution: Fixed
Issue resolved by pull request 24321
[
https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813195#comment-16813195
]
Valeria Vasylieva commented on SPARK-20597:
---
[~jlaskowski] kindly ask you to review the PR, so
[
https://issues.apache.org/jira/browse/SPARK-27415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo closed SPARK-27415.
---
> UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines
> have different Oops size
>
[
https://issues.apache.org/jira/browse/SPARK-27415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo resolved SPARK-27415.
-
Resolution: Invalid
duplicate one due to network issue..
> UnsafeMapData & UnsafeArrayData Kryo
[
https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813495#comment-16813495
]
yangpengyu commented on SPARK-11293:
I hit the sam problem when I run TPCH test on spark1.6.0.
my
[
https://issues.apache.org/jira/browse/SPARK-27417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangpengyu resolved SPARK-27417.
Resolution: Fixed
> CLONE - ExternalSorter and ExternalAppendOnlyMap should free shuffle memory
[
https://issues.apache.org/jira/browse/SPARK-27417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangpengyu closed SPARK-27417.
--
> CLONE - ExternalSorter and ExternalAppendOnlyMap should free shuffle memory
> in their stop() methods
[
https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813511#comment-16813511
]
Brandon Perry commented on SPARK-25150:
---
[~srowen], I ran into this situation yesterday as well,
[
https://issues.apache.org/jira/browse/SPARK-27394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-27394.
Resolution: Fixed
Fix Version/s: 3.0.0
> The staleness of UI may last minutes or
peng bo created SPARK-27416:
---
Summary: UnsafeMapData & UnsafeArrayData Kryo serialization breaks
when two machines have different Oops size
Key: SPARK-27416
URL: https://issues.apache.org/jira/browse/SPARK-27416
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27361:
-
Assignee: Thomas Graves
> YARN support for GPU-aware scheduling
>
peng bo created SPARK-27415:
---
Summary: UnsafeMapData & UnsafeArrayData Kryo serialization breaks
when two machines have different Oops size
Key: SPARK-27415
URL: https://issues.apache.org/jira/browse/SPARK-27415
yangpengyu created SPARK-27417:
--
Summary: CLONE - ExternalSorter and ExternalAppendOnlyMap should
free shuffle memory in their stop() methods
Key: SPARK-27417
URL: https://issues.apache.org/jira/browse/SPARK-27417
[
https://issues.apache.org/jira/browse/SPARK-27412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chendi.Xue updated SPARK-27412:
---
Attachment: PmemShuffleManager-DesignDoc.pdf
> Add a new shuffle manager to use Persistent Memory
Genmao Yu created SPARK-27413:
-
Summary: Keep the same epoch pace between driver and executor.
Key: SPARK-27413
URL: https://issues.apache.org/jira/browse/SPARK-27413
Project: Spark
Issue Type:
Wenchen Fan created SPARK-27414:
---
Summary: make it clear that date type is timezone independent
Key: SPARK-27414
URL: https://issues.apache.org/jira/browse/SPARK-27414
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813554#comment-16813554
]
Sean Owen commented on SPARK-25150:
---
What happens on master, and what happens if you run the SQL query
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813620#comment-16813620
]
shane knapp commented on SPARK-27389:
-
ok, i am going to go all cowboy on this and manually update:
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813625#comment-16813625
]
shane knapp commented on SPARK-27389:
-
done.
{noformat}
$ pssh -h jenkins_workers.txt "cp
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813625#comment-16813625
]
shane knapp edited comment on SPARK-27389 at 4/9/19 5:08 PM:
-
done.
Gengliang Wang created SPARK-27418:
--
Summary: Migrate Parquet to File Data Source V2
Key: SPARK-27418
URL: https://issues.apache.org/jira/browse/SPARK-27418
Project: Spark
Issue Type: Task
Shixiong Zhu created SPARK-27419:
Summary: When setting spark.executor.heartbeatInterval to a value
less than 1 seconds, it will always fail
Key: SPARK-27419
URL: https://issues.apache.org/jira/browse/SPARK-27419
58 matches
Mail list logo
