[
https://issues.apache.org/jira/browse/SPARK-25474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621541#comment-16621541
]
sandeep katta commented on SPARK-25474:
---
okay I would like to check this issue and
[
https://issues.apache.org/jira/browse/SPARK-25474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621539#comment-16621539
]
Ayush Anubhava commented on SPARK-25474:
It behaves the same even if fall back t
[
https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621538#comment-16621538
]
Wenchen Fan commented on SPARK-25475:
-
I'd suggest one benchmark one PR.
> Refactor
[
https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621536#comment-16621536
]
Yuming Wang commented on SPARK-25475:
-
[~dongjoon] How should we create pull request
[
https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25475:
--
Description:
This is an umbrella issue to refactor all benchmarks to use a common style
using
[
https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25475:
--
Description:
This is an umbrella issue to refactor all benchmarks to use a common style
using
[
https://issues.apache.org/jira/browse/SPARK-25474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621535#comment-16621535
]
sandeep katta commented on SPARK-25474:
---
what is the behavior for spark.sql.statis
Dongjoon Hyun created SPARK-25475:
-
Summary: Refactor all benchmark to save the result as a separate
file
Key: SPARK-25475
URL: https://issues.apache.org/jira/browse/SPARK-25475
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25339:
--
Issue Type: Sub-task (was: Test)
Parent: SPARK-25475
> Refactor FilterPushdownBenchma
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621512#comment-16621512
]
Jungtaek Lim commented on SPARK-10816:
--
WIP version of patch: [https://github.com/a
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-10816:
-
Attachment: SPARK-10816 Support session window natively.pdf
> EventTime based sessionization
> -
[
https://issues.apache.org/jira/browse/SPARK-25339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-25339:
---
Assignee: Yuming Wang
> Refactor FilterPushdownBenchmark to use main method
> -
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-10816:
-
Attachment: (was: SPARK-10816_ Support session window natively.pdf)
> EventTime based sessio
[
https://issues.apache.org/jira/browse/SPARK-25339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25339.
-
Resolution: Fixed
Fix Version/s: 2.5.0
Issue resolved by pull request 22443
[https://gith
Ayush Anubhava created SPARK-25474:
--
Summary: Size in bytes of the query is coming in EB in case of
parquet datasource
Key: SPARK-25474
URL: https://issues.apache.org/jira/browse/SPARK-25474
Project:
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621497#comment-16621497
]
Jungtaek Lim commented on SPARK-10816:
--
Just attached the doc. I also have shareabl
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-10816:
-
Attachment: SPARK-10816_ Support session window natively.pdf
> EventTime based sessionization
>
[
https://issues.apache.org/jira/browse/SPARK-23648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-23648.
--
Resolution: Fixed
Assignee: Huaxin Gao
Fix Version/s: 2.5.0
> extend hint synt
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621483#comment-16621483
]
Jungtaek Lim commented on SPARK-10816:
--
I would like to propose native support on s
[
https://issues.apache.org/jira/browse/SPARK-25470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25470.
--
Resolution: Duplicate
> Eval method of Concat expression should call pattern matching only onc
[
https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621462#comment-16621462
]
Hyukjin Kwon commented on SPARK-25469:
--
Please fill the JIRA description
> Eval me
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621452#comment-16621452
]
Bruce Robbins commented on SPARK-23715:
---
Hi [~rxin],
Thanks for following up with
[
https://issues.apache.org/jira/browse/SPARK-25473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-25473:
-
Summary: PySpark ForeachWriter test fails on Python 3.6 and macOS High
Serria (was: PySpark For
Hyukjin Kwon created SPARK-25473:
Summary: PySpark ForeachWriter test fails on Python 3.6 and mocOS
High Serria
Key: SPARK-25473
URL: https://issues.apache.org/jira/browse/SPARK-25473
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25457.
-
Resolution: Fixed
Fix Version/s: 2.5.0
Issue resolved by pull request 22465
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-25457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-25457:
---
Assignee: Marco Gaido
> IntegralDivide (div) should not always return long
> --
[
https://issues.apache.org/jira/browse/SPARK-25432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621416#comment-16621416
]
Kazuaki Ishizaki commented on SPARK-25432:
--
nit: description seems to be in {{e
[
https://issues.apache.org/jira/browse/SPARK-25437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-25437:
-
Comment: was deleted
(was: Is such a feature for major release, not for maintenance rele
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621410#comment-16621410
]
Imran Rashid commented on SPARK-24523:
--
When you say the SparkContext is automatica
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621405#comment-16621405
]
Reynold Xin commented on SPARK-23715:
-
Also I reject the notion that the old behavio
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621395#comment-16621395
]
Reynold Xin commented on SPARK-23715:
-
[~bersprockets] i think we should revert the
[
https://issues.apache.org/jira/browse/SPARK-20598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621396#comment-16621396
]
holdenk commented on SPARK-20598:
-
Huh that's interesting.I suspect that could be we're
[
https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621391#comment-16621391
]
holdenk commented on SPARK-25467:
-
cc [~bryanc]
> Python date/datetime objects in dataf
[
https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk reassigned SPARK-14352:
---
Assignee: zhengruifeng
> approxQuantile should support multi columns
>
[
https://issues.apache.org/jira/browse/SPARK-17602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621389#comment-16621389
]
holdenk commented on SPARK-17602:
-
Did we end up going anywhere with this?
> PySpark -
[
https://issues.apache.org/jira/browse/SPARK-25471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25471.
--
Resolution: Fixed
Fix Version/s: 2.4.0
3.0.0
2.3.3
[
https://issues.apache.org/jira/browse/SPARK-25471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-25471:
Assignee: Bryan Cutler
> Fix tests for Python 3.6 with Pandas 0.23+
> ---
[
https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk resolved SPARK-14352.
-
Resolution: Fixed
Target Version/s: 2.2.0
> approxQuantile should support multi columns
>
[
https://issues.apache.org/jira/browse/SPARK-25472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-25472:
---
Assignee: Burak Yavuz
> Structured Streaming query.stop() doesn't always stop gracefully
>
[
https://issues.apache.org/jira/browse/SPARK-25425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25425:
--
Fix Version/s: (was: 2.5.0)
2.4.0
> Extra options must overwrite sessio
[
https://issues.apache.org/jira/browse/SPARK-24309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621317#comment-16621317
]
Umayr Hassan commented on SPARK-24309:
--
Hi folks. I'm not sure this - or a similar
[
https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk updated SPARK-25021:
Fix Version/s: 2.4.0
> Add spark.executor.pyspark.memory support to Kubernetes
> -
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Umayr Hassan updated SPARK-24523:
-
Environment:
EMR 5.14.0, S3/HDFS inputs and outputs; EMR 5.17
was:
EMR 5.14.0, S3/HD
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Umayr Hassan updated SPARK-24523:
-
Affects Version/s: 2.3.1
> InterruptedException when closing SparkContext
>
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621281#comment-16621281
]
Umayr Hassan commented on SPARK-24523:
--
[~dongjoon] We still see this in Spark 2.3.
[
https://issues.apache.org/jira/browse/SPARK-24360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24360:
--
Target Version/s: 2.5.0
> Support Hive 3.1 metastore
> --
>
>
Burak Yavuz created SPARK-25472:
---
Summary: Structured Streaming query.stop() doesn't always stop
gracefully
Key: SPARK-25472
URL: https://issues.apache.org/jira/browse/SPARK-25472
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-25471:
Assignee: (was: Bryan Cutler)
> Fix tests for Python 3.6 with Pandas 0.23+
>
Bryan Cutler created SPARK-25471:
Summary: Fix tests for Python 3.6 with Pandas 0.23+
Key: SPARK-25471
URL: https://issues.apache.org/jira/browse/SPARK-25471
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621218#comment-16621218
]
t oo commented on SPARK-24360:
--
bump
> Support Hive 3.1 metastore
> --
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621125#comment-16621125
]
Bruce Robbins commented on SPARK-25164:
---
{quote}I am thinking if it's feasible to
[
https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-25449:
-
Issue Type: Improvement (was: Task)
> Don't send zero accumulators in heartbeats
>
[
https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-25449:
-
Target Version/s: (was: 2.5.0)
> Don't send zero accumulators in heartbeats
>
[
https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue resolved SPARK-15420.
---
Resolution: Won't Fix
> Repartition and sort before Parquet writes
> ---
[
https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated SPARK-15420:
--
Target Version/s: (was: 2.4.0)
> Repartition and sort before Parquet writes
> --
Marek Novotny created SPARK-25469:
-
Summary: Eval method of Concat expression should call pattern
matching only once
Key: SPARK-25469
URL: https://issues.apache.org/jira/browse/SPARK-25469
Project: Sp
Marek Novotny created SPARK-25470:
-
Summary: Eval method of Concat expression should call pattern
matching only once
Key: SPARK-25470
URL: https://issues.apache.org/jira/browse/SPARK-25470
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-25414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25414.
-
Resolution: Fixed
Fix Version/s: 2.5.0
> make it clear that the numRows metrics should be
[
https://issues.apache.org/jira/browse/SPARK-25468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhruve Ashar updated SPARK-25468:
-
Attachment: SparkHistoryServer.png
> Highlight current page index in the history server
> --
[
https://issues.apache.org/jira/browse/SPARK-25468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhruve Ashar updated SPARK-25468:
-
Description:
Spark History Server Web UI should highlight the current page index selected
for b
[
https://issues.apache.org/jira/browse/SPARK-25468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhruve Ashar updated SPARK-25468:
-
Description:
Spark History Server Web UI should highlight the current page index selected
for b
Dhruve Ashar created SPARK-25468:
Summary: Highlight current page index in the history server
Key: SPARK-25468
URL: https://issues.apache.org/jira/browse/SPARK-25468
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620809#comment-16620809
]
Rob Vesse commented on SPARK-24434:
---
Started a mailing list thread re: the limitations
[
https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David V. Hill updated SPARK-25467:
--
Description:
When Dataframes contains datetime.date or datetime.datetime instances and
toJSON
[
https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619236#comment-16619236
]
Deepanker edited comment on SPARK-20236 at 9/19/18 3:03 PM:
[
https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David V. Hill updated SPARK-25467:
--
Description:
When Dataframes contains datetime.date or datetime.datetime objects and
toJSON()
David V. Hill created SPARK-25467:
-
Summary: Python date/datetime objects in dataframes increment by 1
day when converted to JSON
Key: SPARK-25467
URL: https://issues.apache.org/jira/browse/SPARK-25467
[
https://issues.apache.org/jira/browse/SPARK-25422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620666#comment-16620666
]
Imran Rashid commented on SPARK-25422:
--
I'm still looking at this, but so far haven
[
https://issues.apache.org/jira/browse/SPARK-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620605#comment-16620605
]
Takeshi Yamamuro commented on SPARK-12978:
--
yea, I think so and we need to disc
[
https://issues.apache.org/jira/browse/SPARK-25466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620575#comment-16620575
]
Patrick McGloin commented on SPARK-25466:
-
[~tdas] I am happy to update the doc
Patrick McGloin created SPARK-25466:
---
Summary: Documentation does not specify how to set fafka consumer
cache capacity for SS
Key: SPARK-25466
URL: https://issues.apache.org/jira/browse/SPARK-25466
Gengliang Wang created SPARK-25465:
--
Summary: Refactor Parquet test suites in project Hive
Key: SPARK-25465
URL: https://issues.apache.org/jira/browse/SPARK-25465
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanta Sen updated SPARK-25464:
-
Description:
Create Database.
CREATE (DATABASE|SCHEMA) [IF NOT EXISTS] db_name [COMMENT comment
[
https://issues.apache.org/jira/browse/SPARK-25358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25358.
-
Resolution: Fixed
Fix Version/s: 2.5.0
Issue resolved by pull request 22355
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-25358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-25358:
---
Assignee: Takeshi Yamamuro
> MutableProjection supports fallback to an interpreted mode
> -
[
https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620489#comment-16620489
]
sandeep katta commented on SPARK-25464:
---
I have raised the PR https://github.com/a
[
https://issues.apache.org/jira/browse/SPARK-24777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620488#comment-16620488
]
Gengliang Wang commented on SPARK-24777:
PR for this task: https://github.com/ap
[
https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanta Sen updated SPARK-25464:
-
Description:
Create Database.
CREATE (DATABASE|SCHEMA) [IF NOT EXISTS] db_name [COMMENT comment
Sushanta Sen created SPARK-25464:
Summary: Dropping database can remove the hive warehouse directory
contents
Key: SPARK-25464
URL: https://issues.apache.org/jira/browse/SPARK-25464
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620476#comment-16620476
]
Yuming Wang commented on SPARK-20937:
-
User 'seancxmao' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620468#comment-16620468
]
Takeshi Yamamuro commented on SPARK-20937:
--
+1, too. Do you have time to write
[
https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620460#comment-16620460
]
Takeshi Yamamuro commented on SPARK-25462:
--
You should first ask in the spark-u
[
https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-25462.
--
Resolution: Invalid
> hive on spark - got a weird output when count(*) from this scri
[
https://issues.apache.org/jira/browse/SPARK-25331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620454#comment-16620454
]
Mihaly Toth commented on SPARK-25331:
-
I have updated the PR with a potential soluti
Herman van Hovell created SPARK-25463:
-
Summary: Make sure single expression can parse sort order
Key: SPARK-25463
URL: https://issues.apache.org/jira/browse/SPARK-25463
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-23899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620230#comment-16620230
]
Georg Heiler commented on SPARK-23899:
--
What about repartitioning by complex types,
86 matches
Mail list logo