[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29361:
-
Component/s: (was: Spark Core)
SQL
> Enable streaming source support on
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29361:
-
Summary: Enable DataFrame with streaming source support on DSv1(was:
Enable streaming
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944987#comment-16944987
]
Jungtaek Lim commented on SPARK-29361:
--
The plan for now is overloading below methods marked as
Jungtaek Lim created SPARK-29361:
Summary: Enable streaming source support on DSv1
Key: SPARK-29361
URL: https://issues.apache.org/jira/browse/SPARK-29361
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944984#comment-16944984
]
Kangtian commented on SPARK-29267:
--
[~hyukjin.kwon]
Just finish when timeout, we don't need final
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kangtian updated SPARK-29267:
-
Attachment: image-2019-10-05-12-38-52-039.png
> rdd.countApprox should stop when 'timeout'
>
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kangtian updated SPARK-29267:
-
Attachment: image-2019-10-05-12-37-22-927.png
> rdd.countApprox should stop when 'timeout'
>
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kangtian updated SPARK-29267:
-
Attachment: image-2019-10-05-12-38-26-867.png
> rdd.countApprox should stop when 'timeout'
>
[
https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944927#comment-16944927
]
L. C. Hsieh commented on SPARK-29358:
-
And I also concern that it is more far away from SQL union.
[
https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944899#comment-16944899
]
L. C. Hsieh commented on SPARK-29358:
-
My concern is it breaks current behavior of unionByName.
>
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944879#comment-16944879
]
Sean R. Owen edited comment on SPARK-27681 at 10/4/19 10:33 PM:
I looked
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944879#comment-16944879
]
Sean R. Owen commented on SPARK-27681:
--
I looked at this one more time today after clearing out
[
https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-28813.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25885
[
https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-28813:
-
Priority: Minor (was: Major)
> Document SHOW CREATE TABLE in SQL Reference.
>
[
https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-28813:
Assignee: Huaxin Gao
> Document SHOW CREATE TABLE in SQL Reference.
>
[
https://issues.apache.org/jira/browse/SPARK-29108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29108:
--
Fix Version/s: (was: 3.0.0)
> Add window.sql - Part 2
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-29109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29109:
--
Fix Version/s: (was: 3.0.0)
> Add window.sql - Part 3
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-29110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29110:
--
Fix Version/s: (was: 3.0.0)
> Add window.sql - Part 4
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-29107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29107:
--
Fix Version/s: (was: 3.0.0)
> Add window.sql - Part 1
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29323:
--
Affects Version/s: (was: 2.4.4)
3.0.0
> Add tooltip for The
[
https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944827#comment-16944827
]
Dongjoon Hyun commented on SPARK-29323:
---
Hi, [~liucht-inspur]. Thank you for creating a JIRA, but
[
https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29323:
--
Fix Version/s: (was: 2.4.4)
> Add tooltip for The Executors Tab's column names in the
[
https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944826#comment-16944826
]
Dongjoon Hyun commented on SPARK-29225:
---
Hi, [~angerszhuuu]. Please use `3.0.0` for the
[
https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29225:
--
Priority: Minor (was: Major)
> Spark SQL 'DESC FORMATTED TABLE' show different format with
[
https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29225:
--
Affects Version/s: (was: 2.4.0)
> Spark SQL 'DESC FORMATTED TABLE' show different format
[
https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944822#comment-16944822
]
Maxim Gekk commented on SPARK-25440:
[~shashidha...@gmail.com] Call
[
https://issues.apache.org/jira/browse/SPARK-29360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944821#comment-16944821
]
Huaxin Gao commented on SPARK-29360:
I will submit a PR soon.
> PySpark FPGrowthModel supports
Huaxin Gao created SPARK-29360:
--
Summary: PySpark FPGrowthModel supports getter/setter
Key: SPARK-29360
URL: https://issues.apache.org/jira/browse/SPARK-29360
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944817#comment-16944817
]
Dongjoon Hyun edited comment on SPARK-25753 at 10/4/19 8:51 PM:
This is
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25753:
--
Fix Version/s: 2.4.5
> binaryFiles broken for small files
>
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944817#comment-16944817
]
Dongjoon Hyun commented on SPARK-25753:
---
This is backported to branch-2.4 via
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25753:
--
Affects Version/s: 2.4.4
> binaryFiles broken for small files
>
[
https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Evans updated SPARK-24540:
---
Summary: Support for multiple character delimiter in Spark CSV read (was:
Support for multiple
[
https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944783#comment-16944783
]
Jeff Evans commented on SPARK-24540:
I created a pull request to support this (which was linked
Peter Toth created SPARK-29359:
--
Summary: Better exception handling in SQLQueryTestSuite and
ThriftServerQueryTestSuite
Key: SPARK-29359
URL: https://issues.apache.org/jira/browse/SPARK-29359
Project:
[
https://issues.apache.org/jira/browse/SPARK-29340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Navdeep Poonia resolved SPARK-29340.
Resolution: Not A Problem
Hi [~hyukjin.kwon] thanks for your response, you made me
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Labels: release-notes (was: )
> Dynamic partition pruning
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Description:
Implements dynamic partition pruning by adding a dynamic-partition-pruning
filter if there
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Description:
Implements dynamic partition pruning by adding a dynamic-partition-pruning
filter if there
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Attachment: image-2019-10-04-11-20-02-616.png
> Dynamic partition pruning
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Description:
Implements dynamic partition pruning by adding a dynamic-partition-pruning
filter if there
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-11150:
Description:
Implements dynamic partition pruning by adding a dynamic-partition-pruning
filter if there
[
https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944736#comment-16944736
]
Srini E commented on SPARK-29337:
-
Hi Wang,
We don't have cache options while we are trying to cache a
Mukul Murthy created SPARK-29358:
Summary: Make unionByName optionally fill missing columns with
nulls
Key: SPARK-29358
URL: https://issues.apache.org/jira/browse/SPARK-29358
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29357:
--
Priority: Minor (was: Major)
> Fix the flaky test in DataFrameSuite
>
[
https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29357:
--
Issue Type: Bug (was: Improvement)
> Fix the flaky test in DataFrameSuite
>
[
https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29357.
---
Fix Version/s: 3.0.0
Assignee: Yuanjian Li
Resolution: Fixed
This is
[
https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29286:
--
Affects Version/s: 2.4.4
> UnicodeDecodeError raised when running python tests on arm
[
https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29286:
--
Fix Version/s: 2.4.5
> UnicodeDecodeError raised when running python tests on arm instance
>
[
https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29286.
---
Fix Version/s: 3.0.0
Assignee: Hyukjin Kwon
Resolution: Fixed
This is
[
https://issues.apache.org/jira/browse/SPARK-29355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29355.
---
Fix Version/s: 3.0.0
Assignee: Maxim Gekk
Resolution: Fixed
This is
[
https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944564#comment-16944564
]
Furcy Pin commented on SPARK-13587:
---
Hello,
I don't know where to ask this, but we have been using
[
https://issues.apache.org/jira/browse/SPARK-29276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944526#comment-16944526
]
Jochen Hebbrecht commented on SPARK-29276:
--
Thanks, I've just send out a mail on the mailing
[
https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944434#comment-16944434
]
Shasidhar E S commented on SPARK-25440:
---
[~maxgekk] How do we use this feature? Is there an
Yuanjian Li created SPARK-29357:
---
Summary: Fix the flaky test in DataFrameSuite
Key: SPARK-29357
URL: https://issues.apache.org/jira/browse/SPARK-29357
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-29356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Malthe Borch updated SPARK-29356:
-
Description: The Spark session's gateway client still has an open network
connection after a
Malthe Borch created SPARK-29356:
Summary: Stopping Spark doesn't shut down all network connections
Key: SPARK-29356
URL: https://issues.apache.org/jira/browse/SPARK-29356
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-28425:
---
Description:
||Operator||Example||Result||
|{{+}}|{{date '2001-09-28' + interval '1
[
https://issues.apache.org/jira/browse/SPARK-29355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-29355:
---
Description:
||Operator||Example||Result||
|{{-}}|{{timestamp '2001-09-29 03:00' - timestamp
Maxim Gekk created SPARK-29355:
--
Summary: Support timestamps subtraction
Key: SPARK-29355
URL: https://issues.apache.org/jira/browse/SPARK-29355
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-29276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29276.
--
Resolution: Invalid
Let's ask questions into mailing list or stackoverflow. You would be able
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29302.
--
Resolution: Invalid
> dynamic partition overwrite with speculation enabled
>
[
https://issues.apache.org/jira/browse/SPARK-29304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-29304:
-
Target Version/s: (was: 3.0.0)
> Input Bytes Metric for Datasource v2 is absent
>
[
https://issues.apache.org/jira/browse/SPARK-29309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944318#comment-16944318
]
Hyukjin Kwon commented on SPARK-29309:
--
So what do you propose?
>
[
https://issues.apache.org/jira/browse/SPARK-29316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29316.
--
Resolution: Won't Fix
> CLONE - schemaInference option not to convert strings with leading
[
https://issues.apache.org/jira/browse/SPARK-29039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29039.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25747
[
https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29337.
--
Resolution: Invalid
Questions should go to stackoverflow or mailing list.
> How to Cache
[
https://issues.apache.org/jira/browse/SPARK-29340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944314#comment-16944314
]
Hyukjin Kwon commented on SPARK-29340:
--
[~navdeepniku], is it possible to show the full reproducer?
[
https://issues.apache.org/jira/browse/SPARK-29344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29344.
--
Resolution: Cannot Reproduce
I haven't seen such things. Please specify the steps to
[
https://issues.apache.org/jira/browse/SPARK-29326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-29326:
---
Assignee: Gengliang Wang
> ANSI store assignment policy: throw exception on insertion
[
https://issues.apache.org/jira/browse/SPARK-29326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29326.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25997
Sungpeo Kook created SPARK-29354:
Summary: Spark has direct dependency on jline, but binaries for
'without hadoop' don't have a jline jar file.
Key: SPARK-29354
URL:
72 matches
Mail list logo