[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839097#comment-16839097
]
tommy duan commented on SPARK-27648:
Hi [~kabhwan]
I'm so sorry.
The above is the main code. The
[
https://issues.apache.org/jira/browse/SPARK-27694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27694:
Summary: CTAS created data source table support collect statistics (was:
Create a data source
Oscar Cassetti created SPARK-27695:
--
Summary: SELECT * returns null column when reading from Hive / ORC
and spark.sql.hive.convertMetastoreOrc=true
Key: SPARK-27695
URL:
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839070#comment-16839070
]
Liang-Chi Hsieh commented on SPARK-27671:
-
[~dongjoon] Thanks for test and updating `Affects
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27689:
Description:
I have a python error when I execute the following code using hive views but it
[
https://issues.apache.org/jira/browse/SPARK-27694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27694:
Assignee: Apache Spark
> Create a data source table using the result of a query should
[
https://issues.apache.org/jira/browse/SPARK-27694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27694:
Assignee: (was: Apache Spark)
> Create a data source table using the result of a
Yuming Wang created SPARK-27694:
---
Summary: Create a data source table using the result of a query
should update statistics if spark.sql.statistics.size.autoUpdate.enabled is
enabled
Key: SPARK-27694
URL:
[
https://issues.apache.org/jira/browse/SPARK-27690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27690:
--
Summary: Remove materialized view first in `HiveClientImpl.reset` (was:
Refactor
[
https://issues.apache.org/jira/browse/SPARK-27690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27690:
--
Summary: Remove materialized views first in `HiveClientImpl.reset` (was:
Remove materialized
[
https://issues.apache.org/jira/browse/SPARK-27682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27682:
Comment: was deleted
(was: Removing .to[...] means creating explicitly the type
[
https://issues.apache.org/jira/browse/SPARK-27682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838885#comment-16838885
]
Stavros Kontopoulos commented on SPARK-27682:
-
Removing .to[...] means creating explicitly
[
https://issues.apache.org/jira/browse/SPARK-27693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27693:
Assignee: Apache Spark
> DataSourceV2: Add default catalog property
>
[
https://issues.apache.org/jira/browse/SPARK-27693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27693:
Assignee: (was: Apache Spark)
> DataSourceV2: Add default catalog property
>
Ryan Blue created SPARK-27693:
-
Summary: DataSourceV2: Add default catalog property
Key: SPARK-27693
URL: https://issues.apache.org/jira/browse/SPARK-27693
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27671.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838812#comment-16838812
]
Sunitha Kambhampati commented on SPARK-27692:
-
Here is the PR:
[
https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27692:
Assignee: (was: Apache Spark)
> Optimize evaluation of udf that is deterministic and
[
https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27692:
Assignee: Apache Spark
> Optimize evaluation of udf that is deterministic and has
[
https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838803#comment-16838803
]
Sunitha Kambhampati commented on SPARK-27692:
-
I'll open a PR soon.
> Optimize evaluation
Sunitha Kambhampati created SPARK-27692:
---
Summary: Optimize evaluation of udf that is deterministic and has
literal inputs
Key: SPARK-27692
URL: https://issues.apache.org/jira/browse/SPARK-27692
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838799#comment-16838799
]
Marcelo Vanzin commented on SPARK-27681:
bq. The case to consider is, roughly, where Seq is an
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838795#comment-16838795
]
Dongjoon Hyun commented on SPARK-27671:
---
The patch can land on `master` and `branch-2.4`. From
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27671:
--
Affects Version/s: 2.4.3
> Fix error when casting from a nested null in a struct
>
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27671:
--
Summary: Fix error when casting from a nested null in a struct (was:
Analysis exception
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838781#comment-16838781
]
Sean Owen commented on SPARK-27681:
---
You're right, the change is kinda breaking! we can just accept
[
https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp closed SPARK-21367.
---
> R older version of Roxygen2 on Jenkins
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838771#comment-16838771
]
Dongjoon Hyun commented on SPARK-21367:
---
Thank you, [~shaneknapp]!
> R older version of Roxygen2
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838766#comment-16838766
]
Marcelo Vanzin commented on SPARK-27681:
bq. But, user code that passes a non-immutable Seq to a
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-27681:
--
Description: {{scala.Seq}} is widely used in the code, and is an alias for
{{scala.collection.Seq}}
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838744#comment-16838744
]
Sean Owen commented on SPARK-27681:
---
OK, take it down a notch; we are largely in agreement, but
[
https://issues.apache.org/jira/browse/SPARK-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27402.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> Fix hadoop-3.2 test
[
https://issues.apache.org/jira/browse/SPARK-27691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Tong updated SPARK-27691:
-
Description:
Am currently running pyspark 2.4.2 and I am currently unable to run the
following
[
https://issues.apache.org/jira/browse/SPARK-27691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Tong updated SPARK-27691:
-
Summary: Issue when running queries using filter predicates on pandas
GROUPED_AGG udafs (was:
Michael Tong created SPARK-27691:
Summary: Issue when running queries using filter predicates on
pandas GROUPED_AGG udfs
Key: SPARK-27691
URL: https://issues.apache.org/jira/browse/SPARK-27691
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838715#comment-16838715
]
Marcelo Vanzin commented on SPARK-27681:
bq. varargs methods in Scala will change their
[
https://issues.apache.org/jira/browse/SPARK-27690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27690:
Assignee: Apache Spark
> Refactor HiveClientImpl#reset() to remove materialized view
[
https://issues.apache.org/jira/browse/SPARK-27690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27690:
Assignee: (was: Apache Spark)
> Refactor HiveClientImpl#reset() to remove
Yuming Wang created SPARK-27690:
---
Summary: Refactor HiveClientImpl#reset() to remove materialized
view first
Key: SPARK-27690
URL: https://issues.apache.org/jira/browse/SPARK-27690
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838696#comment-16838696
]
Yuming Wang commented on SPARK-27689:
-
Thank you [~lambda] I will check it.
> Error to execute hive
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838692#comment-16838692
]
Dongjoon Hyun commented on SPARK-27671:
---
Hi, [~viirya]. Could you test old Spark and update the
[
https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838693#comment-16838693
]
Marcelo Vanzin commented on SPARK-27681:
bq. scala.Seq is just a type def for
[
https://issues.apache.org/jira/browse/SPARK-27617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-27617.
-
> Not able to specify LOCATION for internal table
> ---
[
https://issues.apache.org/jira/browse/SPARK-27617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27617.
---
Resolution: Invalid
> Not able to specify LOCATION for internal table
>
[
https://issues.apache.org/jira/browse/SPARK-27653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27653:
---
Assignee: Liang-Chi Hsieh
> Add max_by() / min_by() SQL aggregate functions
>
[
https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838582#comment-16838582
]
Sean Owen commented on SPARK-27683:
---
Yeah if it comes to defining two source trees we can do that; was
[
https://issues.apache.org/jira/browse/SPARK-27653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27653.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24557
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838558#comment-16838558
]
Jungtaek Lim commented on SPARK-27648:
--
Exposing small part again and again gives more confusing -
[
https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838548#comment-16838548
]
Lukas Rytz commented on SPARK-27683:
bq. This makes it hard to create an API method that works in
Juan Antonio created SPARK-27689:
Summary: Error to execute hive views with spark
Key: SPARK-27689
URL: https://issues.apache.org/jira/browse/SPARK-27689
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838546#comment-16838546
]
Stefan Zeiger commented on SPARK-27683:
---
You could create your own type alias in a conditional
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838540#comment-16838540
]
tommy duan edited comment on SPARK-27648 at 5/13/19 1:36 PM:
-
Hi
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838540#comment-16838540
]
tommy duan edited comment on SPARK-27648 at 5/13/19 1:34 PM:
-
Hi
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838540#comment-16838540
]
tommy duan commented on SPARK-27648:
Hi [~kabhwan]&[~gsomogyi]，
Yes,the code include one sink;
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838501#comment-16838501
]
Sandeep Katta commented on SPARK-27688:
---
okay will work on your fork and raise PR to your fork
>
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838499#comment-16838499
]
Yuming Wang edited comment on SPARK-27688 at 5/13/19 12:18 PM:
---
Sorry
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838499#comment-16838499
]
Yuming Wang commented on SPARK-27688:
-
Sorry [~sandeep.katta2007]. We do not need do any changes
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-26601.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23670
[
https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-26601:
Assignee: zhoukang
> Make broadcast-exchange thread pool keepalivetime and
Sandeep Katta created SPARK-27688:
-
Summary: Beeline should show database in the prompt
Key: SPARK-27688
URL: https://issues.apache.org/jira/browse/SPARK-27688
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838460#comment-16838460
]
Sandeep Katta commented on SPARK-27688:
---
I will be working on this and raise PR soon
> Beeline
[
https://issues.apache.org/jira/browse/SPARK-27687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27687:
--
Component/s: Documentation
> Kafka consumer cache parameter rename and documentation
>
[
https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838421#comment-16838421
]
Sébastien BARNOUD commented on SPARK-21827:
---
Hi,
We already use for a while and with huge
[
https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838396#comment-16838396
]
Sébastien BARNOUD commented on SPARK-21827:
---
Hi,
I don't have the exact reason, but in a
[
https://issues.apache.org/jira/browse/SPARK-27687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27687:
Assignee: (was: Apache Spark)
> Kafka consumer cache parameter rename and
[
https://issues.apache.org/jira/browse/SPARK-27687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27687:
Assignee: Apache Spark
> Kafka consumer cache parameter rename and documentation
>
Gabor Somogyi created SPARK-27687:
-
Summary: Kafka consumer cache parameter rename and documentation
Key: SPARK-27687
URL: https://issues.apache.org/jira/browse/SPARK-27687
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838337#comment-16838337
]
Jungtaek Lim commented on SPARK-27648:
--
[~yy3b2007com]
I feel you're exposing only part of your
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838332#comment-16838332
]
tommy duan commented on SPARK-27648:
[~gsomogyi] Every trigger in my program updates the broadcast
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838324#comment-16838324
]
Gabor Somogyi commented on SPARK-27648:
---
I've also taken a deeper look at the provided data and
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823808#comment-16823808
]
Jiatao Tao edited comment on SPARK-27546 at 5/13/19 7:18 AM:
-
So in my
[
https://issues.apache.org/jira/browse/SPARK-27668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27668.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24571
[
https://issues.apache.org/jira/browse/SPARK-27668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27668:
---
Assignee: Gengliang Wang
> File source V2: support reporting statistics
>
73 matches
Mail list logo
