wuyi created SPARK-31050:
Summary: Disable flaky KafkaDelegationTokenSuite
Key: SPARK-31050
URL: https://issues.apache.org/jira/browse/SPARK-31050
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30886:
--
Target Version/s: 3.0.0
> Deprecate LTRIM, RTRIM, and two-parameter TRIM functions
>
[
https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30886:
--
Issue Type: Bug (was: Task)
> Deprecate LTRIM, RTRIM, and two-parameter TRIM functions
>
[
https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30886:
--
Summary: Deprecate LTRIM, RTRIM, and two-parameter TRIM functions (was:
Warn two-parameter
[
https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi updated SPARK-30541:
-
Priority: Blocker (was: Major)
> Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite
>
Takeshi Yamamuro created SPARK-31049:
Summary: Support nested adjacent generators, e.g.,
explode(explode(v))
Key: SPARK-31049
URL: https://issues.apache.org/jira/browse/SPARK-31049
Project: Spark
Sunil Aryal created SPARK-31048:
---
Summary: alter hive column datatype is not supported
Key: SPARK-31048
URL: https://issues.apache.org/jira/browse/SPARK-31048
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051844#comment-17051844
]
Hyukjin Kwon commented on SPARK-29058:
--
Yeah, so there's kind of tradeoff. If we should have the
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051839#comment-17051839
]
Suchintak Patnaik commented on SPARK-29058:
---
[~hyukjin.kwon] I agree with you on this.
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051827#comment-17051827
]
Hyukjin Kwon commented on SPARK-29058:
--
Yeah, so essentially it doesn't need to parse and convert
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051820#comment-17051820
]
Suchintak Patnaik commented on SPARK-29058:
---
[~hyukjin.kwon] How does column pruning work here
[
https://issues.apache.org/jira/browse/SPARK-30913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30913.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27783
[
https://issues.apache.org/jira/browse/SPARK-30889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30889.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27783
[
https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31047:
---
Component/s: (was: Input/Output)
SQL
> Improve file listing for ViewFileSystem
[
https://issues.apache.org/jira/browse/SPARK-30980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051767#comment-17051767
]
Hyukjin Kwon commented on SPARK-30980:
--
[~coderbond007], can you provide reproducible example? are
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051765#comment-17051765
]
Hyukjin Kwon commented on SPARK-29058:
--
It parses what it needs intenally via column pruning. It's
Manu Zhang created SPARK-31047:
--
Summary: Improve file listing for ViewFileSystem
Key: SPARK-31047
URL: https://issues.apache.org/jira/browse/SPARK-31047
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051664#comment-17051664
]
Thomas Graves edited comment on SPARK-31043 at 3/4/20, 10:18 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051664#comment-17051664
]
Thomas Graves commented on SPARK-31043:
---
rebuilt and still see the error. The full exception in
Wei Xue created SPARK-31046:
---
Summary: Make more efficient and clean up AQE update UI code
Key: SPARK-31046
URL: https://issues.apache.org/jira/browse/SPARK-31046
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051655#comment-17051655
]
Thomas Graves commented on SPARK-31043:
---
A couple of my colleagues actually ran into this and
Wei Xue created SPARK-31045:
---
Summary: Add config for AQE logging level
Key: SPARK-31045
URL: https://issues.apache.org/jira/browse/SPARK-31045
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051643#comment-17051643
]
Sean R. Owen commented on SPARK-31043:
--
Hm, I'm not seeing failures for the 3.0 branch or master
[
https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051630#comment-17051630
]
Thomas Graves commented on SPARK-27651:
---
It looks like this only works when using the external
Maxim Gekk created SPARK-31044:
--
Summary: Support foldable input by `schema_of_json`
Key: SPARK-31044
URL: https://issues.apache.org/jira/browse/SPARK-31044
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051557#comment-17051557
]
Sean R. Owen commented on SPARK-31043:
--
Weird but I think I have to revert it . It isn't essential
[
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051554#comment-17051554
]
Thomas Graves commented on SPARK-31043:
---
I'm working on tracing down what broke this.
[~srowen]
[
https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai resolved SPARK-30784.
--
Resolution: Not A Bug
Resolving it because with Hive 2.3, using regular orc is required.
> Hive 2.3
Thomas Graves created SPARK-31043:
-
Summary: Spark 3.0 built against hadoop2.7 can't start standalone
master
Key: SPARK-31043
URL: https://issues.apache.org/jira/browse/SPARK-31043
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-31027:
Fix Version/s: (was: 3.1.0)
3.0.0
> Refactor `DataSourceStrategy.scala` to
[
https://issues.apache.org/jira/browse/SPARK-31029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shanyu zhao updated SPARK-31029:
Description:
*Problem:*
When running tpc-ds test (https://github.com/databricks/spark-sql-perf),
[
https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051524#comment-17051524
]
Suchintak Patnaik commented on SPARK-29058:
---
[~hyukjin.kwon] Any update on this issue?
>
Suchintak Patnaik created SPARK-31042:
-
Summary: Error in writing a pyspark streaming dataframe created
from Kafka source to a csv file
Key: SPARK-31042
URL: https://issues.apache.org/jira/browse/SPARK-31042
[
https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-31041:
-
Description:
This works:
{code:java}
./dev/make-distribution.sh \
--pip \
[
https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-31041:
-
Description:
This works:
```
./dev/make-distribution.sh \
--pip \
-Phadoop-2.7
[
https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-31041:
-
Description:
This works:
```
./dev/make-distribution.sh \
--pip \
-Phadoop-2.7
[
https://issues.apache.org/jira/browse/SPARK-31041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-31041:
-
Summary: Make arguments to make-distribution.sh position-independent (was:
Make
Nicholas Chammas created SPARK-31041:
Summary: Make argument to make-distribution position-independent
Key: SPARK-31041
URL: https://issues.apache.org/jira/browse/SPARK-31041
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31009:
---
Affects Version/s: (was: 3.0.0)
3.1.0
> Support json_object_keys
[
https://issues.apache.org/jira/browse/SPARK-31008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31008:
---
Affects Version/s: (was: 3.0.0)
3.1.0
> Support
[
https://issues.apache.org/jira/browse/SPARK-31035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-31035.
Resolution: Invalid
Resource aware scheduling doesn't support local mode for now so I'll
[
https://issues.apache.org/jira/browse/SPARK-31040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Gilmore updated SPARK-31040:
Description:
Each batch should either log all offsets for each partition or should scan
[
https://issues.apache.org/jira/browse/SPARK-31040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Gilmore updated SPARK-31040:
Description:
Each batch should either log all offsets for each partition or should scan
Richard Gilmore created SPARK-31040:
---
Summary: Offsets are only logged for partitions which had data
this causes next batch to read the partitions that were not included from the
beginning when using kafka
Key: SPARK-31040
[
https://issues.apache.org/jira/browse/SPARK-31039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051327#comment-17051327
]
Frank Oosterhuis commented on SPARK-31039:
--
As a workaround I have created the table manually
Frank Oosterhuis created SPARK-31039:
Summary: Unable to use vendor specific datatypes with JDBC
Key: SPARK-31039
URL: https://issues.apache.org/jira/browse/SPARK-31039
Project: Spark
Kent Yao created SPARK-31038:
Summary: Add checkValue for spark.sql.session.timeZone
Key: SPARK-31038
URL: https://issues.apache.org/jira/browse/SPARK-31038
Project: Spark
Issue Type:
Wenchen Fan created SPARK-31037:
---
Summary: refine AQE config names
Key: SPARK-31037
URL: https://issues.apache.org/jira/browse/SPARK-31037
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-31009:
---
Description:
This function will return all the keys from outer json object.
PostgreSQL
[
https://issues.apache.org/jira/browse/SPARK-31027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31027.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27778
[
https://issues.apache.org/jira/browse/SPARK-31027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31027:
Assignee: DB Tsai
> Refactor `DataSourceStrategy.scala` to minimize the changes to
[
https://issues.apache.org/jira/browse/SPARK-30992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-30992:
---
Summary: Arrange scattered config of streaming module (was: Arrange
scattered config for
[
https://issues.apache.org/jira/browse/SPARK-30992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-30992:
--
Component/s: (was: Structured Streaming)
DStreams
> Arrange scattered
[
https://issues.apache.org/jira/browse/SPARK-31006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051179#comment-17051179
]
Gabor Somogyi commented on SPARK-31006:
---
I see many users are using DStreams at the moment. Not
[
https://issues.apache.org/jira/browse/SPARK-31017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31017.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27767
[
https://issues.apache.org/jira/browse/SPARK-31017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31017:
---
Assignee: wuyi
> Test for shuffle requests packaging with different size and numBlocks
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051094#comment-17051094
]
Wenchen Fan commented on SPARK-30951:
-
[~bersprockets] You are making a good point here. It's very
[
https://issues.apache.org/jira/browse/SPARK-30563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051076#comment-17051076
]
Maxim Gekk commented on SPARK-30563:
[~petertoth] If you think it is possible to avoid some overhead
[
https://issues.apache.org/jira/browse/SPARK-30563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051073#comment-17051073
]
Maxim Gekk commented on SPARK-30563:
> we spend a lot of time in this loop even
The loop just
[
https://issues.apache.org/jira/browse/SPARK-30960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30960.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27710
Hyukjin Kwon created SPARK-31036:
Summary: Use stringArgs in Expression.toString to respect hidden
parameters
Key: SPARK-31036
URL: https://issues.apache.org/jira/browse/SPARK-31036
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051014#comment-17051014
]
Peter Toth commented on SPARK-30563:
[~maxgekk], [~dongjoon], [~hyukjin.kwon] it looks like the
62 matches
Mail list logo
