[jira] [Updated] (SPARK-30279) Support 32 or more grouping attributes for GROUPING_ID

[ https://issues.apache.org/jira/browse/SPARK-30279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-30279: - Affects Version/s: 2.4.6 > Support 32 or more grouping attributes for GROUPING_ID >

[jira] [Resolved] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31061. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27822

[jira] [Assigned] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31061: --- Assignee: Burak Yavuz > Impossible to change the provider of a table in the HiveMetaStore

[jira] [Created] (SPARK-31068) IllegalArgumentException in BroadcastExchangeExec

Lantao Jin created SPARK-31068: -- Summary: IllegalArgumentException in BroadcastExchangeExec Key: SPARK-31068 URL: https://issues.apache.org/jira/browse/SPARK-31068 Project: Spark Issue Type:

[jira] [Created] (SPARK-31067) Spark 2.4.* SQL query with partition columns scans entire AVRO data

Gopal created SPARK-31067: - Summary: Spark 2.4.* SQL query with partition columns scans entire AVRO data Key: SPARK-31067 URL: https://issues.apache.org/jira/browse/SPARK-31067 Project: Spark

[jira] [Commented] (SPARK-31043) Spark 3.0 built against hadoop2.7 can't start standalone master

[ https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053080#comment-17053080 ] Nicholas Chammas commented on SPARK-31043: -- FWIW I was seeing the same

[jira] [Commented] (SPARK-31065) Empty string values cause schema_of_json() to return a schema not usable by from_json()

[ https://issues.apache.org/jira/browse/SPARK-31065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053079#comment-17053079 ] Nicholas Chammas commented on SPARK-31065: -- Confirmed this issue is also present on

[jira] [Updated] (SPARK-31065) Empty string values cause schema_of_json() to return a schema not usable by from_json()

[ https://issues.apache.org/jira/browse/SPARK-31065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-31065: - Affects Version/s: 3.0.0 > Empty string values cause schema_of_json() to return a

[jira] [Created] (SPARK-31066) Disable useless and uncleaned hive SessionState initialization parts

Kent Yao created SPARK-31066: Summary: Disable useless and uncleaned hive SessionState initialization parts Key: SPARK-31066 URL: https://issues.apache.org/jira/browse/SPARK-31066 Project: Spark

[jira] [Commented] (SPARK-31065) Empty string values cause schema_of_json() to return a schema not usable by from_json()

[ https://issues.apache.org/jira/browse/SPARK-31065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053052#comment-17053052 ] Nicholas Chammas commented on SPARK-31065: -- cc [~hyukjin.kwon] > Empty string values cause

[jira] [Created] (SPARK-31065) Empty string values cause schema_of_json() to return a schema not usable by from_json()

Nicholas Chammas created SPARK-31065: Summary: Empty string values cause schema_of_json() to return a schema not usable by from_json() Key: SPARK-31065 URL: https://issues.apache.org/jira/browse/SPARK-31065

[jira] [Resolved] (SPARK-30776) Support FValueRegressionSelector for continuous features and continuous labels

[ https://issues.apache.org/jira/browse/SPARK-30776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30776. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27679

[jira] [Assigned] (SPARK-30776) Support FValueRegressionSelector for continuous features and continuous labels

[ https://issues.apache.org/jira/browse/SPARK-30776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30776: Assignee: Huaxin Gao > Support FValueRegressionSelector for continuous features and

[jira] [Assigned] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-30985: --- Assignee: (was: Prashant Sharma) > Propagate SPARK_CONF_DIR files to driver

[jira] [Commented] (SPARK-30930) ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-30930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053017#comment-17053017 ] Sean R. Owen commented on SPARK-30930: -- My general stance is: anything that's been public for a

[jira] [Resolved] (SPARK-31063) xml-apis is missing after xercesImpl bumped up to 2.12.0

Components: Spark Core >Affects Versions: 3.0.0, 3.1.0 >Reporter: Kent Yao >Priority: Blocker > > {code:java} > ✘ kentyao@hulk  ~/Downloads/spark/spark-3.1.0-SNAPSHOT-bin-20200305  > bin/spark-sql > 20/03/06 11:05:58 WARN Utils: Your hostname, hulk.lo

[jira] [Assigned] (SPARK-31044) Support foldable input by `schema_of_json`

[ https://issues.apache.org/jira/browse/SPARK-31044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31044: --- Assignee: Maxim Gekk > Support foldable input by `schema_of_json` >

[jira] [Assigned] (SPARK-31025) Support foldable input by `schema_of_csv`

[ https://issues.apache.org/jira/browse/SPARK-31025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31025: --- Assignee: Maxim Gekk > Support foldable input by `schema_of_csv` >

[jira] [Resolved] (SPARK-31025) Support foldable input by `schema_of_csv`

[ https://issues.apache.org/jira/browse/SPARK-31025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31025. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27804

[jira] [Resolved] (SPARK-31044) Support foldable input by `schema_of_json`

[ https://issues.apache.org/jira/browse/SPARK-31044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31044. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27804

[jira] [Resolved] (SPARK-31023) Support foldable schemas by `from_json`

[ https://issues.apache.org/jira/browse/SPARK-31023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31023. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27804

[jira] [Assigned] (SPARK-31023) Support foldable schemas by `from_json`

[ https://issues.apache.org/jira/browse/SPARK-31023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31023: --- Assignee: Maxim Gekk > Support foldable schemas by `from_json` >

[jira] [Assigned] (SPARK-31020) Support foldable schemas by `from_csv`

[ https://issues.apache.org/jira/browse/SPARK-31020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31020: --- Assignee: Maxim Gekk > Support foldable schemas by `from_csv` >

[jira] [Resolved] (SPARK-31020) Support foldable schemas by `from_csv`

[ https://issues.apache.org/jira/browse/SPARK-31020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31020. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27804

[jira] [Assigned] (SPARK-31045) Add config for AQE logging level

[ https://issues.apache.org/jira/browse/SPARK-31045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31045: --- Assignee: Wei Xue > Add config for AQE logging level > >

[jira] [Resolved] (SPARK-31045) Add config for AQE logging level

[ https://issues.apache.org/jira/browse/SPARK-31045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31045. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27798

[jira] [Resolved] (SPARK-30886) Deprecate two-parameter TRIM/LTRIM/RTRIM functions

[ https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30886. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27643

[jira] [Assigned] (SPARK-30886) Deprecate two-parameter TRIM/LTRIM/RTRIM functions

[ https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30886: - Assignee: Dongjoon Hyun > Deprecate two-parameter TRIM/LTRIM/RTRIM functions >

[jira] [Created] (SPARK-31064) New Parquet Predicate Filter APIs with multi-part Identifier Support

DB Tsai created SPARK-31064: --- Summary: New Parquet Predicate Filter APIs with multi-part Identifier Support Key: SPARK-31064 URL: https://issues.apache.org/jira/browse/SPARK-31064 Project: Spark

[jira] [Created] (SPARK-31063) xml-apis is missing after xercesImpl bumped up to 2.12.0

: Bug Components: Spark Core Affects Versions: 3.0.0, 3.1.0 Reporter: Kent Yao {code:java} ✘ kentyao@hulk  ~/Downloads/spark/spark-3.1.0-SNAPSHOT-bin-20200305  bin/spark-sql 20/03/06 11:05:58 WARN Utils: Your hostname, hulk.local resolves to a loopback address

[jira] [Resolved] (SPARK-31043) Spark 3.0 built against hadoop2.7 can't start standalone master

[ https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31043. -- Fix Version/s: 3.0.0 Resolution: Fixed > Spark 3.0 built against hadoop2.7 can't start

[jira] [Commented] (SPARK-31043) Spark 3.0 built against hadoop2.7 can't start standalone master

[ https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052687#comment-17052687 ] Hyukjin Kwon commented on SPARK-31043: -- I believe it was fixed as of

[jira] [Assigned] (SPARK-30914) Add version information to the configuration of UI

[ https://issues.apache.org/jira/browse/SPARK-30914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30914: Assignee: jiaan.geng > Add version information to the configuration of UI >

[jira] [Resolved] (SPARK-30914) Add version information to the configuration of UI

[ https://issues.apache.org/jira/browse/SPARK-30914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30914. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27806

[jira] [Resolved] (SPARK-31036) Use stringArgs in Expression.toString to respect hidden parameters

[ https://issues.apache.org/jira/browse/SPARK-31036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31036. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27788

[jira] [Assigned] (SPARK-31036) Use stringArgs in Expression.toString to respect hidden parameters

[ https://issues.apache.org/jira/browse/SPARK-31036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31036: Assignee: Hyukjin Kwon > Use stringArgs in Expression.toString to respect hidden

[jira] [Resolved] (SPARK-30563) Regressions in Join benchmarks

[ https://issues.apache.org/jira/browse/SPARK-30563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30563. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-30930) ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-30930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052641#comment-17052641 ] Huaxin Gao commented on SPARK-30930: cc [~srowen], [~podongfeng] Developer API Most developer API

[jira] [Created] (SPARK-31062) Improve Spark Decommissioning K8s test relability

Holden Karau created SPARK-31062: Summary: Improve Spark Decommissioning K8s test relability Key: SPARK-31062 URL: https://issues.apache.org/jira/browse/SPARK-31062 Project: Spark Issue

[jira] [Created] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

Burak Yavuz created SPARK-31061: --- Summary: Impossible to change the provider of a table in the HiveMetaStore Key: SPARK-31061 URL: https://issues.apache.org/jira/browse/SPARK-31061 Project: Spark

[jira] [Resolved] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

[ https://issues.apache.org/jira/browse/SPARK-31058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31058. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27814

[jira] [Assigned] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

[ https://issues.apache.org/jira/browse/SPARK-31058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31058: --- Assignee: DB Tsai > Consolidate the implementation of quoteIfNeeded >

[jira] [Commented] (SPARK-30930) ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-30930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052606#comment-17052606 ] Huaxin Gao commented on SPARK-30930: Sealed and Experimental are as following. I don't think we

[jira] [Resolved] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

[ https://issues.apache.org/jira/browse/SPARK-31059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos resolved SPARK-31059. Resolution: Invalid Invalid guys, there is no duplicate "Product line -

[jira] [Updated] (SPARK-25722) Support a backtick character in column names

[ https://issues.apache.org/jira/browse/SPARK-25722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25722: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support a backtick

[jira] [Created] (SPARK-31060) Handle column names containing `dots` in data source `Filter`

DB Tsai created SPARK-31060: --- Summary: Handle column names containing `dots` in data source `Filter` Key: SPARK-31060 URL: https://issues.apache.org/jira/browse/SPARK-31060 Project: Spark Issue

[jira] [Comment Edited] (SPARK-30961) Arrow enabled: to_pandas with date column fails

[ https://issues.apache.org/jira/browse/SPARK-30961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052464#comment-17052464 ] Kevin Appel edited comment on SPARK-30961 at 3/5/20, 10:19 PM: --- (python

[jira] [Updated] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

[ https://issues.apache.org/jira/browse/SPARK-31059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31059: --- Description: When applying "GROUP BY" processing operator (without an

[jira] [Updated] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

[ https://issues.apache.org/jira/browse/SPARK-31059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31059: --- Description: When applying "GROUP BY" processing operator (without an

[jira] [Updated] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

[ https://issues.apache.org/jira/browse/SPARK-31059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31059: --- Attachment: SampleFile_GOSales.csv > Spark's SQL "group by" local

[jira] [Updated] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

[ https://issues.apache.org/jira/browse/SPARK-31059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31059: --- Description: When applying "GROUP BY" processing operator (without an

[jira] [Created] (SPARK-31059) Spark's SQL "group by" local processing operator is broken.

Michail Giannakopoulos created SPARK-31059: -- Summary: Spark's SQL "group by" local processing operator is broken. Key: SPARK-31059 URL: https://issues.apache.org/jira/browse/SPARK-31059

[jira] [Commented] (SPARK-20901) Feature parity for ORC with Parquet

[ https://issues.apache.org/jira/browse/SPARK-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052476#comment-17052476 ] Felix Kizhakkel Jose commented on SPARK-20901: -- Thank you [~dongjoon].  > Feature parity

[jira] [Commented] (SPARK-20901) Feature parity for ORC with Parquet

[ https://issues.apache.org/jira/browse/SPARK-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052473#comment-17052473 ] Dongjoon Hyun commented on SPARK-20901: --- Hi, [~FelixKJose]. Apache Spark community is trying to

[jira] [Commented] (SPARK-30961) Arrow enabled: to_pandas with date column fails

[ https://issues.apache.org/jira/browse/SPARK-30961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052464#comment-17052464 ] Kevin Appel commented on SPARK-30961: - python 3.6, pyarrow 0.8.0, pandas 0.21.0 is a combination I

[jira] [Created] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

DB Tsai created SPARK-31058: --- Summary: Consolidate the implementation of quoteIfNeeded Key: SPARK-31058 URL: https://issues.apache.org/jira/browse/SPARK-31058 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-31052) Fix flaky test "DAGSchedulerSuite.shuffle fetch failed on speculative task, but original task succeed"

[ https://issues.apache.org/jira/browse/SPARK-31052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-31052. -- Fix Version/s: 3.0.0 Target Version/s: 3.0.0 Assignee: wuyi

[jira] [Updated] (SPARK-31052) Fix flaky test "DAGSchedulerSuite.shuffle fetch failed on speculative task, but original task succeed"

[ https://issues.apache.org/jira/browse/SPARK-31052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-31052: - Summary: Fix flaky test "DAGSchedulerSuite.shuffle fetch failed on speculative task, but

[jira] [Updated] (SPARK-30886) Deprecate two-parameter TRIM/LTRIM/RTRIM functions

[ https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30886: -- Summary: Deprecate two-parameter TRIM/LTRIM/RTRIM functions (was: Deprecate two-parameter

[jira] [Updated] (SPARK-30886) Deprecate two-parameter TRIM/LTRIM/RTRIM function

[ https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30886: -- Summary: Deprecate two-parameter TRIM/LTRIM/RTRIM function (was: Deprecate two-parameter

[jira] [Updated] (SPARK-31057) approxQuantile function of spark , not taking List as first parameter

[ https://issues.apache.org/jira/browse/SPARK-31057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam updated SPARK-31057: -- Shepherd: Sean R. Owen > approxQuantile function of spark , not taking List as first parameter >

[jira] [Created] (SPARK-31057) approxQuantile function of spark , not taking List as first parameter

Shyam created SPARK-31057: - Summary: approxQuantile function of spark , not taking List as first parameter Key: SPARK-31057 URL: https://issues.apache.org/jira/browse/SPARK-31057 Project: Spark

[jira] [Commented] (SPARK-20901) Feature parity for ORC with Parquet

[ https://issues.apache.org/jira/browse/SPARK-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052384#comment-17052384 ] Felix Kizhakkel Jose commented on SPARK-20901: -- Hi [~dongjoon], I was trying to choose

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052348#comment-17052348 ] Attila Zsolt Piros commented on SPARK-27651: well in case of dynamic allocation and a

[jira] [Updated] (SPARK-30886) Deprecate two-parameter TRIM function

[ https://issues.apache.org/jira/browse/SPARK-30886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30886: -- Summary: Deprecate two-parameter TRIM function (was: Deprecate LTRIM, RTRIM, and

[jira] [Created] (SPARK-31056) Add CalendarIntervals division

Enrico Minack created SPARK-31056: - Summary: Add CalendarIntervals division Key: SPARK-31056 URL: https://issues.apache.org/jira/browse/SPARK-31056 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31055) Update config docs for shuffle local host reads to have dep on external shuffle service

Thomas Graves created SPARK-31055: - Summary: Update config docs for shuffle local host reads to have dep on external shuffle service Key: SPARK-31055 URL: https://issues.apache.org/jira/browse/SPARK-31055

[jira] [Created] (SPARK-31054) Turn on deprecation in Scala REPL/spark-shell by default

wuyi created SPARK-31054: Summary: Turn on deprecation in Scala REPL/spark-shell by default Key: SPARK-31054 URL: https://issues.apache.org/jira/browse/SPARK-31054 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052251#comment-17052251 ] Thomas Graves commented on SPARK-27651: --- thanks, that makes sense. I can look in more details at

[jira] [Created] (SPARK-31053) mark connector API as Evolving

Wenchen Fan created SPARK-31053: --- Summary: mark connector API as Evolving Key: SPARK-31053 URL: https://issues.apache.org/jira/browse/SPARK-31053 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-31034) ShuffleBlockFetcherIterator may can't create request for last group

[ https://issues.apache.org/jira/browse/SPARK-31034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31034. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27786

[jira] [Assigned] (SPARK-31034) ShuffleBlockFetcherIterator may can't create request for last group

[ https://issues.apache.org/jira/browse/SPARK-31034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31034: --- Assignee: wuyi > ShuffleBlockFetcherIterator may can't create request for last group >

[jira] [Created] (SPARK-31052) Fix flaky test of SPARK-30388

wuyi created SPARK-31052: Summary: Fix flaky test of SPARK-30388 Key: SPARK-31052 URL: https://issues.apache.org/jira/browse/SPARK-31052 Project: Spark Issue Type: Bug Components: Spark

[jira] [Resolved] (SPARK-31005) Support time zone ids in casting strings to timestamps

[ https://issues.apache.org/jira/browse/SPARK-31005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31005. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27753

[jira] [Assigned] (SPARK-31005) Support time zone ids in casting strings to timestamps

[ https://issues.apache.org/jira/browse/SPARK-31005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31005: --- Assignee: Maxim Gekk > Support time zone ids in casting strings to timestamps >

[jira] [Resolved] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

[ https://issues.apache.org/jira/browse/SPARK-31051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-31051. --- Resolution: Not A Problem I'm just blind. They are there. > Thriftserver

[jira] [Created] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

Juliusz Sompolski created SPARK-31051: - Summary: Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed Key: SPARK-31051 URL:

[jira] [Commented] (SPARK-30100) Decimal Precision Inferred from JDBC via Spark

[ https://issues.apache.org/jira/browse/SPARK-30100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052050#comment-17052050 ] Joby Joje commented on SPARK-30100: --- [~hyukjin.kwon] is there any workaround for this precision data

[jira] [Resolved] (SPARK-31046) Make more efficient and clean up AQE update UI code

[ https://issues.apache.org/jira/browse/SPARK-31046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31046. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27799

[jira] [Assigned] (SPARK-31046) Make more efficient and clean up AQE update UI code

[ https://issues.apache.org/jira/browse/SPARK-31046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31046: --- Assignee: Wei Xue > Make more efficient and clean up AQE update UI code >

[jira] [Updated] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27651: --- Description: When a shuffle block (content) is fetched the network is always used

[jira] [Commented] (SPARK-27651) Avoid the network when block manager fetches shuffle blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051995#comment-17051995 ] Attila Zsolt Piros commented on SPARK-27651: Yes, the final implementation works only when

[jira] [Resolved] (SPARK-31024) Allow specifying session catalog name (spark_catalog) in qualified column names

[ https://issues.apache.org/jira/browse/SPARK-31024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31024. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27776

[jira] [Assigned] (SPARK-31024) Allow specifying session catalog name (spark_catalog) in qualified column names

[ https://issues.apache.org/jira/browse/SPARK-31024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31024: --- Assignee: Terry Kim > Allow specifying session catalog name (spark_catalog) in qualified

[jira] [Commented] (SPARK-15798) Secondary sort in Dataset/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051990#comment-17051990 ] Melitta Dragaschnig commented on SPARK-15798: - Hi all, I am a frequent user of tresata's

[jira] [Resolved] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30668. - Resolution: Fixed Issue resolved by pull request 27537

[jira] [Resolved] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31050. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27789

[jira] [Assigned] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31050: - Assignee: wuyi > Disable flaky KafkaDelegationTokenSuite >

[jira] [Commented] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051877#comment-17051877 ] Dongjoon Hyun commented on SPARK-30541: --- Please see the PR. This is decided to be a blocker for

[jira] [Updated] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30541: -- Target Version/s: 3.0.0 > Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

[jira] [Updated] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31050: - Description: Disable flaky KafkaDelegationTokenSuite since it's too flaky. > Disable flaky

[jira] [Updated] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31050: - Environment: (was: Disable flaky KafkaDelegationTokenSuite since it's too flaky.) > Disable flaky