[jira] [Resolved] (SPARK-35594) Remove duplicate installations in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-35594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35594. -- Resolution: Not A Problem > Remove duplicate installations in build_and_test.yml >

[jira] [Assigned] (SPARK-35474) Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

[ https://issues.apache.org/jira/browse/SPARK-35474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35474: Assignee: (was: Apache Spark) > Enable disallow_untyped_defs mypy check for

[jira] [Assigned] (SPARK-35474) Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

[ https://issues.apache.org/jira/browse/SPARK-35474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35474: Assignee: Apache Spark > Enable disallow_untyped_defs mypy check for

[jira] [Commented] (SPARK-35474) Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

[ https://issues.apache.org/jira/browse/SPARK-35474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355498#comment-17355498 ] Apache Spark commented on SPARK-35474: -- User 'pingsutw' has created a pull request for this issue:

[jira] [Commented] (SPARK-35579) Fix a bug in janino or work around it in Spark.

[ https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355497#comment-17355497 ] Takeshi Yamamuro commented on SPARK-35579: -- I'm working on this. See: 

[jira] [Resolved] (SPARK-35583) Move JDBC data source options from Python and Scala into a single page

[ https://issues.apache.org/jira/browse/SPARK-35583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35583. -- Fix Version/s: 3.2.0 Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-35607) Migrate Spark Arm Job from Jenkins to GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-35607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35607: Description: There were two Arm CI jobs in AMP lab:

[jira] [Assigned] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35077: -- Assignee: Yingyi Bu (was: Apache Spark) > Migrate to transformWithPruning for

[jira] [Resolved] (SPARK-35077) Migrate to transformWithPruning for leftover optimizer rules

[ https://issues.apache.org/jira/browse/SPARK-35077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35077. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32721

[jira] [Updated] (SPARK-35607) Migrate Spark Arm Job from Jenkins to GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-35607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35607: Description: There were two Arm CI jobs in AMP lab:

[jira] [Updated] (SPARK-35607) Migrate Spark Arm Job from Jenkins to GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-35607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35607: Description: There were two Arm CI jobs in AMP lab:

[jira] [Created] (SPARK-35607) Migrate Spark Arm Job from Jenkins to GitHub Actions

Yikun Jiang created SPARK-35607: --- Summary: Migrate Spark Arm Job from Jenkins to GitHub Actions Key: SPARK-35607 URL: https://issues.apache.org/jira/browse/SPARK-35607 Project: Spark Issue

[jira] [Assigned] (SPARK-35606) List Python 3.9 installed libraries in build_and_test workflow

[ https://issues.apache.org/jira/browse/SPARK-35606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35606: Assignee: (was: Apache Spark) > List Python 3.9 installed libraries in

[jira] [Commented] (SPARK-35606) List Python 3.9 installed libraries in build_and_test workflow

[ https://issues.apache.org/jira/browse/SPARK-35606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355466#comment-17355466 ] Apache Spark commented on SPARK-35606: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35606) List Python 3.9 installed libraries in build_and_test workflow

[ https://issues.apache.org/jira/browse/SPARK-35606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35606: Assignee: Apache Spark > List Python 3.9 installed libraries in build_and_test workflow

[jira] [Created] (SPARK-35606) List Python 3.9 installed libraries in build_and_test workflow

Xinrong Meng created SPARK-35606: Summary: List Python 3.9 installed libraries in build_and_test workflow Key: SPARK-35606 URL: https://issues.apache.org/jira/browse/SPARK-35606 Project: Spark

[jira] [Resolved] (SPARK-35100) Refactor AFT - support virtual centering

[ https://issues.apache.org/jira/browse/SPARK-35100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-35100. -- Resolution: Fixed > Refactor AFT - support virtual centering >

[jira] [Resolved] (SPARK-35560) Remove redundant subexpression evaluation in nested subexpressions

[ https://issues.apache.org/jira/browse/SPARK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35560. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32699

[jira] [Resolved] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35595. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32725

[jira] [Assigned] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35595: -- Assignee: Gengliang Wang > Support multiple loggers in testing method

[jira] [Updated] (SPARK-35605) Move pandas_on_spark accessor to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35605: Description: Inspired by https://github.com/apache/spark/pull/32729#discussion_r643591322, As

[jira] [Commented] (SPARK-35605) Move pandas_on_spark accessor to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355438#comment-17355438 ] Haejoon Lee commented on SPARK-35605: - I'm working on this > Move pandas_on_spark accessor to the

[jira] [Created] (SPARK-35605) Move pandas_on_spark accessor to the Spark DataFrame.

Haejoon Lee created SPARK-35605: --- Summary: Move pandas_on_spark accessor to the Spark DataFrame. Key: SPARK-35605 URL: https://issues.apache.org/jira/browse/SPARK-35605 Project: Spark Issue

[jira] [Assigned] (SPARK-35539) Restore to_koalas to keep the backward compatibility

[ https://issues.apache.org/jira/browse/SPARK-35539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35539: Assignee: Haejoon Lee > Restore to_koalas to keep the backward compatibility >

[jira] [Resolved] (SPARK-35539) Restore to_koalas to keep the backward compatibility

[ https://issues.apache.org/jira/browse/SPARK-35539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35539. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32729

[jira] [Resolved] (SPARK-35600) Move Set command related test cases to a single test suite

[ https://issues.apache.org/jira/browse/SPARK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35600. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32732

[jira] [Commented] (SPARK-35604) Fix condition check for FULL OUTER sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355428#comment-17355428 ] Apache Spark commented on SPARK-35604: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35604) Fix condition check for FULL OUTER sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35604: Assignee: Apache Spark > Fix condition check for FULL OUTER sort merge join >

[jira] [Assigned] (SPARK-35604) Fix condition check for FULL OUTER sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35604: Assignee: (was: Apache Spark) > Fix condition check for FULL OUTER sort merge join >

[jira] [Created] (SPARK-35604) Fix condition check for FULL OUTER sort merge join

Cheng Su created SPARK-35604: Summary: Fix condition check for FULL OUTER sort merge join Key: SPARK-35604 URL: https://issues.apache.org/jira/browse/SPARK-35604 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35590. -- Resolution: Invalid > pyspark v3.1.1removed pyspark.streaming.kafka? >

[jira] [Comment Edited] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355422#comment-17355422 ] Hyukjin Kwon edited comment on SPARK-35590 at 6/2/21, 1:10 AM: --- I think we

[jira] [Commented] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355422#comment-17355422 ] Hyukjin Kwon commented on SPARK-35590: -- I think we haven't added Kafka support for Dstream. >

[jira] [Updated] (SPARK-35603) Move data source options from R into a single page.

[ https://issues.apache.org/jira/browse/SPARK-35603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35603: Parent: (was: SPARK-34491) Issue Type: Documentation (was: Sub-task) > Move data

[jira] [Updated] (SPARK-35603) Move data source options from R into a single page.

[ https://issues.apache.org/jira/browse/SPARK-35603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35603: Description: We should consolidate the data source options from R documentation as well like we

[jira] [Created] (SPARK-35603) Move data source options from R into a single page.

Haejoon Lee created SPARK-35603: --- Summary: Move data source options from R into a single page. Key: SPARK-35603 URL: https://issues.apache.org/jira/browse/SPARK-35603 Project: Spark Issue

[jira] [Updated] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34909: -- Labels: correctness (was: ) > conv() does not convert negative inputs to unsigned correctly

[jira] [Updated] (SPARK-34756) Fix FileScan equality check

[ https://issues.apache.org/jira/browse/SPARK-34756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34756: -- Labels: correctness (was: ) > Fix FileScan equality check > --- > >

[jira] [Updated] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34737: -- Issue Type: Bug (was: Improvement) > Discrepancy between TIMESTAMP_SECONDS and cast from

[jira] [Updated] (SPARK-34840) Fix cases of corruption in merged shuffle blocks that are pushed

[ https://issues.apache.org/jira/browse/SPARK-34840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-34840: -- Parent: SPARK-30602 Issue Type: Sub-task (was: Bug) > Fix cases of corruption in

[jira] [Updated] (SPARK-34727) Difference in results of casting float to timestamp

[ https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34727: -- Labels: correctness (was: ) > Difference in results of casting float to timestamp >

[jira] [Closed] (SPARK-34540) Add convert_dtypes to the DataFrameLike protocol

[ https://issues.apache.org/jira/browse/SPARK-34540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-34540. - > Add convert_dtypes to the DataFrameLike protocol >

[jira] [Assigned] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35589: - Assignee: Dongjoon Hyun > BlockManagerMasterEndpoint should not ignore index-only

[jira] [Resolved] (SPARK-35589) BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

[ https://issues.apache.org/jira/browse/SPARK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35589. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32727

[jira] [Commented] (SPARK-35580) Support subexpression elimination for higher order functions

[ https://issues.apache.org/jira/browse/SPARK-35580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355326#comment-17355326 ] Apache Spark commented on SPARK-35580: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35580) Support subexpression elimination for higher order functions

[ https://issues.apache.org/jira/browse/SPARK-35580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35580: Assignee: (was: Apache Spark) > Support subexpression elimination for higher order

[jira] [Assigned] (SPARK-35580) Support subexpression elimination for higher order functions

[ https://issues.apache.org/jira/browse/SPARK-35580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35580: Assignee: Apache Spark > Support subexpression elimination for higher order functions >

[jira] [Commented] (SPARK-35580) Support subexpression elimination for higher order functions

[ https://issues.apache.org/jira/browse/SPARK-35580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355325#comment-17355325 ] Apache Spark commented on SPARK-35580: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35423) The output of PCA is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35423: Assignee: (was: Apache Spark) > The output of PCA is inconsistent >

[jira] [Commented] (SPARK-35423) The output of PCA is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355293#comment-17355293 ] Apache Spark commented on SPARK-35423: -- User 'shahidki31' has created a pull request for this

[jira] [Assigned] (SPARK-35423) The output of PCA is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35423: Assignee: Apache Spark > The output of PCA is inconsistent >

[jira] [Updated] (SPARK-35343) Make conversion from/to pandas data-type-based

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35343: - Description: Make the conversion from/to pandas data-type-based. > Make conversion from/to

[jira] [Commented] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355289#comment-17355289 ] Bruce Robbins commented on SPARK-34731: --- I am working from memory, but I remember that you lose

[jira] [Created] (SPARK-35602) Job crashes with java.io.UTFDataFormatException: encoded string too long

dejan miljkovic created SPARK-35602: --- Summary: Job crashes with java.io.UTFDataFormatException: encoded string too long Key: SPARK-35602 URL: https://issues.apache.org/jira/browse/SPARK-35602

[jira] [Resolved] (SPARK-35314) Support arithmetic operations against bool IndexOpsMixin

[ https://issues.apache.org/jira/browse/SPARK-35314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35314. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Created] (SPARK-35601) Support arithmetic operations against bool

Xinrong Meng created SPARK-35601: Summary: Support arithmetic operations against bool Key: SPARK-35601 URL: https://issues.apache.org/jira/browse/SPARK-35601 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35597) CTE With clause not working when using JDBC connection

[ https://issues.apache.org/jira/browse/SPARK-35597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355258#comment-17355258 ] Franck Thang commented on SPARK-35597: -- What's your query ? It seems not related to Spark as your

[jira] [Assigned] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35402: Assignee: Kent Yao > Increase the max thread pool size of jetty server in HistoryServer UI >

[jira] [Resolved] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35402. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32539

[jira] [Comment Edited] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355233#comment-17355233 ] Dongjoon Hyun edited comment on SPARK-35590 at 6/1/21, 4:58 PM: BTW,

[jira] [Commented] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355233#comment-17355233 ] Dongjoon Hyun commented on SPARK-35590: --- BTW, since this is reported to PySpark 3.1.1, cc

[jira] [Assigned] (SPARK-35600) Move Set command related test cases to a single test suite

[ https://issues.apache.org/jira/browse/SPARK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35600: Assignee: Gengliang Wang (was: Apache Spark) > Move Set command related test cases to a

[jira] [Assigned] (SPARK-35600) Move Set command related test cases to a single test suite

[ https://issues.apache.org/jira/browse/SPARK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35600: Assignee: Apache Spark (was: Gengliang Wang) > Move Set command related test cases to a

[jira] [Commented] (SPARK-35600) Move Set command related test cases to a single test suite

[ https://issues.apache.org/jira/browse/SPARK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355218#comment-17355218 ] Apache Spark commented on SPARK-35600: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35600) Move Set command related test cases to a single test suite

[ https://issues.apache.org/jira/browse/SPARK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35600: - Assignee: Gengliang Wang > Move Set command related test cases to a single test suite

[jira] [Created] (SPARK-35600) Move Set command related test cases to a single test suite

Dongjoon Hyun created SPARK-35600: - Summary: Move Set command related test cases to a single test suite Key: SPARK-35600 URL: https://issues.apache.org/jira/browse/SPARK-35600 Project: Spark

[jira] [Created] (SPARK-35599) Introduce a way to compare series of array for older pandas

Xinrong Meng created SPARK-35599: Summary: Introduce a way to compare series of array for older pandas Key: SPARK-35599 URL: https://issues.apache.org/jira/browse/SPARK-35599 Project: Spark

[jira] [Created] (SPARK-35598) Improve Spark-ML PCA analysis

Antonio Zammuto created SPARK-35598: --- Summary: Improve Spark-ML PCA analysis Key: SPARK-35598 URL: https://issues.apache.org/jira/browse/SPARK-35598 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-35402: - Summary: Increase the max thread pool size of jetty server in HistoryServer UI (was: Make thread pool

[jira] [Assigned] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35596: Assignee: Apache Spark > HighlyCompressedMapStatus should record accurately the size of

[jira] [Assigned] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35596: Assignee: (was: Apache Spark) > HighlyCompressedMapStatus should record accurately

[jira] [Commented] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355183#comment-17355183 ] Apache Spark commented on SPARK-35596: -- User 'exmy' has created a pull request for this issue:

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355182#comment-17355182 ] Ismaël Mejía commented on SPARK-35557: -- Spark probably won't support intermediary versions of the

[jira] [Created] (SPARK-35597) CTE With clause not working when using JDBC connection

Randall Suárez created SPARK-35597: -- Summary: CTE With clause not working when using JDBC connection Key: SPARK-35597 URL: https://issues.apache.org/jira/browse/SPARK-35597 Project: Spark

[jira] [Comment Edited] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355166#comment-17355166 ] Doychin Bondzhev edited comment on SPARK-35557 at 6/1/21, 3:25 PM: ---

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355166#comment-17355166 ] Doychin Bondzhev commented on SPARK-35557: -- Same applies to JDK 16 > Adapt uses of JDK 17

[jira] [Created] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

exmy created SPARK-35596: Summary: HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks Key: SPARK-35596 URL: https://issues.apache.org/jira/browse/SPARK-35596 Project: Spark

[jira] [Resolved] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35577. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-35539) Restore to_koalas to keep the backward compatibility

[ https://issues.apache.org/jira/browse/SPARK-35539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-35539: - Priority: Minor (was: Major) > Restore to_koalas to keep the backward compatibility >

[jira] [Commented] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355101#comment-17355101 ] Apache Spark commented on SPARK-35595: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35595: Assignee: (was: Apache Spark) > Support multiple loggers in testing method

[jira] [Commented] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355100#comment-17355100 ] Apache Spark commented on SPARK-35595: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35595) Support multiple loggers in testing method withLogAppender

[ https://issues.apache.org/jira/browse/SPARK-35595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35595: Assignee: Apache Spark > Support multiple loggers in testing method withLogAppender >

[jira] [Created] (SPARK-35595) Support multiple loggers in testing method withLogAppender

Gengliang Wang created SPARK-35595: -- Summary: Support multiple loggers in testing method withLogAppender Key: SPARK-35595 URL: https://issues.apache.org/jira/browse/SPARK-35595 Project: Spark

[jira] [Updated] (SPARK-35563) [SQL] Window operations with over Int.MaxValue + 1 rows can silently drop rows

[ https://issues.apache.org/jira/browse/SPARK-35563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated SPARK-35563: Labels: data-loss (was: ) > [SQL] Window operations with over Int.MaxValue + 1

[jira] [Updated] (SPARK-35563) [SQL] Window operations with over Int.MaxValue + 1 rows can silently drop rows

[ https://issues.apache.org/jira/browse/SPARK-35563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated SPARK-35563: Priority: Blocker (was: Major) > [SQL] Window operations with over Int.MaxValue

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355088#comment-17355088 ] Robert Joseph Evans commented on SPARK-35089: - I should add that the above "solution" is

[jira] [Commented] (SPARK-35594) Remove duplicate installations in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-35594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355086#comment-17355086 ] Apache Spark commented on SPARK-35594: -- User 'pingsutw' has created a pull request for this issue:

[jira] [Commented] (SPARK-35594) Remove duplicate installations in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-35594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355085#comment-17355085 ] Apache Spark commented on SPARK-35594: -- User 'pingsutw' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35594) Remove duplicate installations in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-35594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35594: Assignee: Apache Spark > Remove duplicate installations in build_and_test.yml >

[jira] [Assigned] (SPARK-35594) Remove duplicate installations in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-35594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35594: Assignee: (was: Apache Spark) > Remove duplicate installations in build_and_test.yml

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355083#comment-17355083 ] Robert Joseph Evans commented on SPARK-35089: - [~Tonzetic] to be clear my point was just to

[jira] [Assigned] (SPARK-35516) Storage UI tab Storage Level tool tip correction

[ https://issues.apache.org/jira/browse/SPARK-35516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-35516: -- Assignee: Lidiya Nixon > Storage UI tab Storage Level tool tip correction >

[jira] [Created] (SPARK-35594) Remove duplicate installations in build_and_test.yml

Kevin Su created SPARK-35594: Summary: Remove duplicate installations in build_and_test.yml Key: SPARK-35594 URL: https://issues.apache.org/jira/browse/SPARK-35594 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35593) Support shuffle data recovery on the reused PVCs

[ https://issues.apache.org/jira/browse/SPARK-35593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35593: Assignee: (was: Apache Spark) > Support shuffle data recovery on the reused PVCs >

[jira] [Commented] (SPARK-35593) Support shuffle data recovery on the reused PVCs

[ https://issues.apache.org/jira/browse/SPARK-35593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355082#comment-17355082 ] Apache Spark commented on SPARK-35593: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-35593) Support shuffle data recovery on the reused PVCs

[ https://issues.apache.org/jira/browse/SPARK-35593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35593: Assignee: Apache Spark > Support shuffle data recovery on the reused PVCs >

[jira] [Created] (SPARK-35593) Support shuffle data recovery on the reused PVCs

Dongjoon Hyun created SPARK-35593: - Summary: Support shuffle data recovery on the reused PVCs Key: SPARK-35593 URL: https://issues.apache.org/jira/browse/SPARK-35593 Project: Spark Issue

[jira] [Commented] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355078#comment-17355078 ] Dongjoon Hyun commented on SPARK-35590: --- Hi. The image is broken. Could you describe more about

[jira] [Resolved] (SPARK-35581) Casting special strings to DATE/TIMESTAMP returns inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-35581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35581. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32714

  1   2   >