[jira] [Resolved] (SPARK-25673) Remove Travis CI which enables Java lint check

[ https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25673. -- Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-25673) Remove Travis CI which enables Java lint check

[ https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25673: Assignee: Hyukjin Kwon > Remove Travis CI which enables Java lint check >

[jira] [Created] (SPARK-25678) SPIP: Adding support in Spark for HPC cluster manager (PBS Professional)

Utkarsh Maheshwari created SPARK-25678: -- Summary: SPIP: Adding support in Spark for HPC cluster manager (PBS Professional) Key: SPARK-25678 URL: https://issues.apache.org/jira/browse/SPARK-25678

[jira] [Commented] (SPARK-25632) KafkaRDDSuite: compacted topic 2 min 5 sec.

[ https://issues.apache.org/jira/browse/SPARK-25632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641397#comment-16641397 ] Apache Spark commented on SPARK-25632: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-25631) KafkaRDDSuite: basic usage 2 min 4 sec

[ https://issues.apache.org/jira/browse/SPARK-25631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641394#comment-16641394 ] Apache Spark commented on SPARK-25631: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-25632) KafkaRDDSuite: compacted topic 2 min 5 sec.

[ https://issues.apache.org/jira/browse/SPARK-25632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641396#comment-16641396 ] Apache Spark commented on SPARK-25632: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25632) KafkaRDDSuite: compacted topic 2 min 5 sec.

[ https://issues.apache.org/jira/browse/SPARK-25632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25632: Assignee: (was: Apache Spark) > KafkaRDDSuite: compacted topic 2 min 5 sec. >

[jira] [Assigned] (SPARK-25631) KafkaRDDSuite: basic usage 2 min 4 sec

[ https://issues.apache.org/jira/browse/SPARK-25631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25631: Assignee: (was: Apache Spark) > KafkaRDDSuite: basic usage2 min 4 sec >

[jira] [Commented] (SPARK-25677) [Spark Compression] spark.io.compression.codec = org.apache.spark.io.ZstdCompressionCodec throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641392#comment-16641392 ] Apache Spark commented on SPARK-25677: -- User 'shivusondur' has created a pull request for this

[jira] [Assigned] (SPARK-25677) [Spark Compression] spark.io.compression.codec = org.apache.spark.io.ZstdCompressionCodec throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25677: Assignee: (was: Apache Spark) > [Spark Compression] spark.io.compression.codec = >

[jira] [Commented] (SPARK-25677) [Spark Compression] spark.io.compression.codec = org.apache.spark.io.ZstdCompressionCodec throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641391#comment-16641391 ] Apache Spark commented on SPARK-25677: -- User 'shivusondur' has created a pull request for this

[jira] [Assigned] (SPARK-25677) [Spark Compression] spark.io.compression.codec = org.apache.spark.io.ZstdCompressionCodec throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25677: Assignee: Apache Spark > [Spark Compression] spark.io.compression.codec = >

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638226#comment-16638226 ] Michael Heuer edited comment on SPARK-25588 at 10/8/18 6:16 AM: >

[jira] [Assigned] (SPARK-25631) KafkaRDDSuite: basic usage 2 min 4 sec

[ https://issues.apache.org/jira/browse/SPARK-25631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25631: Assignee: Apache Spark > KafkaRDDSuite: basic usage2 min 4 sec >

[jira] [Assigned] (SPARK-25632) KafkaRDDSuite: compacted topic 2 min 5 sec.

[ https://issues.apache.org/jira/browse/SPARK-25632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25632: Assignee: Apache Spark > KafkaRDDSuite: compacted topic 2 min 5 sec. >

[jira] [Commented] (SPARK-25631) KafkaRDDSuite: basic usage 2 min 4 sec

[ https://issues.apache.org/jira/browse/SPARK-25631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641395#comment-16641395 ] Apache Spark commented on SPARK-25631: -- User 'dilipbiswal' has created a pull request for this

[jira] [Updated] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-25677: - Description: To check the Event Log compression size with different compression

[jira] [Assigned] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25591: Assignee: Liang-Chi Hsieh > PySpark Accumulators with multiple PythonUDFs >

[jira] [Resolved] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25591. -- Resolution: Fixed Fix Version/s: 2.4.1 Fixed in

[jira] [Resolved] (SPARK-25282) Document custom builds needed for K8S development

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25282. - Resolution: Not A Problem Fix Version/s: 3.0.0 Looks like this is working

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641516#comment-16641516 ] Jackey Lee commented on SPARK-24630: [~kabhwan] The DDL in SQLStreaming has nothing change with

[jira] [Commented] (SPARK-25643) Performance issues querying wide rows

[ https://issues.apache.org/jira/browse/SPARK-25643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641554#comment-16641554 ] Liang-Chi Hsieh commented on SPARK-25643: - {quote}predicate push down is not helping: either

[jira] [Assigned] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25615: Assignee: Apache Spark > KafkaSinkSuite: streaming - write to non-existing topic 1 min >

[jira] [Commented] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641566#comment-16641566 ] Apache Spark commented on SPARK-25615: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25615: Assignee: (was: Apache Spark) > KafkaSinkSuite: streaming - write to non-existing

[jira] [Resolved] (SPARK-25666) Internally document type conversion between Python data and SQL types in UDFs

[ https://issues.apache.org/jira/browse/SPARK-25666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25666. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22655

[jira] [Assigned] (SPARK-25666) Internally document type conversion between Python data and SQL types in UDFs

[ https://issues.apache.org/jira/browse/SPARK-25666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25666: Assignee: Hyukjin Kwon > Internally document type conversion between Python data and SQL

[jira] [Resolved] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25677. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Issue resolved by pull

[jira] [Assigned] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25677: Assignee: shivusondur > Configuring zstd compression in JDBC throwing

[jira] [Comment Edited] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641516#comment-16641516 ] Jackey Lee edited comment on SPARK-24630 at 10/8/18 8:36 AM: - [~kabhwan]

[jira] [Updated] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neenu updated SPARK-25679: -- Issue Type: Question (was: Bug) > OOM Killed observed for spark thrift executors with dynamic allocation >

[jira] [Updated] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25674: Priority: Minor (was: Trivial) > If the records are incremented by more than 1 at a time,the number of

[jira] [Commented] (SPARK-25605) CastSuite: cast string to timestamp 2 mins 31 sec

[ https://issues.apache.org/jira/browse/SPARK-25605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641812#comment-16641812 ] Apache Spark commented on SPARK-25605: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

neenu created SPARK-25679: - Summary: OOM Killed observed for spark thrift executors with dynamic allocation enabled Key: SPARK-25679 URL: https://issues.apache.org/jira/browse/SPARK-25679 Project: Spark

[jira] [Commented] (SPARK-25663) Refactor BuiltInDataSourceWriteBenchmark and DataSourceWriteBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641791#comment-16641791 ] Gengliang Wang commented on SPARK-25663: I wonder whether we should do this. The current

[jira] [Assigned] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25291: - Assignee: Ilan Filonenko > Flakiness of tests in terms of executor memory

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642036#comment-16642036 ] Apache Spark commented on SPARK-20144: -- User 'darabos' has created a pull request for this issue:

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642038#comment-16642038 ] Apache Spark commented on SPARK-20144: -- User 'darabos' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25283) A deadlock in UnionRDD

[ https://issues.apache.org/jira/browse/SPARK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25283: - Assignee: Maxim Gekk > A deadlock in UnionRDD > -- > >

[jira] [Assigned] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25295: - Assignee: Stavros Kontopoulos > Pod names conflicts in client mode, if previous

[jira] [Commented] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642055#comment-16642055 ] Dongjoon Hyun commented on SPARK-25295: --- Hi, [~liyinan926] . Please update the assignee together

[jira] [Resolved] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

[ https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-25641. --- Resolution: Fixed Fix Version/s: 3.0.0 > Change the

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642233#comment-16642233 ] Dongjoon Hyun commented on SPARK-25680: --- Hi, [~cloud_fan] . Is this targeting both Spark 3.0 and

[jira] [Assigned] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

[ https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-25641: - Assignee: Sanket Reddy > Change the

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Priority: Blocker (was: Critical) > Use quoted attribute names if needed in pushed ORC

[jira] [Commented] (SPARK-16707) TransportClientFactory.createClient may throw NPE

[ https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642191#comment-16642191 ] John Zhuge commented on SPARK-16707: Saw the same NPE with 2.1.1: {noformat}

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642200#comment-16642200 ] Michael Heuer commented on SPARK-25588: --- I moved the version back to 2.3.2, see

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Labels: correctness (was: data-loss) > PySpark Accumulators with multiple PythonUDFs >

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Priority: Blocker (was: Critical) > PySpark Accumulators with multiple PythonUDFs >

[jira] [Assigned] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

[ https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-25639: - Assignee: Tathagata Das > Add documentation on foreachBatch, and multiple watermark

[jira] [Resolved] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

[ https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-25639. --- Resolution: Fixed Fix Version/s: 2.4.1 Issue resolved by pull request 22627

[jira] [Assigned] (SPARK-25623) LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec

[ https://issues.apache.org/jira/browse/SPARK-25623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25623: - Assignee: shahid > LogisticRegressionSuite: multinomial logistic regression with intercept

[jira] [Assigned] (SPARK-25625) LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec

[ https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25625: - Assignee: shahid > LogisticRegressionSuite.binary logistic regression with intercept with >

[jira] [Resolved] (SPARK-25625) LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec

[ https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25625. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659

[jira] [Resolved] (SPARK-25624) LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds

[ https://issues.apache.org/jira/browse/SPARK-25624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25624. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659

[jira] [Assigned] (SPARK-25624) LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds

[ https://issues.apache.org/jira/browse/SPARK-25624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25624: - Assignee: shahid > LogisticRegressionSuite.multinomial logistic regression with intercept with

[jira] [Resolved] (SPARK-25623) LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec

[ https://issues.apache.org/jira/browse/SPARK-25623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25623. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659

[jira] [Created] (SPARK-25683) Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0

Devaraj K created SPARK-25683: - Summary: Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0 Key: SPARK-25683 URL: https://issues.apache.org/jira/browse/SPARK-25683

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642506#comment-16642506 ] Xiao Li commented on SPARK-25591: - RC3 is not out yet. Thus, RC3 will include the fix. > PySpark

[jira] [Resolved] (SPARK-25659) Test type inference specification for createDataFrame in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25659. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22653

[jira] [Assigned] (SPARK-25659) Test type inference specification for createDataFrame in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25659: Assignee: Hyukjin Kwon > Test type inference specification for createDataFrame in

[jira] [Created] (SPARK-25682) Docker images generated from dev build and from dist tarball are different

Marcelo Vanzin created SPARK-25682: -- Summary: Docker images generated from dev build and from dist tarball are different Key: SPARK-25682 URL: https://issues.apache.org/jira/browse/SPARK-25682

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Fix Version/s: (was: 2.4.1) 2.4.0 > PySpark Accumulators with multiple PythonUDFs

[jira] [Assigned] (SPARK-25347) Document image data source in doc site

[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25347: Assignee: (was: Apache Spark) > Document image data source in doc site >

[jira] [Commented] (SPARK-25347) Document image data source in doc site

[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642727#comment-16642727 ] Apache Spark commented on SPARK-25347: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-25347) Document image data source in doc site

[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25347: Assignee: Apache Spark > Document image data source in doc site >

[jira] [Commented] (SPARK-17570) Avoid Hash and Exchange in Sort Merge join if bucketing factor is multiple for tables

[ https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642730#comment-16642730 ] Wang, Gang commented on SPARK-17570: Any update? > Avoid Hash and Exchange in Sort Merge join if

[jira] [Commented] (SPARK-16707) TransportClientFactory.createClient may throw NPE

[ https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642699#comment-16642699 ] John Zhuge commented on SPARK-16707: Did the channel get closed here?

[jira] [Updated] (SPARK-25408) Move to idiomatic Java 8

[ https://issues.apache.org/jira/browse/SPARK-25408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25408: -- Priority: Minor (was: Major) > Move to idiomatic Java 8 > > >

[jira] [Created] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

Wenchen Fan created SPARK-25680: --- Summary: SQL execution listener shouldn't happen on execution thread Key: SPARK-25680 URL: https://issues.apache.org/jira/browse/SPARK-25680 Project: Spark

[jira] [Updated] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Heuer updated SPARK-25588: -- Affects Version/s: (was: 2.4.0) 2.3.2 > SchemaParseException:

[jira] [Updated] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Heuer updated SPARK-25588: -- Environment: Spark version 2.3.2 (was: Spark version 2.4.0 (RC2). {noformat} $ spark-submit

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642201#comment-16642201 ] Apache Spark commented on SPARK-25680: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642202#comment-16642202 ] Apache Spark commented on SPARK-25680: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25680: Assignee: Apache Spark (was: Wenchen Fan) > SQL execution listener shouldn't happen on

[jira] [Assigned] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25680: Assignee: Wenchen Fan (was: Apache Spark) > SQL execution listener shouldn't happen on

[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642379#comment-16642379 ] Bryan Cutler commented on SPARK-25461: -- Just wanted to add that the resolution here added a note

[jira] [Commented] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642393#comment-16642393 ] Yuming Wang commented on SPARK-25679: - Thanks [~nanndomi], Could you provide which query are getting

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642401#comment-16642401 ] Daniel Darabos commented on SPARK-20144: Sorry, I had an idea for a quick fix for this and sent

[jira] [Resolved] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25630. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 >

[jira] [Updated] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25681: --- Labels: Hadoop Kerberos (was: ) > Delegation Tokens fetched twice upon

[jira] [Created] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

Ilan Filonenko created SPARK-25681: -- Summary: Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation Key: SPARK-25681 URL: https://issues.apache.org/jira/browse/SPARK-25681