[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506792#comment-16506792 ] Yu-Jhe Li commented on SPARK-24492: --- [~ste...@apache.org]: i thinks the TaskCommitDeni

[jira] [Resolved] (SPARK-24468) DecimalType `adjustPrecisionScale` might fail when scale is negative

[ https://issues.apache.org/jira/browse/SPARK-24468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24468. - Resolution: Fixed Fix Version/s: 2.3.2 2.4.0 Issue resolved by pull re

[jira] [Assigned] (SPARK-24468) DecimalType `adjustPrecisionScale` might fail when scale is negative

[ https://issues.apache.org/jira/browse/SPARK-24468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24468: --- Assignee: Marco Gaido > DecimalType `adjustPrecisionScale` might fail when scale is negativ

[jira] [Resolved] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24412. - Resolution: Fixed > Adding docs about automagical type casting in `isin` and `isInCollection` APIs > ---

[jira] [Commented] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506730#comment-16506730 ] Apache Spark commented on SPARK-24412: -- User 'trvskn' has created a pull request fo

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24412: Assignee: thrvskn (was: Apache Spark) > Adding docs about automagical type casting in `i

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24412: Assignee: Apache Spark (was: thrvskn) > Adding docs about automagical type casting in `i

[jira] [Assigned] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24502: Assignee: Apache Spark (was: Wenchen Fan) > flaky test: UnsafeRowSerializerSuite > -

[jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506728#comment-16506728 ] Apache Spark commented on SPARK-24502: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24502: Assignee: Wenchen Fan (was: Apache Spark) > flaky test: UnsafeRowSerializerSuite > -

[jira] [Created] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

Wenchen Fan created SPARK-24502: --- Summary: flaky test: UnsafeRowSerializerSuite Key: SPARK-24502 URL: https://issues.apache.org/jira/browse/SPARK-24502 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24502: Description: https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4193/testReport

[jira] [Updated] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24502: Labels: flaky-test (was: ) > flaky test: UnsafeRowSerializerSuite > -

[jira] [Commented] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506709#comment-16506709 ] Nicholas Parker commented on SPARK-24501: - PR: https://github.com/apache/spark/p

[jira] [Issue Comment Deleted] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Parker updated SPARK-24501: Comment: was deleted (was: PR: https://github.com/apache/spark/pull/21516) > Add metrics

[jira] [Assigned] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24501: Assignee: (was: Apache Spark) > Add metrics for Mesos Driver and Dispatcher > ---

[jira] [Commented] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506707#comment-16506707 ] Apache Spark commented on SPARK-24501: -- User 'nickbp' has created a pull request fo

[jira] [Assigned] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24501: Assignee: Apache Spark > Add metrics for Mesos Driver and Dispatcher > --

[jira] [Assigned] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24372: Assignee: (was: Apache Spark) > Create script for preparing RCs > ---

[jira] [Assigned] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24372: Assignee: Apache Spark > Create script for preparing RCs > --

[jira] [Commented] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506703#comment-16506703 ] Apache Spark commented on SPARK-24372: -- User 'vanzin' has created a pull request fo

[jira] [Created] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

Nicholas Parker created SPARK-24501: --- Summary: Add metrics for Mesos Driver and Dispatcher Key: SPARK-24501 URL: https://issues.apache.org/jira/browse/SPARK-24501 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch

[ https://issues.apache.org/jira/browse/SPARK-24106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-24106: --- Fix Version/s: (was: 2.4.0) (was: 2.3.0) > Spark Structure Stream

[jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch

[ https://issues.apache.org/jira/browse/SPARK-24106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-24106: --- Target Version/s: (was: 2.2.1, 2.3.0) > Spark Structure Streaming with RF model taking lon

[jira] [Assigned] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22860: Assignee: (was: Apache Spark) > Spark workers log ssl passwords passed to the executo

[jira] [Assigned] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22860: Assignee: Apache Spark > Spark workers log ssl passwords passed to the executors > --

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506693#comment-16506693 ] Apache Spark commented on SPARK-22860: -- User 'tooptoop4' has created a pull request

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-24412: --- Assignee: thrvskn > Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[jira] [Resolved] (SPARK-23010) Add integration testing for Kubernetes backend into the apache/spark repository

[ https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-23010. Resolution: Fixed Fix Version/s: 2.4.0 Some tests are missing but we got a basic set of the

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM:

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM:

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506521#comment-16506521 ] Felix Cheung commented on SPARK-24359: -- Thanks Joseph - correct one possibility is

[jira] [Commented] (SPARK-19826) spark.ml Python API for PIC

[ https://issues.apache.org/jira/browse/SPARK-19826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506503#comment-16506503 ] Apache Spark commented on SPARK-19826: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-24500) UnsupportedOperationException when trying to execute Union plan with Stream of children

Bogdan Raducanu created SPARK-24500: --- Summary: UnsupportedOperationException when trying to execute Union plan with Stream of children Key: SPARK-24500 URL: https://issues.apache.org/jira/browse/SPARK-24500

[jira] [Updated] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-22666: -- Target Version/s: 2.4.0 > Spark datasource for image format >

[jira] [Commented] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506471#comment-16506471 ] Xiangrui Meng commented on SPARK-22666: --- [~mhamilton] Do you want to take this tas

[jira] [Updated] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-22666: -- Shepherd: Xiangrui Meng > Spark datasource for image format >

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Fixed > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType

[jira] [Resolved] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24217. Resolution: Fixed > Power Iteration Clustering is not displaying cluster indices corresponding to > some

[jira] [Resolved] (SPARK-23984) PySpark Bindings for K8S

[ https://issues.apache.org/jira/browse/SPARK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-23984. Resolution: Fixed Fix Version/s: 2.4.0 > PySpark Bindings for K8S > ---

[jira] [Commented] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506456#comment-16506456 ] Wenchen Fan commented on SPARK-20712: - I looked into this. This is actually a hive b

[jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-17756: Assignee: Hyukjin Kwon > java.lang.ClassCastException when using cartesian with DStream.t

[jira] [Resolved] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-17756. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 19498 [https://gi

[jira] [Commented] (SPARK-24258) SPIP: Improve PySpark support for ML Matrix and Vector types

[ https://issues.apache.org/jira/browse/SPARK-24258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506399#comment-16506399 ] Li Jin commented on SPARK-24258: I ran into [~mengxr] and chatted about this. Seems a go

[jira] [Comment Edited] (SPARK-24467) VectorAssemblerEstimator

[ https://issues.apache.org/jira/browse/SPARK-24467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506334#comment-16506334 ] Nick Pentreath edited comment on SPARK-24467 at 6/8/18 5:59 PM: --

[jira] [Commented] (SPARK-24467) VectorAssemblerEstimator

[ https://issues.apache.org/jira/browse/SPARK-24467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506334#comment-16506334 ] Nick Pentreath commented on SPARK-24467: Yeah the estimator would return a {{Mod

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506285#comment-16506285 ] Li Yuanjian commented on SPARK-24499: - No problem, thanks for ping me, our pleasure.

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506250#comment-16506250 ] Xiao Li commented on SPARK-24498: - Thank you! > Add JDK compiler for runtime codegen >

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506239#comment-16506239 ] Kazuaki Ishizaki commented on SPARK-24498: -- Hi [~smilegator] Definetely, I am i

[jira] [Resolved] (SPARK-24454) ml.image doesn't have __all__ explicitly defined

[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24454. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21483 [https://

[jira] [Assigned] (SPARK-24454) ml.image doesn't have __all__ explicitly defined

[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24454: - Assignee: Hyukjin Kwon > ml.image doesn't have __all__ explicitly defined > ---

[jira] [Assigned] (SPARK-24477) Import submodules under pyspark.ml by default

[ https://issues.apache.org/jira/browse/SPARK-24477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24477: - Assignee: Hyukjin Kwon > Import submodules under pyspark.ml by default > --

[jira] [Resolved] (SPARK-24477) Import submodules under pyspark.ml by default

[ https://issues.apache.org/jira/browse/SPARK-24477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24477. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21483 [https://

[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506232#comment-16506232 ] Jiang Xingbo commented on SPARK-24492: -- It is possible that one task attempt acquir

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506219#comment-16506219 ] Xiao Li commented on SPARK-24499: - Apache Spark is widely adopted in the production syst

[jira] [Created] (SPARK-24499) Documentation improvement of Spark core and SQL

Xiao Li created SPARK-24499: --- Summary: Documentation improvement of Spark core and SQL Key: SPARK-24499 URL: https://issues.apache.org/jira/browse/SPARK-24499 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24499: Component/s: Spark Core Documentation > Documentation improvement of Spark core and SQL >

[jira] [Commented] (SPARK-24481) GeneratedIteratorForCodegenStage1 grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-24481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506183#comment-16506183 ] Marco Gaido commented on SPARK-24481: - Yes, because before SPARK-22520 code generati

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506159#comment-16506159 ] Xiao Li commented on SPARK-24498: - cc [~kiszk] Are you interested in this task? Could yo

[jira] [Created] (SPARK-24498) Add JDK compiler for runtime codegen

Xiao Li created SPARK-24498: --- Summary: Add JDK compiler for runtime codegen Key: SPARK-24498 URL: https://issues.apache.org/jira/browse/SPARK-24498 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-24191) Scala example code for Power Iteration Clustering in Spark ML examples

[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24191. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21248 [https://github.c

[jira] [Resolved] (SPARK-24224) Java example code for Power Iteration Clustering in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-24224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24224. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21283 [https://github.c

[jira] [Assigned] (SPARK-24224) Java example code for Power Iteration Clustering in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-24224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24224: - Assignee: shahid Target Version/s: (was: 2.4.0) Priority: Trivial (wa

[jira] [Assigned] (SPARK-24191) Scala example code for Power Iteration Clustering in Spark ML examples

[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24191: - Assignee: shahid Target Version/s: (was: 2.4.0) Priority: Trivial (wa

[jira] [Created] (SPARK-24497) Support recursive SQL query

Yuming Wang created SPARK-24497: --- Summary: Support recursive SQL query Key: SPARK-24497 URL: https://issues.apache.org/jira/browse/SPARK-24497 Project: Spark Issue Type: New Feature C

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506023#comment-16506023 ] Saisai Shao commented on SPARK-23534: - Yes, it is a Hadoop 2.8+ issue, but we don't

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506021#comment-16506021 ] Steve Loughran commented on SPARK-23534: [~jerryshao] is that the HDFS token ide

[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506009#comment-16506009 ] Steve Loughran commented on SPARK-24492: the retry problem looks like something

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24492: --- Summary: Endless attempted task when TaskCommitDenied exception writing to S3A (was: Endles

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Priority: Minor (was: Major) > java.net.SocketTimeoutException: Read timed out under jets3t

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Summary: java.net.SocketTimeoutException: Read timed out under jets3t while running the Spar

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Component/s: (was: Spark Core) Structured Streaming > java.net.SocketTi

[jira] [Commented] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506002#comment-16506002 ] Steve Loughran commented on SPARK-24476: Switch from s3n to the s3a connector, s

[jira] [Commented] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

[ https://issues.apache.org/jira/browse/SPARK-24496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506001#comment-16506001 ] SHAILENDRA SHAHANE commented on SPARK-24496: This issue is still there . I t

[jira] [Updated] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

[ https://issues.apache.org/jira/browse/SPARK-24496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHAILENDRA SHAHANE updated SPARK-24496: --- Attachment: SparkJiraIssue08062018.txt > CLONE - JSON data source fails to infer flo

[jira] [Created] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

SHAILENDRA SHAHANE created SPARK-24496: -- Summary: CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision. Key: SPARK-24496 URL: https://is

[jira] [Created] (SPARK-24495) SortMergeJoin with duplicate keys wrong results

Bogdan Raducanu created SPARK-24495: --- Summary: SortMergeJoin with duplicate keys wrong results Key: SPARK-24495 URL: https://issues.apache.org/jira/browse/SPARK-24495 Project: Spark Issue T

[jira] [Resolved] (SPARK-24119) Add interpreted execution to SortPrefix expression

[ https://issues.apache.org/jira/browse/SPARK-24119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24119. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 2.4.0 > Add

[jira] [Created] (SPARK-24494) Give users possibility to skip own classes in SparkContext.getCallSite()

Florian Kaspar created SPARK-24494: -- Summary: Give users possibility to skip own classes in SparkContext.getCallSite() Key: SPARK-24494 URL: https://issues.apache.org/jira/browse/SPARK-24494 Project:

[jira] [Resolved] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-24487. - Resolution: Won't Fix > Add support for RabbitMQ. > - > >

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505786#comment-16505786 ] Saisai Shao commented on SPARK-24487: - I'm sure Spark community will not merge this

[jira] [Updated] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-23151: Issue Type: Sub-task (was: Dependency upgrade) Parent: SPARK-23534 > Provide a distributi

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505783#comment-16505783 ] Saisai Shao commented on SPARK-23151: - I will convert this as a subtask of SPARK-235