[jira] [Updated] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23532: Description: Currently Spark on Yarn supports better data locality by considering the preferred locations

[jira] [Assigned] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23532: Assignee: (was: Apache Spark) > [STANDALONE] Improve data locality when launching new

[jira] [Commented] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379906#comment-16379906 ] Apache Spark commented on SPARK-23532: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23532: Assignee: Apache Spark > [STANDALONE] Improve data locality when launching new executors

[jira] [Updated] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

[ https://issues.apache.org/jira/browse/SPARK-23530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxianjiao updated SPARK-23530: Priority: Critical (was: Major) > It's not appropriate to let the original master exit while the

[jira] [Updated] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23532: Description: Currently Spark on Yarn supports better data locality by considering the preferred locations

[jira] [Updated] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-23532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23532: Description: Currently Spark on Yarn supports better data locality by considering the preferred locations

[jira] [Assigned] (SPARK-23533) Add support for changing ContinuousDataReader's startOffset

[ https://issues.apache.org/jira/browse/SPARK-23533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23533: Assignee: Apache Spark > Add support for changing ContinuousDataReader's startOffset >

[jira] [Assigned] (SPARK-23533) Add support for changing ContinuousDataReader's startOffset

[ https://issues.apache.org/jira/browse/SPARK-23533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23533: Assignee: (was: Apache Spark) > Add support for changing ContinuousDataReader's

[jira] [Commented] (SPARK-23533) Add support for changing ContinuousDataReader's startOffset

[ https://issues.apache.org/jira/browse/SPARK-23533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379897#comment-16379897 ] Apache Spark commented on SPARK-23533: -- User 'xuanyuanking' has created a pull request for this

[jira] [Updated] (SPARK-23533) Add support for changing ContinuousDataReader's startOffset

[ https://issues.apache.org/jira/browse/SPARK-23533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Yuanjian updated SPARK-23533: Summary: Add support for changing ContinuousDataReader's startOffset (was: Add support for

[jira] [Created] (SPARK-23533) Add support for changing ContinousDataReader's startOffset

Li Yuanjian created SPARK-23533: --- Summary: Add support for changing ContinousDataReader's startOffset Key: SPARK-23533 URL: https://issues.apache.org/jira/browse/SPARK-23533 Project: Spark

[jira] [Created] (SPARK-23532) [STANDALONE] Improve data locality when launching new executors for dynamic allocation

liuxian created SPARK-23532: --- Summary: [STANDALONE] Improve data locality when launching new executors for dynamic allocation Key: SPARK-23532 URL: https://issues.apache.org/jira/browse/SPARK-23532

[jira] [Commented] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379807#comment-16379807 ] Astha Arya commented on SPARK-14922: Any updates ?   > Alter Table Drop Partition Using

[jira] [Created] (SPARK-23531) When explain, plan's output should include attribute type info

Wenchen Fan created SPARK-23531: --- Summary: When explain, plan's output should include attribute type info Key: SPARK-23531 URL: https://issues.apache.org/jira/browse/SPARK-23531 Project: Spark

[jira] [Commented] (SPARK-23498) Accuracy problem in comparison with string and integer

[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379753#comment-16379753 ] Kevin Zhang commented on SPARK-23498: - yes, thanks. But when we use spark sql to run existing hive

[jira] [Updated] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

[ https://issues.apache.org/jira/browse/SPARK-23530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxianjiao updated SPARK-23530: Affects Version/s: 2.3.0 > It's not appropriate to let the original master exit while the leader

[jira] [Issue Comment Deleted] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

[ https://issues.apache.org/jira/browse/SPARK-23530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxianjiao updated SPARK-23530: Comment: was deleted (was: When the leader of zookeeper shutdown,the current method of spark is

[jira] [Updated] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

[ https://issues.apache.org/jira/browse/SPARK-23530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxianjiao updated SPARK-23530: Description: When the leader of zookeeper shutdown,the current method of spark is letting the

[jira] [Commented] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

[ https://issues.apache.org/jira/browse/SPARK-23530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379723#comment-16379723 ] liuxianjiao commented on SPARK-23530: - When the leader of zookeeper shutdown,the current method of

[jira] [Created] (SPARK-23530) It's not appropriate to let the original master exit while the leader of zookeeper shutdown

liuxianjiao created SPARK-23530: --- Summary: It's not appropriate to let the original master exit while the leader of zookeeper shutdown Key: SPARK-23530 URL: https://issues.apache.org/jira/browse/SPARK-23530

[jira] [Assigned] (SPARK-23096) Migrate rate source to v2

[ https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23096: Assignee: Apache Spark > Migrate rate source to v2 > - > >

[jira] [Commented] (SPARK-23096) Migrate rate source to v2

[ https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379665#comment-16379665 ] Apache Spark commented on SPARK-23096: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23096) Migrate rate source to v2

[ https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23096: Assignee: (was: Apache Spark) > Migrate rate source to v2 > -

[jira] [Resolved] (SPARK-23448) Dataframe returns wrong result when column don't respect datatype

[ https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23448. -- Resolution: Fixed Fix Version/s: 2.3.1 Issue resolved by pull request 20666

[jira] [Assigned] (SPARK-23448) Dataframe returns wrong result when column don't respect datatype

[ https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23448: Assignee: Liang-Chi Hsieh > Dataframe returns wrong result when column don't respect

[jira] [Resolved] (SPARK-22968) java.lang.IllegalStateException: No current assignment for partition kssh-2

[ https://issues.apache.org/jira/browse/SPARK-22968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson resolved SPARK-22968. Resolution: Fixed > java.lang.IllegalStateException: No current assignment for partition kssh-2 >

[jira] [Commented] (SPARK-22968) java.lang.IllegalStateException: No current assignment for partition kssh-2

[ https://issues.apache.org/jira/browse/SPARK-22968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379639#comment-16379639 ] Jepson commented on SPARK-22968: It's been a long time.I close it first. >

[jira] [Comment Edited] (SPARK-13210) NPE in Sort

[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379614#comment-16379614 ] Lulu Cheng edited comment on SPARK-13210 at 2/28/18 1:23 AM: - [~Aspecting]

[jira] [Commented] (SPARK-13210) NPE in Sort

[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379614#comment-16379614 ] Lulu Cheng commented on SPARK-13210: [~Aspecting] Were you able to get around that, looking at a

[jira] [Updated] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suman Somasundar updated SPARK-23529: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-18278) >

[jira] [Assigned] (SPARK-23417) pyspark tests give wrong sbt instructions

[ https://issues.apache.org/jira/browse/SPARK-23417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23417: Assignee: Bruce Robbins > pyspark tests give wrong sbt instructions >

[jira] [Resolved] (SPARK-23417) pyspark tests give wrong sbt instructions

[ https://issues.apache.org/jira/browse/SPARK-23417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23417. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20638

[jira] [Commented] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379516#comment-16379516 ] Liang-Chi Hsieh commented on SPARK-23471: - I can't reproduce this. With `fit`, the params are

[jira] [Created] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

Suman Somasundar created SPARK-23529: Summary: Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes Key: SPARK-23529 URL:

[jira] [Updated] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suman Somasundar updated SPARK-23529: - Priority: Minor (was: Blocker) > Specify hostpath volume and mount the volume in Spark

[jira] [Created] (SPARK-23528) Expose vital statistics of GaussianMixtureModel

Erich Schubert created SPARK-23528: -- Summary: Expose vital statistics of GaussianMixtureModel Key: SPARK-23528 URL: https://issues.apache.org/jira/browse/SPARK-23528 Project: Spark Issue

[jira] [Comment Edited] (SPARK-23333) SparkML VectorAssembler.transform slow when needing to invoke .first() on sorted DataFrame

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379296#comment-16379296 ] Bago Amirbekian edited comment on SPARK-2 at 2/27/18 9:24 PM: --

[jira] [Commented] (SPARK-23333) SparkML VectorAssembler.transform slow when needing to invoke .first() on sorted DataFrame

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379296#comment-16379296 ] Bago Amirbekian commented on SPARK-2: - [~MBALearnsToCode] you can use a `VectorSizeHint` 

[jira] [Commented] (SPARK-19947) RFormulaModel always throws Exception on transforming data with NULL or Unseen labels

[ https://issues.apache.org/jira/browse/SPARK-19947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379282#comment-16379282 ] Bago Amirbekian commented on SPARK-19947: - I think this was resolved by

[jira] [Created] (SPARK-23527) Error with spark-submit and kerberos with TLS-enabled Hadoop cluster

Ron Gonzalez created SPARK-23527: Summary: Error with spark-submit and kerberos with TLS-enabled Hadoop cluster Key: SPARK-23527 URL: https://issues.apache.org/jira/browse/SPARK-23527 Project: Spark

[jira] [Assigned] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22915: Assignee: (was: Apache Spark) > ML test for StructuredStreaming: spark.ml.feature,

[jira] [Assigned] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22915: Assignee: Apache Spark > ML test for StructuredStreaming: spark.ml.feature, N-Z >

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379214#comment-16379214 ] Apache Spark commented on SPARK-22915: -- User 'attilapiros' has created a pull request for this

[jira] [Comment Edited] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian edited comment on SPARK-23471 at 2/27/18 8:07 PM: --

[jira] [Comment Edited] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian edited comment on SPARK-23471 at 2/27/18 8:06 PM: --

[jira] [Comment Edited] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian edited comment on SPARK-23471 at 2/27/18 8:06 PM: --

[jira] [Comment Edited] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian edited comment on SPARK-23471 at 2/27/18 8:04 PM: --

[jira] [Comment Edited] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian edited comment on SPARK-23471 at 2/27/18 8:04 PM: --

[jira] [Commented] (SPARK-23500) Filters on named_structs could be pushed into scans

[ https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379201#comment-16379201 ] Henry Robinson commented on SPARK-23500: Ok, I figured it out! {{SimplifyCreateStructOps}} does

[jira] [Commented] (SPARK-23471) RandomForestClassificationModel save() - incorrect metadata

[ https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379202#comment-16379202 ] Bago Amirbekian commented on SPARK-23471: - [~Keepun] `train` is a protected API, it's called by

[jira] [Assigned] (SPARK-23501) Refactor AllStagesPage in order to avoid redundant code

[ https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23501: -- Assignee: Marco Gaido > Refactor AllStagesPage in order to avoid redundant code >

[jira] [Resolved] (SPARK-23501) Refactor AllStagesPage in order to avoid redundant code

[ https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23501. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20663

[jira] [Assigned] (SPARK-23365) DynamicAllocation with failure in straggler task can lead to a hung spark job

[ https://issues.apache.org/jira/browse/SPARK-23365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23365: -- Assignee: Imran Rashid > DynamicAllocation with failure in straggler task can lead to

[jira] [Resolved] (SPARK-23365) DynamicAllocation with failure in straggler task can lead to a hung spark job

[ https://issues.apache.org/jira/browse/SPARK-23365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23365. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379056#comment-16379056 ] Attila Zsolt Piros commented on SPARK-22915: Thank you as I have already a lot of work in it.

[jira] [Resolved] (SPARK-18062) ProbabilisticClassificationModel.normalizeToProbabilitiesInPlace should return probabilities when given all-0 vector

[ https://issues.apache.org/jira/browse/SPARK-18062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18062. --- Resolution: Duplicate >

[jira] [Commented] (SPARK-19416) Dataset.schema is inconsistent with Dataset in handling columns with periods

[ https://issues.apache.org/jira/browse/SPARK-19416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379034#comment-16379034 ] Joseph K. Bradley commented on SPARK-19416: --- [~rxin] Shall we close this as Won't Do, or shall

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379035#comment-16379035 ] yogesh garg commented on SPARK-22915: - Ah, doesn't make sense for me to take it then. Thanks! Please

[jira] [Updated] (SPARK-23523) Incorrect result caused by the rule OptimizeMetadataOnlyQuery

[ https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23523: -- Affects Version/s: 2.1.2 > Incorrect result caused by the rule OptimizeMetadataOnlyQuery >

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378987#comment-16378987 ] Attila Zsolt Piros commented on SPARK-22915: I am also very close to a PR. > ML test for

[jira] [Commented] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378978#comment-16378978 ] yogesh garg commented on SPARK-22915: - I have started working on this and can raise a PR soon. Thanks

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378963#comment-16378963 ] Dongjoon Hyun commented on SPARK-19809: --- I meant 2.1.1 literally. :) > NullPointerException on

[jira] [Resolved] (SPARK-23523) Incorrect result caused by the rule OptimizeMetadataOnlyQuery

[ https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23523. - Resolution: Fixed Fix Version/s: 2.3.0 > Incorrect result caused by the rule

[jira] [Updated] (SPARK-23523) Incorrect result caused by the rule OptimizeMetadataOnlyQuery

[ https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23523: Fix Version/s: (was: 2.3.0) 2.4.0 > Incorrect result caused by the rule

[jira] [Commented] (SPARK-10856) SQL Server dialect needs to map java.sql.Timestamp to DATETIME instead of TIMESTAMP

[ https://issues.apache.org/jira/browse/SPARK-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378904#comment-16378904 ] Greg Michalopoulos commented on SPARK-10856: I am facing an issue with one of the datatypes

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378879#comment-16378879 ] Edwina Lu commented on SPARK-23206: --- [~assia6], I haven't submitted the PR yet – the code is currently

[jira] [Resolved] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17147. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20572

[jira] [Assigned] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-17147: - Assignee: Cody Koeninger > Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive

[jira] [Commented] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378636#comment-16378636 ] PandaMonkey commented on SPARK-23509: - [~srowen]Thx for your reply. > Upgrade commons-net from 2.2

[jira] [Updated] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23509: -- Priority: Minor (was: Major) > Upgrade commons-net from 2.2 to 3.1 >

[jira] [Assigned] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23509: - Assignee: Kazuaki Ishizaki > Upgrade commons-net from 2.2 to 3.1 >

[jira] [Resolved] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23509. --- Resolution: Fixed Issue resolved by pull request 20672 [https://github.com/apache/spark/pull/20672]

[jira] [Commented] (SPARK-23525) ALTER TABLE CHANGE COLUMN doesn't work for external hive table

[ https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378550#comment-16378550 ] Pavlo Skliar commented on SPARK-23525: -- Unbelievably quick response as for an open-sourced project.

[jira] [Commented] (SPARK-23525) ALTER TABLE CHANGE COLUMN doesn't work for external hive table

[ https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378546#comment-16378546 ] Jiang Xingbo commented on SPARK-23525: -- I'm working on a fix for it, and will try to backport the

[jira] [Commented] (SPARK-23525) ALTER TABLE CHANGE COLUMN doesn't work for external hive table

[ https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378533#comment-16378533 ] Jiang Xingbo commented on SPARK-23525: -- Thank you for reporting this. I believe the bug is caused

[jira] [Updated] (SPARK-23525) ALTER TABLE CHANGE COLUMN doesn't work for external hive table

[ https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-23525: - Affects Version/s: 2.3.0 Priority: Major (was: Minor) Summary: ALTER

[jira] [Commented] (SPARK-23526) KafkaMicroBatchV2SourceSuite.ensure stream-stream self-join generates only one offset in offset log

[ https://issues.apache.org/jira/browse/SPARK-23526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378468#comment-16378468 ] Wenchen Fan commented on SPARK-23526: - cc [~zsxwing] > KafkaMicroBatchV2SourceSuite.ensure

[jira] [Created] (SPARK-23526) KafkaMicroBatchV2SourceSuite.ensure stream-stream self-join generates only one offset in offset log

Wenchen Fan created SPARK-23526: --- Summary: KafkaMicroBatchV2SourceSuite.ensure stream-stream self-join generates only one offset in offset log Key: SPARK-23526 URL: https://issues.apache.org/jira/browse/SPARK-23526

[jira] [Created] (SPARK-23525) Update column comment doesn't work from spark

Pavlo Skliar created SPARK-23525: Summary: Update column comment doesn't work from spark Key: SPARK-23525 URL: https://issues.apache.org/jira/browse/SPARK-23525 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17859) persist should not impede with spark's ability to perform a broadcast join.

[ https://issues.apache.org/jira/browse/SPARK-17859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fernando Pereira updated SPARK-17859: - Fix Version/s: 2.2.1 > persist should not impede with spark's ability to perform a

[jira] [Assigned] (SPARK-23524) Big local shuffle blocks should not be checked for corruption.

[ https://issues.apache.org/jira/browse/SPARK-23524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23524: Assignee: Apache Spark > Big local shuffle blocks should not be checked for corruption. >

[jira] [Assigned] (SPARK-23524) Big local shuffle blocks should not be checked for corruption.

[ https://issues.apache.org/jira/browse/SPARK-23524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23524: Assignee: (was: Apache Spark) > Big local shuffle blocks should not be checked for

[jira] [Commented] (SPARK-23524) Big local shuffle blocks should not be checked for corruption.

[ https://issues.apache.org/jira/browse/SPARK-23524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378324#comment-16378324 ] Apache Spark commented on SPARK-23524: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Resolved] (SPARK-23351) checkpoint corruption in long running application

[ https://issues.apache.org/jira/browse/SPARK-23351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Ahern resolved SPARK-23351. - Resolution: Fixed Fix Version/s: 2.2.1 already fixed in future version... will test when

[jira] [Commented] (SPARK-23351) checkpoint corruption in long running application

[ https://issues.apache.org/jira/browse/SPARK-23351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378311#comment-16378311 ] David Ahern commented on SPARK-23351: - will close this assuming it's fixed in future version... will

[jira] [Created] (SPARK-23524) Big local shuffle blocks should not be checked for corruption.

jin xing created SPARK-23524: Summary: Big local shuffle blocks should not be checked for corruption. Key: SPARK-23524 URL: https://issues.apache.org/jira/browse/SPARK-23524 Project: Spark

[jira] [Commented] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378303#comment-16378303 ] 吴志龙 commented on SPARK-23346: - This bug is found and solved? This bug will result in incorrect data. >