[jira] [Assigned] (SPARK-26737) Executor/Task STDERR & STDOUT log urls are not correct in Yarn deployment mode

[ https://issues.apache.org/jira/browse/SPARK-26737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26737: Assignee: (was: Apache Spark) > Executor/Task STDERR & STDOUT log urls are not

[jira] [Assigned] (SPARK-26379) Fix issue on adding current_timestamp/current_date to streaming query

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26379: Assignee: Jungtaek Lim (was: Apache Spark) > Fix issue on adding

[jira] [Assigned] (SPARK-26379) Fix issue on adding current_timestamp/current_date to streaming query

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26379: Assignee: Apache Spark (was: Jungtaek Lim) > Fix issue on adding

[jira] [Reopened] (SPARK-26379) Fix issue on adding current_timestamp/current_date to streaming query

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-26379: --- > Fix issue on adding current_timestamp/current_date to streaming query >

[jira] [Assigned] (SPARK-26737) Executor/Task STDERR & STDOUT log urls are not correct in Yarn deployment mode

[ https://issues.apache.org/jira/browse/SPARK-26737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26737: Assignee: Apache Spark > Executor/Task STDERR & STDOUT log urls are not correct in Yarn

[jira] [Created] (SPARK-26737) Executor/Task STDERR & STDOUT log urls are not correct in Yarn deployment mode

Devaraj K created SPARK-26737: - Summary: Executor/Task STDERR & STDOUT log urls are not correct in Yarn deployment mode Key: SPARK-26737 URL: https://issues.apache.org/jira/browse/SPARK-26737 Project:

[jira] [Assigned] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26698: - Assignee: SongYadong > Use ConfigEntry for hardcoded configs for memory and storage categories

[jira] [Resolved] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26698. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23623

[jira] [Resolved] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26442. --- Resolution: Done > Use ConfigEntry for hardcoded configs. > --

[jira] [Created] (SPARK-26736) if filter condition has rand() function it does not do partition prunning

roncenzhao created SPARK-26736: -- Summary: if filter condition has rand() function it does not do partition prunning Key: SPARK-26736 URL: https://issues.apache.org/jira/browse/SPARK-26736 Project: Spark

[jira] [Updated] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26698: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-26442 > Use ConfigEntry for hardcoded

[jira] [Updated] (SPARK-26587) Deadlock between SparkUI thread and Driver thread

[ https://issues.apache.org/jira/browse/SPARK-26587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Umayr Hassan updated SPARK-26587: - Attachment: _Spark_node_hanging__Thread_dump_from_application_master.txt > Deadlock between

[jira] [Commented] (SPARK-26587) Deadlock between SparkUI thread and Driver thread

[ https://issues.apache.org/jira/browse/SPARK-26587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752908#comment-16752908 ] Umayr Hassan commented on SPARK-26587: -- [~Vitaliy.Savkin] we see something similar in our apps. Any

[jira] [Commented] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752905#comment-16752905 ] Sean Owen commented on SPARK-26721: --- I would not call it a Blocker, but I'd welcome a pull request to

[jira] [Commented] (SPARK-26708) Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

[ https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752866#comment-16752866 ] Takeshi Yamamuro commented on SPARK-26708: -- I also want to know that this is related to

[jira] [Comment Edited] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752865#comment-16752865 ] Takeshi Yamamuro edited comment on SPARK-26721 at 1/26/19 12:48 AM:

[jira] [Updated] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26721: - Priority: Major (was: Blocker) > Bug in feature importance calculation in GBM (and

[jira] [Commented] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752865#comment-16752865 ] Takeshi Yamamuro commented on SPARK-26721: -- Unset the priority tag for now cuz its generally

[jira] [Assigned] (SPARK-26735) Verify plan integrity for special expressions

[ https://issues.apache.org/jira/browse/SPARK-26735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26735: Assignee: Apache Spark > Verify plan integrity for special expressions >

[jira] [Assigned] (SPARK-26735) Verify plan integrity for special expressions

[ https://issues.apache.org/jira/browse/SPARK-26735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26735: Assignee: (was: Apache Spark) > Verify plan integrity for special expressions >

[jira] [Created] (SPARK-26735) Verify plan integrity for special expressions

Kris Mok created SPARK-26735: Summary: Verify plan integrity for special expressions Key: SPARK-26735 URL: https://issues.apache.org/jira/browse/SPARK-26735 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-26709) OptimizeMetadataOnlyQuery does not correctly handle the files with zero record

[ https://issues.apache.org/jira/browse/SPARK-26709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26709. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1

[jira] [Resolved] (SPARK-26711) JSON Schema inference takes 15 times longer

[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26711. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 3.0.0 This is

[jira] [Created] (SPARK-26734) StackOverflowError on WAL serialization caused by large receivedBlockQueue

Ross M. Lodge created SPARK-26734: - Summary: StackOverflowError on WAL serialization caused by large receivedBlockQueue Key: SPARK-26734 URL: https://issues.apache.org/jira/browse/SPARK-26734

[jira] [Assigned] (SPARK-26566) Upgrade apache/arrow to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26566: Assignee: (was: Apache Spark) > Upgrade apache/arrow to 0.12.0 >

[jira] [Assigned] (SPARK-26566) Upgrade apache/arrow to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26566: Assignee: Apache Spark > Upgrade apache/arrow to 0.12.0 > --

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Description: Version 0.12.0 includes the following selected fixes/improvements relevant to

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752822#comment-16752822 ] Liang-Chi Hsieh commented on SPARK-26727: - When it asks if a table exists, doesn't it only check

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Description: Version 0.12.0 includes the following selected fixes/improvements relevant to

[jira] [Resolved] (SPARK-25825) Kerberos Support for Long Running Jobs in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25825. Resolution: Won't Do I'm going to close this for now since there isn't a definition of

[jira] [Assigned] (SPARK-25825) Kerberos Support for Long Running Jobs in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25825: -- Assignee: (was: Marcelo Vanzin) > Kerberos Support for Long Running Jobs in

[jira] [Assigned] (SPARK-25825) Kerberos Support for Long Running Jobs in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25825: -- Assignee: Marcelo Vanzin > Kerberos Support for Long Running Jobs in Kubernetes >

[jira] [Resolved] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25751. Resolution: Won't Do Other changes in this area introduced unit tests already, so this

[jira] [Updated] (SPARK-26379) Fix issue on adding current_timestamp/current_date to streaming query

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26379: -- Summary: Fix issue on adding current_timestamp/current_date to streaming query (was:

[jira] [Resolved] (SPARK-23078) Allow Submitting Spark Thrift Server in Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-23078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23078. Resolution: Won't Do No answer to my question, assuming use case is now covered. > Allow

[jira] [Assigned] (SPARK-26733) Clean up entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-26733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26733: Assignee: Apache Spark > Clean up entrypoint.sh > -- > >

[jira] [Assigned] (SPARK-26733) Clean up entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-26733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26733: Assignee: (was: Apache Spark) > Clean up entrypoint.sh > -- > >

[jira] [Updated] (SPARK-26379) Fix issue on adding current_timestamp/current_date to streaming query

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26379: -- Fix Version/s: 2.4.1 > Fix issue on adding current_timestamp/current_date to streaming query

[jira] [Created] (SPARK-26733) Clean up entrypoint.sh

Marcelo Vanzin created SPARK-26733: -- Summary: Clean up entrypoint.sh Key: SPARK-26733 URL: https://issues.apache.org/jira/browse/SPARK-26733 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-26678) Empty values end up as quoted empty strings in CSV files

[ https://issues.apache.org/jira/browse/SPARK-26678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752785#comment-16752785 ] Robert V commented on SPARK-26678: -- Yes, this parameter solved the problem as documented

[jira] [Resolved] (SPARK-26379) Structured Streaming - Exception on adding column to Dataset

[ https://issues.apache.org/jira/browse/SPARK-26379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26379. --- Resolution: Fixed Assignee: Jungtaek Lim Fix Version/s: 3.0.0 This is

[jira] [Assigned] (SPARK-26732) Flaky test: SparkContextInfoSuite.getRDDStorageInfo only reports on RDDs that actually persist data

[ https://issues.apache.org/jira/browse/SPARK-26732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26732: Assignee: Apache Spark > Flaky test: SparkContextInfoSuite.getRDDStorageInfo only

[jira] [Assigned] (SPARK-26732) Flaky test: SparkContextInfoSuite.getRDDStorageInfo only reports on RDDs that actually persist data

[ https://issues.apache.org/jira/browse/SPARK-26732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26732: Assignee: (was: Apache Spark) > Flaky test: SparkContextInfoSuite.getRDDStorageInfo

[jira] [Created] (SPARK-26732) Flaky test: SparkContextInfoSuite.getRDDStorageInfo only reports on RDDs that actually persist data

Marcelo Vanzin created SPARK-26732: -- Summary: Flaky test: SparkContextInfoSuite.getRDDStorageInfo only reports on RDDs that actually persist data Key: SPARK-26732 URL:

[jira] [Commented] (SPARK-23411) Deprecate SparkContext.getRDDStorageInfo

[ https://issues.apache.org/jira/browse/SPARK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752734#comment-16752734 ] Marcelo Vanzin commented on SPARK-23411: Hmm, removing this method is a little tricky because

[jira] [Resolved] (SPARK-26170) Add missing metrics in FlatMapGroupsWithState

[ https://issues.apache.org/jira/browse/SPARK-26170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres resolved SPARK-26170. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23142

[jira] [Commented] (SPARK-23411) Deprecate SparkContext.getRDDStorageInfo

[ https://issues.apache.org/jira/browse/SPARK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752661#comment-16752661 ] Marcelo Vanzin commented on SPARK-23411: I saw the test for this method fail (see e.g.

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752652#comment-16752652 ] Xiao Li commented on SPARK-26727: - Are you using S3-like object store? These file systems do not

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23385: -- Assignee: Marcelo Vanzin > Allow SparkUITab to be customized adding in SparkConf and

[jira] [Resolved] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23385. --- Resolution: Won't Fix > Allow SparkUITab to be customized adding in SparkConf and loaded when >

[jira] [Assigned] (SPARK-26711) JSON Schema inference takes 15 times longer

[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26711: Assignee: (was: Apache Spark) > JSON Schema inference takes 15 times longer >

[jira] [Assigned] (SPARK-26711) JSON Schema inference takes 15 times longer

[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26711: Assignee: Apache Spark > JSON Schema inference takes 15 times longer >

[jira] [Assigned] (SPARK-22404) Provide an option to use unmanaged AM in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-22404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22404: -- Assignee: Devaraj K > Provide an option to use unmanaged AM in yarn-client mode >

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: (was: Apache Spark) > Allow SparkUITab to be customized adding in

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: Apache Spark > Allow SparkUITab to be customized adding in SparkConf and

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23385: -- Assignee: (was: Marcelo Vanzin) > Allow SparkUITab to be customized adding in

[jira] [Comment Edited] (SPARK-26677) Incorrect results of not(eqNullSafe) when data read from Parquet file

[ https://issues.apache.org/jira/browse/SPARK-26677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752619#comment-16752619 ] Dongjoon Hyun edited comment on SPARK-26677 at 1/25/19 7:56 PM: Yep.

[jira] [Commented] (SPARK-26677) Incorrect results of not(eqNullSafe) when data read from Parquet file

[ https://issues.apache.org/jira/browse/SPARK-26677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752619#comment-16752619 ] Dongjoon Hyun commented on SPARK-26677: --- Yep. Correct. There were two mixed issues. > Incorrect

[jira] [Resolved] (SPARK-22404) Provide an option to use unmanaged AM in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-22404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22404. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 19616

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752607#comment-16752607 ] Dongjoon Hyun commented on SPARK-26727: --- Interesting issue. cc [~cloud_fan] and [~smilegator]. >

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752613#comment-16752613 ] Dongjoon Hyun commented on SPARK-26727: --- Hi, [~yarrasree], [~ramgopalnaali], [~rigolaszlo]. May I

[jira] [Commented] (SPARK-26677) Incorrect results of not(eqNullSafe) when data read from Parquet file

[ https://issues.apache.org/jira/browse/SPARK-26677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752606#comment-16752606 ] Ryan Blue commented on SPARK-26677: --- To clarify [~dongjoon]'s comment: All recent versions of Parquet

[jira] [Commented] (SPARK-26731) remove EOLed spark jobs from jenkins

[ https://issues.apache.org/jira/browse/SPARK-26731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752586#comment-16752586 ] shane knapp commented on SPARK-26731: - ok, should i hold off on disabling them until 3.0? > remove

[jira] [Updated] (SPARK-26731) remove EOLed spark jobs from jenkins

[ https://issues.apache.org/jira/browse/SPARK-26731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26731: -- Target Version/s: 3.0.0 Priority: Major (was: Critical) Let's, eh, delete them when 3.0

[jira] [Updated] (SPARK-26731) remove EOLed spark jobs from jenkins

[ https://issues.apache.org/jira/browse/SPARK-26731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26731: Description: i will disable, but not remove (yet), the branch-specific builds for 1.6, 2.0 and

[jira] [Resolved] (SPARK-26254) Move delegation token providers into a separate project

[ https://issues.apache.org/jira/browse/SPARK-26254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26254. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23499

[jira] [Assigned] (SPARK-26254) Move delegation token providers into a separate project

[ https://issues.apache.org/jira/browse/SPARK-26254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26254: -- Assignee: Gabor Somogyi > Move delegation token providers into a separate project >

[jira] [Created] (SPARK-26731) remove EOLed spark jobs from jenkins

shane knapp created SPARK-26731: --- Summary: remove EOLed spark jobs from jenkins Key: SPARK-26731 URL: https://issues.apache.org/jira/browse/SPARK-26731 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-26694) Console progress bar not showing in 3.0

[ https://issues.apache.org/jira/browse/SPARK-26694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26694. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23618

[jira] [Assigned] (SPARK-26694) Console progress bar not showing in 3.0

[ https://issues.apache.org/jira/browse/SPARK-26694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26694: -- Assignee: Ankur Gupta > Console progress bar not showing in 3.0 >

[jira] [Updated] (SPARK-25635) Support selective direct encoding in native ORC write

[ https://issues.apache.org/jira/browse/SPARK-25635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25635: -- Fix Version/s: 2.4.1 > Support selective direct encoding in native ORC write >

[jira] [Resolved] (SPARK-26724) Non negative coefficients for LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-26724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26724. -- Resolution: Invalid > Non negative coefficients for LinearRegression >

[jira] [Commented] (SPARK-26724) Non negative coefficients for LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-26724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752499#comment-16752499 ] Hyukjin Kwon commented on SPARK-26724: -- Take a look at https://spark.apache.org/community.html.

[jira] [Assigned] (SPARK-26718) structured streaming fetched wrong current offset from kafka

[ https://issues.apache.org/jira/browse/SPARK-26718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26718: Assignee: Apache Spark > structured streaming fetched wrong current offset from kafka >

[jira] [Commented] (SPARK-26718) structured streaming fetched wrong current offset from kafka

[ https://issues.apache.org/jira/browse/SPARK-26718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752478#comment-16752478 ] Apache Spark commented on SPARK-26718: -- User 'linehrr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26718) structured streaming fetched wrong current offset from kafka

[ https://issues.apache.org/jira/browse/SPARK-26718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26718: Assignee: (was: Apache Spark) > structured streaming fetched wrong current offset

[jira] [Commented] (SPARK-26718) structured streaming fetched wrong current offset from kafka

[ https://issues.apache.org/jira/browse/SPARK-26718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752420#comment-16752420 ] Ryne Yang commented on SPARK-26718: --- [~kabhwan], [~gsomogyi] PR submitted : 

[jira] [Commented] (SPARK-22229) SPIP: RDMA Accelerated Shuffle Engine

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752451#comment-16752451 ] Yuval Degani commented on SPARK-9: -- Great questions, [~tgraves] * SparkRDMA (starting version

[jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks

[ https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752462#comment-16752462 ] Xiangrui Meng commented on SPARK-24579: --- [~bryanc] If we limit the scope to model inference w/

[jira] [Commented] (SPARK-26410) Support per Pandas UDF configuration

[ https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752467#comment-16752467 ] Xiangrui Meng commented on SPARK-26410: --- There are several possible solutions to this. SPARK-23258

[jira] [Updated] (SPARK-23458) Flaky test: OrcQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-23458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23458: -- Fix Version/s: 2.4.1 > Flaky test: OrcQuerySuite > -- > >

[jira] [Updated] (SPARK-26427) Upgrade Apache ORC to 1.5.4

[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26427: -- Fix Version/s: 2.4.1 > Upgrade Apache ORC to 1.5.4 > --- > >

[jira] [Commented] (SPARK-22229) SPIP: RDMA Accelerated Shuffle Engine

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752356#comment-16752356 ] Thomas Graves commented on SPARK-9: --- This is interesting, a few questions * I'm assuming all

[jira] [Commented] (SPARK-26718) structured streaming fetched wrong current offset from kafka

[ https://issues.apache.org/jira/browse/SPARK-26718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752353#comment-16752353 ] Ryne Yang commented on SPARK-26718: --- [~kabhwan] cool, I will make a PR soon. thank you.  > structured

[jira] [Reopened] (SPARK-26724) Non negative coefficients for LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-26724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Chang reopened SPARK-26724: Please let me know where the "mailing list" is. By the way, if this place is not a good place to ask

[jira] [Updated] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26730: - Description: For types like Product, we've already add AssertNotNull when we construct serializer(pls see the

[jira] [Updated] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26730: - Description: For types like Product, we've already add AssertNotNull when we construct serializer(pls see the

[jira] [Resolved] (SPARK-26710) ImageSchemaSuite has some errors when running it in local laptop

[ https://issues.apache.org/jira/browse/SPARK-26710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26710. --- Resolution: Not A Problem > ImageSchemaSuite has some errors when running it in local laptop >

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752304#comment-16752304 ] Bruce Robbins commented on SPARK-26711: --- [~hyukjin.kwon] Ok, that worked. I had in my mind a more

[jira] [Assigned] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26730: Assignee: (was: Apache Spark) > Strip redundant AssertNotNull expression for

[jira] [Assigned] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26730: Assignee: Apache Spark > Strip redundant AssertNotNull expression for

[jira] [Created] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

wuyi created SPARK-26730: Summary: Strip redundant AssertNotNull expression for ExpressionEncoder's serializer Key: SPARK-26730 URL: https://issues.apache.org/jira/browse/SPARK-26730 Project: Spark

[jira] [Updated] (SPARK-22229) SPIP: RDMA Accelerated Shuffle Engine

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-9: -- Affects Version/s: 3.0.0 2.4.0 > SPIP: RDMA Accelerated Shuffle Engine

[jira] [Commented] (SPARK-22229) SPIP: RDMA Accelerated Shuffle Engine

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752282#comment-16752282 ] Peter Rudenko commented on SPARK-9: --- [~S71955] - there's no yet PR to include SparkRDMA to

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752277#comment-16752277 ] Liang-Chi Hsieh commented on SPARK-26727: - I can't reproduce it even continuing running the SQL

[jira] [Comment Edited] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752203#comment-16752203 ] Laszlo Rigo edited comment on SPARK-26727 at 1/25/19 12:09 PM: --- Hi, It

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752203#comment-16752203 ] Laszlo Rigo commented on SPARK-26727: - Hi, It can be reproduced with a scala snippet in

[jira] [Created] (SPARK-26729) Spark on Kubernetes tooling hardcodes default image names

Rob Vesse created SPARK-26729: - Summary: Spark on Kubernetes tooling hardcodes default image names Key: SPARK-26729 URL: https://issues.apache.org/jira/browse/SPARK-26729 Project: Spark Issue

[jira] [Assigned] (SPARK-26728) Make rdd.unpersist blocking configurable

[ https://issues.apache.org/jira/browse/SPARK-26728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26728: Assignee: (was: Apache Spark) > Make rdd.unpersist blocking configurable >

[jira] [Assigned] (SPARK-26728) Make rdd.unpersist blocking configurable

[ https://issues.apache.org/jira/browse/SPARK-26728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26728: Assignee: Apache Spark > Make rdd.unpersist blocking configurable >

  1   2   >