[jira] [Commented] (SPARK-15544) Bouncing Zookeeper node causes Active spark master to exit

2019-03-19 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796825#comment-16796825 ] Jungtaek Lim commented on SPARK-15544: -- [~moein7tl] Do you make some progress? If you are no

[jira] [Assigned] (SPARK-26739) Standardized Join Types for DataFrames

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26739: Assignee: (was: Apache Spark) > Standardized Join Types for DataFrames >

[jira] [Assigned] (SPARK-26739) Standardized Join Types for DataFrames

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26739: Assignee: Apache Spark > Standardized Join Types for DataFrames >

[jira] [Comment Edited] (SPARK-27086) DataSourceV2 MicroBatchExecution commits last batch only if new batch is constructed

2019-03-19 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796812#comment-16796812 ] Jungtaek Lim edited comment on SPARK-27086 at 3/20/19 5:38 AM: ---

[jira] [Commented] (SPARK-27086) DataSourceV2 MicroBatchExecution commits last batch only if new batch is constructed

2019-03-19 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796812#comment-16796812 ] Jungtaek Lim commented on SPARK-27086: -- [~sebastianherold] This sounds like a kind of request or 

[jira] [Assigned] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27209: Assignee: Apache Spark > Split parsing of SELECT and INSERT into two top-level rules in

[jira] [Assigned] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27209: Assignee: (was: Apache Spark) > Split parsing of SELECT and INSERT into two

[jira] [Created] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

2019-03-19 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-27209: Summary: Split parsing of SELECT and INSERT into two top-level rules in the grammar file. Key: SPARK-27209 URL: https://issues.apache.org/jira/browse/SPARK-27209

[jira] [Commented] (SPARK-16190) Worker registration failed: Duplicate worker ID

2019-03-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796772#comment-16796772 ] zuotingbing commented on SPARK-16190: - i faced the same issue. worker log as follows: {code:java} //

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

2019-03-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 3:57 AM: -- i faced the

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

2019-03-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 4:02 AM: -- i faced the

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

2019-03-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 3:59 AM: -- i faced the

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

2019-03-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 4:00 AM: -- i faced the

[jira] [Commented] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796760#comment-16796760 ] Dongjoon Hyun commented on SPARK-27160: --- Hi, [~sadhen]. Thank you so much for this contribution.

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27160: -- Fix Version/s: (was: 2.4.1) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Resolved] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26975. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via

[jira] [Updated] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-27112: - Fix Version/s: (was: 2.4.1) 2.4.2 > Spark Scheduler encounters two

[jira] [Commented] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796677#comment-16796677 ] Imran Rashid commented on SPARK-27112: -- I revised the fix version for 2.4 to 2.4.2, as I just

[jira] [Commented] (SPARK-27186) Optimize SortShuffleWriter writing process

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796671#comment-16796671 ] Apache Spark commented on SPARK-27186: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-26736) if filter condition `And` has non-determined sub function it does not do partition prunning

2019-03-19 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated SPARK-26736: --- Summary: if filter condition `And` has non-determined sub function it does not do partition

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

2019-03-19 Thread Artem Rukavytsia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:03 AM: ---

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

2019-03-19 Thread Artem Rukavytsia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:02 AM: ---

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

2019-03-19 Thread Artem Rukavytsia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:00 AM: ---

[jira] [Resolved] (SPARK-27197) Add ReadNestedSchemaTest for file-based data sources

2019-03-19 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-27197. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24139

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: (was: Marcelo Vanzin) > Dynamic allocation will preserve cached data >

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: Marcelo Vanzin > Dynamic allocation will preserve cached data >

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27194: --- Description: When a container fails for some reason (for example when killed by yarn for

[jira] [Created] (SPARK-27208) RestSubmissionClient only supports http

2019-03-19 Thread Jorge Machado (JIRA)
Jorge Machado created SPARK-27208: - Summary: RestSubmissionClient only supports http Key: SPARK-27208 URL: https://issues.apache.org/jira/browse/SPARK-27208 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27207: Assignee: (was: Apache Spark) > There exists a bug with SortBasedAggregator where

[jira] [Assigned] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27207: Assignee: Apache Spark > There exists a bug with SortBasedAggregator where

[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http

2019-03-19 Thread Jorge Machado (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796544#comment-16796544 ] Jorge Machado commented on SPARK-27208: --- relates to this as the follow up error >

[jira] [Updated] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-27112: - Fix Version/s: 2.4.1 2.3.4 > Spark Scheduler encounters two independent

[jira] [Commented] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796539#comment-16796539 ] Imran Rashid commented on SPARK-27112: -- Fixed in 2.4 & 2.3 by

[jira] [Resolved] (SPARK-26288) add initRegisteredExecutorsDB in ExternalShuffleService

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26288. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23393

[jira] [Assigned] (SPARK-26288) add initRegisteredExecutorsDB in ExternalShuffleService

2019-03-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-26288: Assignee: weixiuli > add initRegisteredExecutorsDB in ExternalShuffleService >

[jira] [Created] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

2019-03-19 Thread Parth Gandhi (JIRA)
Parth Gandhi created SPARK-27207: Summary: There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize Key: SPARK-27207 URL:

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796434#comment-16796434 ] Dongjoon Hyun commented on SPARK-27194: --- Hi, [~ajithshetty]. Just out of curiosity, according to

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27194: -- Description: When a container fails for some reason (for example when killed by yarn for

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27194: -- Description: When a container fails for some reason (for example when killed by yarn for

[jira] [Resolved] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

2019-03-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27179. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24114

[jira] [Assigned] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

2019-03-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27179: - Assignee: Yuming Wang Priority: Minor (was: Major) > Exclude javax.ws.rs:jsr311-api from

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

2019-03-19 Thread Karthik Palaniappan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796263#comment-16796263 ] Karthik Palaniappan commented on SPARK-24668: - Please take it :) I didn't have time to work

[jira] [Created] (SPARK-27206) Using slice method with streaming api's Interval on DStream

2019-03-19 Thread Aarthi (JIRA)
Aarthi created SPARK-27206: -- Summary: Using slice method with streaming api's Interval on DStream Key: SPARK-27206 URL: https://issues.apache.org/jira/browse/SPARK-27206 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27205: Assignee: Apache Spark > spark-shell with packages option fails to load transitive

[jira] [Assigned] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27205: Assignee: (was: Apache Spark) > spark-shell with packages option fails to load

[jira] [Updated] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

2019-03-19 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-27205: - Description: I found this bug while testing my patch regarding Spark SQL Kafka module - I tend

[jira] [Created] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

2019-03-19 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-27205: Summary: spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars Key: SPARK-27205 URL:

[jira] [Commented] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

2019-03-19 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796125#comment-16796125 ] Jungtaek Lim commented on SPARK-27205: -- I have a patch now: it's not just a rollback of commit.

[jira] [Created] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

2019-03-19 Thread ABHISHEK KUMAR GUPTA (JIRA)
ABHISHEK KUMAR GUPTA created SPARK-27204: Summary: First time Loading application page from History Server is taking time when event log size is huge Key: SPARK-27204 URL:

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

2019-03-19 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796110#comment-16796110 ] shahid commented on SPARK-27204: Thanks. I will analyze, > First time Loading application page from

[jira] [Updated] (SPARK-27203) Spark Fails to read a view using CTE (WITH clause) and created via beeline

2019-03-19 Thread Igor Ngouagna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Ngouagna updated SPARK-27203: -- Environment: (was: *Spark: 2.1.1* *Beeline: 1.2.1000*) > Spark Fails to read a view

[jira] [Updated] (SPARK-27203) Spark Fails to read a view using CTE (WITH clause) and created via beeline

2019-03-19 Thread Igor Ngouagna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Ngouagna updated SPARK-27203: -- Summary: Spark Fails to read a view using CTE (WITH clause) and created via beeline (was:

[jira] [Created] (SPARK-27203) Fails to read a view using CTE (WITH clause) and created via beeline

2019-03-19 Thread Igor Ngouagna (JIRA)
Igor Ngouagna created SPARK-27203: - Summary: Fails to read a view using CTE (WITH clause) and created via beeline Key: SPARK-27203 URL: https://issues.apache.org/jira/browse/SPARK-27203 Project:

[jira] [Assigned] (SPARK-27202) update comments to keep according with code

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27202: Assignee: (was: Apache Spark) > update comments to keep according with code >

[jira] [Assigned] (SPARK-27202) update comments to keep according with code

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27202: Assignee: Apache Spark > update comments to keep according with code >

[jira] [Created] (SPARK-27202) update comments to keep according with code

2019-03-19 Thread EdisonWang (JIRA)
EdisonWang created SPARK-27202: -- Summary: update comments to keep according with code Key: SPARK-27202 URL: https://issues.apache.org/jira/browse/SPARK-27202 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27201) Show full job description on click

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27201: Assignee: (was: Apache Spark) > Show full job description on click >

[jira] [Assigned] (SPARK-27201) Show full job description on click

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27201: Assignee: Apache Spark > Show full job description on click >

[jira] [Created] (SPARK-27201) Show full job description on click

2019-03-19 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-27201: -- Summary: Show full job description on click Key: SPARK-27201 URL: https://issues.apache.org/jira/browse/SPARK-27201 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-26739) Standardized Join Types for DataFrames

2019-03-19 Thread Valeria Vasylieva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796045#comment-16796045 ] Valeria Vasylieva commented on SPARK-26739: --- [~slehan] hi! I strongly agree this change will

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796039#comment-16796039 ] acupple commented on SPARK-27169: - The full event log is too large. unknown stage log:

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: stage_3511.log > number of active tasks is negative on executors page >

[jira] [Resolved] (SPARK-26176) Verify column name when creating table via `STORED AS`

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26176. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24075

[jira] [Assigned] (SPARK-26176) Verify column name when creating table via `STORED AS`

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26176: --- Assignee: Sujith Chacko > Verify column name when creating table via `STORED AS` >

[jira] [Resolved] (SPARK-27151) ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

2019-03-19 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27151. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:32 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:24 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:24 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:17 AM: - Hi 

[jira] [Assigned] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26555: --- Assignee: Martin Loncaric > Thread safety issue causes createDataset to fail with

[jira] [Resolved] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26555. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24085

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:18 AM: - Hi 

[jira] [Commented] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade commented on SPARK-26985: --- Hi [~srowen], [~hyukjin.kwon] I have observed that after

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:16 AM: - Hi 

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-03-19 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:12 AM: - Hi 

[jira] [Assigned] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27200: Assignee: (was: Apache Spark) > History Environment tab must sort

[jira] [Assigned] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27200: Assignee: Apache Spark > History Environment tab must sort Configurations/Properties by

[jira] [Created] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

2019-03-19 Thread Ajith S (JIRA)
Ajith S created SPARK-27200: --- Summary: History Environment tab must sort Configurations/Properties by default Key: SPARK-27200 URL: https://issues.apache.org/jira/browse/SPARK-27200 Project: Spark

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

2019-03-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795903#comment-16795903 ] Hyukjin Kwon commented on SPARK-24668: -- Please go ahead. > PySpark crashes when getting the webui

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

2019-03-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795908#comment-16795908 ] Hyukjin Kwon commented on SPARK-24668: -- It doesn't usually and neccesarily assign someone. If you

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

2019-03-19 Thread Nikolay Kashtanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795907#comment-16795907 ] Nikolay Kashtanov commented on SPARK-24668: --- [~hyukjin.kwon] could you please assign it to me?

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795878#comment-16795878 ] shahid edited comment on SPARK-27169 at 3/19/19 9:38 AM: - Thank you. Could you

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

2019-03-19 Thread Nikolay Kashtanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795890#comment-16795890 ] Nikolay Kashtanov commented on SPARK-24668: --- Hi [~Karthik Palaniappan] are you worknig on this

[jira] [Commented] (SPARK-27052) Using PySpark udf in transform yields NULL values

2019-03-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795883#comment-16795883 ] Hyukjin Kwon commented on SPARK-27052: -- It doesn't usually and necessarily assign someone. When you

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795878#comment-16795878 ] shahid commented on SPARK-27169: Thank you. Could you please provide full event log if possible? I

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27194: Assignee: (was: Apache Spark) > Job failures when task attempts do not clean up

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27194: Assignee: Apache Spark > Job failures when task attempts do not clean up spark-staging

[jira] [Commented] (SPARK-27052) Using PySpark udf in transform yields NULL values

2019-03-19 Thread Artem Rybin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795797#comment-16795797 ] Artem Rybin commented on SPARK-27052: - Hi [~hejsgpuom62c]! I reproduced this issue. I would like to

[jira] [Assigned] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27199: Assignee: Apache Spark > Replace TimeZone by ZoneId in TimestampFormatter API >

[jira] [Assigned] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

2019-03-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27199: Assignee: (was: Apache Spark) > Replace TimeZone by ZoneId in TimestampFormatter API

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795774#comment-16795774 ] acupple edited comment on SPARK-27169 at 3/19/19 7:22 AM: -- I have enabled event

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795774#comment-16795774 ] acupple commented on SPARK-27169: - I have enabled event log, on the spark UI, the job has not completed,

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: image-2019-03-19-15-17-25-522.png > number of active tasks is negative on executors page >

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-19 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: job_1924.log > number of active tasks is negative on executors page >

[jira] [Created] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

2019-03-19 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-27199: -- Summary: Replace TimeZone by ZoneId in TimestampFormatter API Key: SPARK-27199 URL: https://issues.apache.org/jira/browse/SPARK-27199 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27193) CodeFormatter should format multi comment lines correctly

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27193. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24133

[jira] [Assigned] (SPARK-27193) CodeFormatter should format multi comment lines correctly

2019-03-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27193: --- Assignee: wuyi > CodeFormatter should format multi comment lines correctly >

  1   2   >