[jira] [Created] (SPARK-14441) Consolidate DDL tests

Andrew Or created SPARK-14441: - Summary: Consolidate DDL tests Key: SPARK-14441 URL: https://issues.apache.org/jira/browse/SPARK-14441 Project: Spark Issue Type: Sub-task Components: SQ

[jira] [Updated] (SPARK-14132) [Table related commands] Alter partition

[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14132: -- Description: For alter column command, we have the following tokens. TOK_ALTERTABLE_ADDPARTS TOK_ALTERT

[jira] [Updated] (SPARK-14132) [Table related commands] Alter partition

[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14132: -- Description: For alter column command, we have the following tokens. TOK_ALTERTABLE_ADDPARTS TOK_ALTERT

[jira] [Resolved] (SPARK-14383) Missing "|" in the g4 definition

[ https://issues.apache.org/jira/browse/SPARK-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14383. --- Resolution: Fixed Assignee: Bo Meng Fix Version/s: 2.0.0 Target Version/s

[jira] [Resolved] (SPARK-14429) Improve LIKE pattern in "SHOW TABLES / FUNCTIONS LIKE " DDL

[ https://issues.apache.org/jira/browse/SPARK-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14429. --- Resolution: Fixed Assignee: Bo Meng Fix Version/s: 2.0.0 Target Version/s

[jira] [Resolved] (SPARK-14426) Merge PerserUtils and ParseUtils

[ https://issues.apache.org/jira/browse/SPARK-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14426. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Merge PerserUtils a

[jira] [Updated] (SPARK-14426) Merge PerserUtils and ParseUtils

[ https://issues.apache.org/jira/browse/SPARK-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14426: -- Assignee: Kousuke Saruta > Merge PerserUtils and ParseUtils > > >

[jira] [Updated] (SPARK-14426) Merge ParserUtils and ParseUtils

[ https://issues.apache.org/jira/browse/SPARK-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14426: -- Summary: Merge ParserUtils and ParseUtils (was: Merge PerserUtils and ParseUtils) > Merge ParserUtils

[jira] [Assigned] (SPARK-14410) SessionCatalog needs to check function existence

[ https://issues.apache.org/jira/browse/SPARK-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14410: - Assignee: Andrew Or > SessionCatalog needs to check function existence > --

[jira] [Updated] (SPARK-14410) SessionCatalog needs to check function existence

[ https://issues.apache.org/jira/browse/SPARK-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14410: -- Summary: SessionCatalog needs to check function existence (was: SessionCatalog needs to check databas

[jira] [Updated] (SPARK-14410) SessionCatalog needs to check function existence

[ https://issues.apache.org/jira/browse/SPARK-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14410: -- Description: Right now, operations for an existing functions in SessionCatalog do not really check if t

[jira] [Assigned] (SPARK-14132) [Table related commands] Alter partition

[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14132: - Assignee: Andrew Or > [Table related commands] Alter partition > ---

[jira] [Resolved] (SPARK-14252) Executors do not try to download remote cached blocks

[ https://issues.apache.org/jira/browse/SPARK-14252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14252. --- Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Executors do not try to

[jira] [Resolved] (SPARK-14416) Add thread-safe comments for CoarseGrainedSchedulerBackend's fields

[ https://issues.apache.org/jira/browse/SPARK-14416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14416. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Add thread-safe comme

[jira] [Updated] (SPARK-14416) Add thread-safe comments for CoarseGrainedSchedulerBackend's fields

[ https://issues.apache.org/jira/browse/SPARK-14416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14416: -- Target Version/s: 2.0.0 > Add thread-safe comments for CoarseGrainedSchedulerBackend's fields > ---

[jira] [Created] (SPARK-14414) Make error messages consistent across DDLs

Andrew Or created SPARK-14414: - Summary: Make error messages consistent across DDLs Key: SPARK-14414 URL: https://issues.apache.org/jira/browse/SPARK-14414 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14243. --- Resolution: Fixed > updatedBlockStatuses does not update correctly when removing blocks > ---

[jira] [Updated] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14243: -- Fix Version/s: 1.6.2 > updatedBlockStatuses does not update correctly when removing blocks > --

[jira] [Resolved] (SPARK-14123) Function related commands

[ https://issues.apache.org/jira/browse/SPARK-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14123. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 > Function related c

[jira] [Created] (SPARK-14385) Use FunctionIdentifier in FunctionRegistry/SessionCatalog

Andrew Or created SPARK-14385: - Summary: Use FunctionIdentifier in FunctionRegistry/SessionCatalog Key: SPARK-14385 URL: https://issues.apache.org/jira/browse/SPARK-14385 Project: Spark Issue Typ

[jira] [Updated] (SPARK-14385) Use FunctionIdentifier in FunctionRegistry/SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14385: -- Assignee: (was: Yin Huai) > Use FunctionIdentifier in FunctionRegistry/SessionCatalog > ---

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11327: -- Fix Version/s: 1.6.2 > spark-dispatcher doesn't pass along some spark properties >

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11327: -- Target Version/s: 1.6.2, 2.0.0 (was: 2.0.0) > spark-dispatcher doesn't pass along some spark propertie

[jira] [Resolved] (SPARK-14358) Change SparkListener from a trait to an abstract class, and remove JavaSparkListener

[ https://issues.apache.org/jira/browse/SPARK-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14358. --- Resolution: Fixed Fix Version/s: 2.0.0 > Change SparkListener from a trait to an abstract clas

[jira] [Resolved] (SPARK-14364) HeartbeatReceiver object should be private[spark]

[ https://issues.apache.org/jira/browse/SPARK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14364. --- Resolution: Fixed Fix Version/s: 2.0.0 > HeartbeatReceiver object should be private[spark] > -

[jira] [Commented] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222370#comment-15222370 ] Andrew Or commented on SPARK-13845: --- Thanks josh > BlockStatus and StreamBlockId keep

[jira] [Commented] (SPARK-14333) Duration of task should be the total time (not just computation time)

[ https://issues.apache.org/jira/browse/SPARK-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222189#comment-15222189 ] Andrew Or commented on SPARK-14333: --- can you post a screenshot too > Duration of task

[jira] [Closed] (SPARK-14294) Support native execution of ALTER TABLE ... RENAME TO

[ https://issues.apache.org/jira/browse/SPARK-14294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-14294. - Resolution: Duplicate Assignee: Andrew Or > Support native execution of ALTER TABLE ... RENAME TO >

[jira] [Assigned] (SPARK-14129) [Table related commands] Alter table

[ https://issues.apache.org/jira/browse/SPARK-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14129: - Assignee: Andrew Or > [Table related commands] Alter table > ---

[jira] [Resolved] (SPARK-14304) Fix tests that don't create temp files in the `java.io.tmpdir` folder

[ https://issues.apache.org/jira/browse/SPARK-14304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14304. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Fix tests that don'

[jira] [Resolved] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11327. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > spark-dispatcher do

[jira] [Resolved] (SPARK-14069) Improve SparkStatusTracker to also track executor information

[ https://issues.apache.org/jira/browse/SPARK-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14069. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Improve SparkStatus

[jira] [Updated] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14243: -- Fix Version/s: 2.0.0 > updatedBlockStatuses does not update correctly when removing blocks > --

[jira] [Reopened] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-14243: --- > updatedBlockStatuses does not update correctly when removing blocks > -

[jira] [Resolved] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14243. --- Resolution: Fixed Target Version/s: 1.6.2, 2.0.0 > updatedBlockStatuses does not update cor

[jira] [Resolved] (SPARK-14182) Parse DDL command: Alter View

[ https://issues.apache.org/jira/browse/SPARK-14182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14182. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target Version/s

[jira] [Updated] (SPARK-13796) Lock release errors occur frequently in executor logs

[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13796: -- Target Version/s: 2.0.0 Fix Version/s: 2.0.0 > Lock release errors occur frequently in executor

[jira] [Updated] (SPARK-13796) Lock release errors occur frequently in executor logs

[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13796: -- Assignee: Nishkam Ravi > Lock release errors occur frequently in executor logs > --

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14127: - Assignee: Andrew Or > [Table related commands] Describe table >

[jira] [Updated] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14125: -- Assignee: Xiao Li > View related commands > - > > Key: SPARK-14125

[jira] [Issue Comment Deleted] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14125: -- Comment: was deleted (was: User 'davies' has created a pull request for this issue: https://github.com/

[jira] [Resolved] (SPARK-14124) Database related commands

[ https://issues.apache.org/jira/browse/SPARK-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14124. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Database related commands

[jira] [Created] (SPARK-14253) Avoid registering temporary functions in Hive

Andrew Or created SPARK-14253: - Summary: Avoid registering temporary functions in Hive Key: SPARK-14253 URL: https://issues.apache.org/jira/browse/SPARK-14253 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14120) Import/Export commands (Exception)

[ https://issues.apache.org/jira/browse/SPARK-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14120. --- Resolution: Fixed Assignee: Andrew Or Fix Version/s: 2.0.0 > Import/Export commands (

[jira] [Resolved] (SPARK-14119) Role management commands (Exception)

[ https://issues.apache.org/jira/browse/SPARK-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14119. --- Resolution: Fixed Fix Version/s: 2.0.0 > Role management commands (Exception) > --

[jira] [Assigned] (SPARK-14119) Role management commands (Exception)

[ https://issues.apache.org/jira/browse/SPARK-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14119: - Assignee: Andrew Or > Role management commands (Exception) > ---

[jira] [Resolved] (SPARK-14122) Show commands (Exception)

[ https://issues.apache.org/jira/browse/SPARK-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14122. --- Resolution: Fixed Assignee: Andrew Or Fix Version/s: 2.0.0 > Show commands (Exception

[jira] [Resolved] (SPARK-10570) Add Spark version endpoint to standalone JSON API

[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10570. --- Resolution: Fixed Assignee: Jakob Odersky Fix Version/s: 2.0.0 Target Ver

[jira] [Resolved] (SPARK-14232) Event timeline on job page doesn't show if an executor is removed with multiple line reason

[ https://issues.apache.org/jira/browse/SPARK-14232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14232. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.2 Target Version/s:

[jira] [Updated] (SPARK-14232) Event timeline on job page doesn't show if an executor is removed with multiple line reason

[ https://issues.apache.org/jira/browse/SPARK-14232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14232: -- Assignee: Carson Wang > Event timeline on job page doesn't show if an executor is removed with > multi

[jira] [Updated] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13845: -- Assignee: jeanlyn > BlockStatus and StreamBlockId keep on growing result driver OOM > -

[jira] [Updated] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14243: -- Assignee: jeanlyn > updatedBlockStatuses does not update correctly when removing blocks > -

[jira] [Commented] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216448#comment-15216448 ] Andrew Or commented on SPARK-14243: --- Thanks I've assigned this to you. > updatedBlockS

[jira] [Resolved] (SPARK-13447) Fix AM failure situation for dynamic allocation disabled situation

[ https://issues.apache.org/jira/browse/SPARK-13447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13447. --- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.0.0 Target Versi

[jira] [Updated] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13845: -- Target Version/s: 1.6.2, 2.0.0 (was: 1.6.1, 2.0.0) > BlockStatus and StreamBlockId keep on growing res

[jira] [Updated] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13845: -- Target Version/s: 1.6.1, 2.0.0 Fix Version/s: 2.0.0 > BlockStatus and StreamBlockId keep on grow

[jira] [Assigned] (SPARK-14013) Properly implement temporary functions in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14013: - Assignee: Andrew Or > Properly implement temporary functions in SessionCatalog > ---

[jira] [Commented] (SPARK-14079) Limit the number of queries on SQL UI

[ https://issues.apache.org/jira/browse/SPARK-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207275#comment-15207275 ] Andrew Or commented on SPARK-14079: --- we should do `maxRetainedQueries` or something, si

[jira] [Created] (SPARK-14013) Properly implement temporary functions in SessionCatalog

Andrew Or created SPARK-14013: - Summary: Properly implement temporary functions in SessionCatalog Key: SPARK-14013 URL: https://issues.apache.org/jira/browse/SPARK-14013 Project: Spark Issue Type

[jira] [Created] (SPARK-14014) Replace existing analysis.Catalog with SessionCatalog

Andrew Or created SPARK-14014: - Summary: Replace existing analysis.Catalog with SessionCatalog Key: SPARK-14014 URL: https://issues.apache.org/jira/browse/SPARK-14014 Project: Spark Issue Type: B

[jira] [Created] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

Andrew Or created SPARK-13923: - Summary: Implement SessionCatalog to manage temp functions and tables Key: SPARK-13923 URL: https://issues.apache.org/jira/browse/SPARK-13923 Project: Spark Issue

[jira] [Resolved] (SPARK-6157) Unrolling with MEMORY_AND_DISK should always release memory

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6157. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Unrolling with MEMORY_

[jira] [Resolved] (SPARK-10907) Get rid of pending unroll memory

[ https://issues.apache.org/jira/browse/SPARK-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10907. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Get rid of pending

[jira] [Resolved] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13054. --- Resolution: Fixed Assignee: Thomas Graves (was: Andrew Or) Fix Version/s: 2.0.0 > Al

[jira] [Updated] (SPARK-12583) spark shuffle fails with mesos after 2mins

[ https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12583: -- Assignee: Bertrand Bossy > spark shuffle fails with mesos after 2mins > ---

[jira] [Resolved] (SPARK-12583) spark shuffle fails with mesos after 2mins

[ https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12583. --- Resolution: Fixed Fix Version/s: 2.0.0 > spark shuffle fails with mesos after 2mins >

[jira] [Resolved] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13833. --- Resolution: Fixed Fix Version/s: 2.0.0 > Guard against race condition when re-caching spilled

[jira] [Resolved] (SPARK-13328) Possible poor read performance for broadcast variables with dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13328. --- Resolution: Fixed Assignee: Nezih Yigitbasi Fix Version/s: 2.0.0 Target V

[jira] [Resolved] (SPARK-13604) Sync worker's state after registering with master

[ https://issues.apache.org/jira/browse/SPARK-13604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13604. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Sync worker's state

[jira] [Updated] (SPARK-3854) Scala style: require spaces before `{`

[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3854: - Assignee: Dongjoon Hyun > Scala style: require spaces before `{` > --

[jira] [Resolved] (SPARK-3854) Scala style: require spaces before `{`

[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-3854. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Scala style: require s

[jira] [Resolved] (SPARK-13696) Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities

[ https://issues.apache.org/jira/browse/SPARK-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13696. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove BlockStore interface to more cleanly reflect d

[jira] [Updated] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13492: -- Assignee: Sergiusz Urbaniak (was: Andrew Or) > Configure a custom webui_url for the Spark Mesos Framew

[jira] [Assigned] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-13492: - Assignee: Andrew Or > Configure a custom webui_url for the Spark Mesos Framework > -

[jira] [Resolved] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13492. --- Resolution: Fixed Fix Version/s: 2.0.0 > Configure a custom webui_url for the Spark Mesos Fram

[jira] [Resolved] (SPARK-13775) history server sort by completed time by default

[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13775. --- Resolution: Fixed Assignee: Zhuo Liu Fix Version/s: 2.0.0 Target Version/

[jira] [Resolved] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

[ https://issues.apache.org/jira/browse/SPARK-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13778. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Master's Applicatio

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185511#comment-15185511 ] Andrew Or commented on SPARK-11857: --- [~dragos][~tnachen] any thoughts on at least depre

[jira] [Resolved] (SPARK-13659) Remove returnValues from BlockStore APIs

[ https://issues.apache.org/jira/browse/SPARK-13659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13659. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove returnValues from BlockStore APIs > --

[jira] [Resolved] (SPARK-13689) Move some methods in CatalystQl to a util object

[ https://issues.apache.org/jira/browse/SPARK-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13689. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move some methods in CatalystQl to a util object > --

[jira] [Created] (SPARK-13689) Move some methods in CatalystQl to a util object

Andrew Or created SPARK-13689: - Summary: Move some methods in CatalystQl to a util object Key: SPARK-13689 URL: https://issues.apache.org/jira/browse/SPARK-13689 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-13685) Rename catalog.Catalog to ExternalCatalog

Andrew Or created SPARK-13685: - Summary: Rename catalog.Catalog to ExternalCatalog Key: SPARK-13685 URL: https://issues.apache.org/jira/browse/SPARK-13685 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13633. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move parser classes to o.a.s.sql.catalyst.parser pack

[jira] [Updated] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13633: -- Summary: Move parser classes to o.a.s.sql.catalyst.parser package (was: Create new o.a.s.sql.catalyst.

[jira] [Created] (SPARK-13633) Create new o.a.s.sql.catalyst.parser package

Andrew Or created SPARK-13633: - Summary: Create new o.a.s.sql.catalyst.parser package Key: SPARK-13633 URL: https://issues.apache.org/jira/browse/SPARK-13633 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13632) Create new o.a.s.sql.execution.commands package

Andrew Or created SPARK-13632: - Summary: Create new o.a.s.sql.execution.commands package Key: SPARK-13632 URL: https://issues.apache.org/jira/browse/SPARK-13632 Project: Spark Issue Type: Sub-tas

[jira] [Resolved] (SPARK-12817) Remove CacheManager and replace it with new BlockManager.getOrElseUpdate method

[ https://issues.apache.org/jira/browse/SPARK-12817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12817. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove CacheManager and replace it with new BlockMana

[jira] [Issue Comment Deleted] (SPARK-13571) Track current database in SQL/HiveContext

[ https://issues.apache.org/jira/browse/SPARK-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13571: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue: https://github.

[jira] [Created] (SPARK-13571) Track current database in SQL/HiveContext

Andrew Or created SPARK-13571: - Summary: Track current database in SQL/HiveContext Key: SPARK-13571 URL: https://issues.apache.org/jira/browse/SPARK-13571 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-13522) Executor should kill itself when it's unable to heartbeat to the driver more than N times

[ https://issues.apache.org/jira/browse/SPARK-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13522. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Target Vers

[jira] [Created] (SPARK-13526) Refactor: Move SQLContext/HiveContext per-session state to separate class

Andrew Or created SPARK-13526: - Summary: Refactor: Move SQLContext/HiveContext per-session state to separate class Key: SPARK-13526 URL: https://issues.apache.org/jira/browse/SPARK-13526 Project: Spark

[jira] [Resolved] (SPARK-13519) Driver should tell Executor to stop itself when cleaning executor's state

[ https://issues.apache.org/jira/browse/SPARK-13519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13519. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Target Vers

[jira] [Created] (SPARK-13524) Remove BroadcastManager

Andrew Or created SPARK-13524: - Summary: Remove BroadcastManager Key: SPARK-13524 URL: https://issues.apache.org/jira/browse/SPARK-13524 Project: Spark Issue Type: Improvement Component

[jira] [Resolved] (SPARK-12757) Use reference counting to prevent blocks from being evicted during reads

[ https://issues.apache.org/jira/browse/SPARK-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12757. --- Resolution: Fixed Fix Version/s: 2.0.0 > Use reference counting to prevent blocks from being e

[jira] [Resolved] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

[ https://issues.apache.org/jira/browse/SPARK-13387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13387. --- Resolution: Fixed Assignee: Timothy Chen Fix Version/s: 2.0.0 Target Vers

[jira] [Resolved] (SPARK-13501) Remove use of Guava Stopwatch class

[ https://issues.apache.org/jira/browse/SPARK-13501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13501. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove use of Guava Stopwatch class > ---

[jira] [Updated] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12009: -- Fix Version/s: (was: 1.6.1) > Avoid re-allocate yarn container while driver want to stop all Execut

[jira] [Updated] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12009: -- Assignee: SuYan > Avoid re-allocate yarn container while driver want to stop all Executors > --

[jira] [Resolved] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12009. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > Avoid re-allocate yarn conta

[jira] [Resolved] (SPARK-7729) Executor which has been killed should also be displayed on Executors Tab.

[ https://issues.apache.org/jira/browse/SPARK-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-7729. -- Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 2.0.0 Target Version

<    1   2   3   4   5   6   7   8   9   10   >