[jira] [Resolved] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15223. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 >

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Priority: Minor (was: Trivial) > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Resolved] (SPARK-15093) create/delete/rename directory for InMemoryCatalog operations if needed

[ https://issues.apache.org/jira/browse/SPARK-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15093. --- Resolution: Fixed Fix Version/s: 2.0.0 > create/delete/rename directory for InMemoryCatalog

[jira] [Resolved] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13566. --- Resolution: Fixed Fix Version/s: 1.6.2 > Deadlock between MemoryStore and BlockManager >

[jira] [Resolved] (SPARK-15167) Add public catalog implementation method to SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15167. --- Resolution: Won't Fix > Add public catalog implementation method to SparkSession >

[jira] [Updated] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13566: -- Assignee: cen yuhai > Deadlock between MemoryStore and BlockManager >

[jira] [Resolved] (SPARK-15152) Scaladoc and Code style Improvements

[ https://issues.apache.org/jira/browse/SPARK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15152. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-15167) Add public catalog implementation method to SparkSession

Andrew Or created SPARK-15167: - Summary: Add public catalog implementation method to SparkSession Key: SPARK-15167 URL: https://issues.apache.org/jira/browse/SPARK-15167 Project: Spark Issue

[jira] [Updated] (SPARK-15166) Move hive-specific conf setting from SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15166: -- Summary: Move hive-specific conf setting from SparkSession (was: Move hive-specific conf setting to

[jira] [Created] (SPARK-15166) Move hive-specific conf setting to HiveSharedState

Andrew Or created SPARK-15166: - Summary: Move hive-specific conf setting to HiveSharedState Key: SPARK-15166 URL: https://issues.apache.org/jira/browse/SPARK-15166 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14893. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.0.0 > Re-enable

[jira] [Updated] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15158: -- Assignee: Kai Wang > Too aggressive logging in SizeBasedRollingPolicy? >

[jira] [Resolved] (SPARK-9926) Parallelize file listing for partitioned Hive table

[ https://issues.apache.org/jira/browse/SPARK-9926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9926. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Parallelize file

[jira] [Resolved] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15158. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Too aggressive

[jira] [Resolved] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15134. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15135) Make sure SparkSession thread safe

[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15135. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make sure SparkSession thread safe >

[jira] [Resolved] (SPARK-15072) Remove SparkSession.withHiveSupport

[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15072. --- Resolution: Fixed > Remove SparkSession.withHiveSupport > --- > >

[jira] [Resolved] (SPARK-14896) Deprecate HiveContext in Python

[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14896. --- Resolution: Fixed Fix Version/s: 2.0.0 > Deprecate HiveContext in Python >

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Assignee: Sandeep Singh > Use SparkSession instead of SQLContext in testsuites >

[jira] [Updated] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15045: -- Priority: Major (was: Trivial) > Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for

[jira] [Resolved] (SPARK-15116) In REPL we should create SparkSession first and get SparkContext from it

[ https://issues.apache.org/jira/browse/SPARK-15116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15116. --- Resolution: Fixed Fix Version/s: 2.0.0 > In REPL we should create SparkSession first and get

[jira] [Resolved] (SPARK-15031) Use SparkSession in Scala/Python/Java example.

[ https://issues.apache.org/jira/browse/SPARK-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15031. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use SparkSession

[jira] [Updated] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13001: -- Assignee: Sebastien Rainville > Coarse-grained Mesos scheduler should reject offers for longer period

[jira] [Resolved] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13001. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Coarse-grained

[jira] [Resolved] (SPARK-15121) Improve logging of external shuffle handler

[ https://issues.apache.org/jira/browse/SPARK-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15121. --- Resolution: Fixed Assignee: Thomas Graves Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-15121) Improve logging of external shuffle handler

[ https://issues.apache.org/jira/browse/SPARK-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15121: -- Priority: Minor (was: Major) > Improve logging of external shuffle handler >

[jira] [Resolved] (SPARK-12299) Remove history serving functionality from standalone Master

[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12299. --- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.0.0 > Remove history

[jira] [Resolved] (SPARK-15126) RuntimeConfig.set should return Unit rather than RuntimeConfig itself

[ https://issues.apache.org/jira/browse/SPARK-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15126. --- Resolution: Fixed > RuntimeConfig.set should return Unit rather than RuntimeConfig itself >

[jira] [Commented] (SPARK-13269) Expose more executor stats in stable status API

[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270067#comment-15270067 ] Andrew Or commented on SPARK-13269: --- Oops actually this was already done in SPARK-14069. Closing this

[jira] [Resolved] (SPARK-13269) Expose more executor stats in stable status API

[ https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13269. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.0.0 > Expose more executor

[jira] [Updated] (SPARK-14645) non local Python resource doesn't work with Mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14645: -- Assignee: Timothy Chen > non local Python resource doesn't work with Mesos cluster mode >

[jira] [Resolved] (SPARK-14414) Make error messages consistent across DDLs

[ https://issues.apache.org/jira/browse/SPARK-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14414. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make error messages consistent across DDLs >

[jira] [Resolved] (SPARK-15097) Import fails for someDataset.sqlContext.implicits._

[ https://issues.apache.org/jira/browse/SPARK-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15097. --- Resolution: Fixed Assignee: Koert Kuipers Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15084) Use builder pattern to create SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15084. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use builder

[jira] [Resolved] (SPARK-14645) non local Python resource doesn't work with Mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14645. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > non local Python

[jira] [Updated] (SPARK-14422) Improve handling of optional configs in SQLConf

[ https://issues.apache.org/jira/browse/SPARK-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14422: -- Assignee: Sandeep Singh > Improve handling of optional configs in SQLConf >

[jira] [Resolved] (SPARK-14422) Improve handling of optional configs in SQLConf

[ https://issues.apache.org/jira/browse/SPARK-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14422. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Improve handling

[jira] [Created] (SPARK-15104) Bad spacing in log line

Andrew Ash created SPARK-15104: -- Summary: Bad spacing in log line Key: SPARK-15104 URL: https://issues.apache.org/jira/browse/SPARK-15104 Project: Spark Issue Type: Bug Affects Versions:

[jira] [Updated] (SPARK-15072) Remove SparkSession.withHiveSupport

[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15072: -- Assignee: Sandeep Singh > Remove SparkSession.withHiveSupport > --- >

[jira] [Updated] (SPARK-15084) Use builder pattern to create SparkSession in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15084: -- Assignee: Dongjoon Hyun > Use builder pattern to create SparkSession in PySpark >

[jira] [Assigned] (SPARK-15073) Make SparkSession constructors private

[ https://issues.apache.org/jira/browse/SPARK-15073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15073: - Assignee: Andrew Or > Make SparkSession constructors private >

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Summary: Use SparkSession instead of SQLContext in testsuites (was: Use SparkSession instread of

[jira] [Resolved] (SPARK-15068) Use proper metastore warehouse path

[ https://issues.apache.org/jira/browse/SPARK-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15068. --- Resolution: Duplicate > Use proper metastore warehouse path > --- >

[jira] [Created] (SPARK-15068) Use proper metastore warehouse path

Andrew Or created SPARK-15068: - Summary: Use proper metastore warehouse path Key: SPARK-15068 URL: https://issues.apache.org/jira/browse/SPARK-15068 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15068) Use proper metastore warehouse path

[ https://issues.apache.org/jira/browse/SPARK-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15068: -- Description: Today, we use "" empty string without Hive, and "/user/hive/warehouse" with Hive, which

[jira] [Closed] (SPARK-14895) SparkSession Python API

[ https://issues.apache.org/jira/browse/SPARK-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-14895. - Resolution: Duplicate > SparkSession Python API > --- > > Key:

[jira] [Resolved] (SPARK-15019) Propagate all Spark Confs to HiveConf created in HiveClientImpl

[ https://issues.apache.org/jira/browse/SPARK-15019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15019. --- Resolution: Fixed Fix Version/s: 2.0.0 > Propagate all Spark Confs to HiveConf created in

[jira] [Updated] (SPARK-14896) Deprecate HiveContext in Python

[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14896: -- Summary: Deprecate HiveContext in Python (was: Remove HiveContext in Python) > Deprecate HiveContext

[jira] [Resolved] (SPARK-14673) Remove HiveContext

[ https://issues.apache.org/jira/browse/SPARK-14673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14673. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove HiveContext > -- > >

[jira] [Reopened] (SPARK-14896) Remove HiveContext in Python

[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-14896: --- > Remove HiveContext in Python > > > Key: SPARK-14896 >

[jira] [Closed] (SPARK-14896) Remove HiveContext in Python

[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-14896. - Resolution: Won't Fix > Remove HiveContext in Python > > >

[jira] [Created] (SPARK-15012) Simplify configuration API further

Andrew Or created SPARK-15012: - Summary: Simplify configuration API further Key: SPARK-15012 URL: https://issues.apache.org/jira/browse/SPARK-15012 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-14988) Implement catalog and conf API in Python SparkSession

[ https://issues.apache.org/jira/browse/SPARK-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14988. --- Resolution: Fixed Fix Version/s: 2.0.0 > Implement catalog and conf API in Python

[jira] [Created] (SPARK-14988) Implement catalog and conf API in Python SparkSession

Andrew Or created SPARK-14988: - Summary: Implement catalog and conf API in Python SparkSession Key: SPARK-14988 URL: https://issues.apache.org/jira/browse/SPARK-14988 Project: Spark Issue Type:

[jira] [Updated] (SPARK-14988) Implement catalog and conf API in Python SparkSession

[ https://issues.apache.org/jira/browse/SPARK-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14988: -- Description: This is like implementing SPARK-13477 and SPARK-13487 in the Python SparkSession. >

[jira] [Commented] (SPARK-14014) Replace existing analysis.Catalog with SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261177#comment-15261177 ] Andrew Or commented on SPARK-14014: --- Pretty sure this was fixed. :) > Replace existing

[jira] [Resolved] (SPARK-14014) Replace existing analysis.Catalog with SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14014. --- Resolution: Fixed Fix Version/s: 2.0.0 > Replace existing analysis.Catalog with

[jira] [Commented] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

[ https://issues.apache.org/jira/browse/SPARK-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260623#comment-15260623 ] Andrew Or commented on SPARK-14915: --- I haven't looked into the scheduler code in detail yet, but it

[jira] [Assigned] (SPARK-14945) Python SparkSession API

[ https://issues.apache.org/jira/browse/SPARK-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14945: - Assignee: Andrew Or > Python SparkSession API > --- > >

[jira] [Created] (SPARK-14945) Python SparkSession API

Andrew Or created SPARK-14945: - Summary: Python SparkSession API Key: SPARK-14945 URL: https://issues.apache.org/jira/browse/SPARK-14945 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-14940) Move ExternalCatalog to own file

Andrew Or created SPARK-14940: - Summary: Move ExternalCatalog to own file Key: SPARK-14940 URL: https://issues.apache.org/jira/browse/SPARK-14940 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14904) Add back HiveContext in compatibility package

Andrew Or created SPARK-14904: - Summary: Add back HiveContext in compatibility package Key: SPARK-14904 URL: https://issues.apache.org/jira/browse/SPARK-14904 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

Andrew Or created SPARK-14902: - Summary: Expose user-facing RuntimeConfig in SparkSession Key: SPARK-14902 URL: https://issues.apache.org/jira/browse/SPARK-14902 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-14721) Remove the HiveContext class

[ https://issues.apache.org/jira/browse/SPARK-14721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14721. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove the HiveContext class >

[jira] [Created] (SPARK-14896) Remove HiveContext in Python

Andrew Or created SPARK-14896: - Summary: Remove HiveContext in Python Key: SPARK-14896 URL: https://issues.apache.org/jira/browse/SPARK-14896 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14895) SparkSession Python API

Andrew Or created SPARK-14895: - Summary: SparkSession Python API Key: SPARK-14895 URL: https://issues.apache.org/jira/browse/SPARK-14895 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

Andrew Or created SPARK-14893: - Summary: Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed Key: SPARK-14893 URL: https://issues.apache.org/jira/browse/SPARK-14893 Project: Spark

[jira] [Created] (SPARK-14861) Replace internal usages of SQLContext with SparkSession

Andrew Or created SPARK-14861: - Summary: Replace internal usages of SQLContext with SparkSession Key: SPARK-14861 URL: https://issues.apache.org/jira/browse/SPARK-14861 Project: Spark Issue

[jira] [Comment Edited] (SPARK-14694) Thrift Server + Hive Metastore + Kerberos doesn't work

[ https://issues.apache.org/jira/browse/SPARK-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254337#comment-15254337 ] Andrew Lee edited comment on SPARK-14694 at 4/22/16 6:03 PM: - Not sure if

[jira] [Commented] (SPARK-14694) Thrift Server + Hive Metastore + Kerberos doesn't work

[ https://issues.apache.org/jira/browse/SPARK-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254337#comment-15254337 ] Andrew Lee commented on SPARK-14694: I'm able to get this working with Spark 1.6.1 + Hive 1.2 +

[jira] [Created] (SPARK-14828) Start SparkSession in REPL instead of SQLContext

Andrew Or created SPARK-14828: - Summary: Start SparkSession in REPL instead of SQLContext Key: SPARK-14828 URL: https://issues.apache.org/jira/browse/SPARK-14828 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14823) Fix all references to HiveContext in comments and docs

Andrew Or created SPARK-14823: - Summary: Fix all references to HiveContext in comments and docs Key: SPARK-14823 URL: https://issues.apache.org/jira/browse/SPARK-14823 Project: Spark Issue Type:

[jira] [Created] (SPARK-14824) Rename object HiveContext to something else

Andrew Or created SPARK-14824: - Summary: Rename object HiveContext to something else Key: SPARK-14824 URL: https://issues.apache.org/jira/browse/SPARK-14824 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14721) Remove the HiveContext class

[ https://issues.apache.org/jira/browse/SPARK-14721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14721: -- Summary: Remove the HiveContext class (was: Actually remove the HiveContext file itself) > Remove

[jira] [Commented] (SPARK-14789) Move FunctionResourceLoader into SessionState

[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252393#comment-15252393 ] Andrew Or commented on SPARK-14789: --- Fixed in https://github.com/apache/spark/pull/12556 > Move

[jira] [Resolved] (SPARK-14789) Move FunctionResourceLoader into SessionState

[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14789. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move FunctionResourceLoader into SessionState >

[jira] [Created] (SPARK-14789) Move FunctionResourceLoader into SessionState

Andrew Or created SPARK-14789: - Summary: Move FunctionResourceLoader into SessionState Key: SPARK-14789 URL: https://issues.apache.org/jira/browse/SPARK-14789 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14721) Actually remove the HiveContext file itself

Andrew Or created SPARK-14721: - Summary: Actually remove the HiveContext file itself Key: SPARK-14721 URL: https://issues.apache.org/jira/browse/SPARK-14721 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14720) Move the rest of HiveContext to HiveSessionState

Andrew Or created SPARK-14720: - Summary: Move the rest of HiveContext to HiveSessionState Key: SPARK-14720 URL: https://issues.apache.org/jira/browse/SPARK-14720 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245009#comment-15245009 ] Andrew Or commented on SPARK-14647: --- I've reverted it for now. > Group SQLContext/HiveContext state

[jira] [Created] (SPARK-14674) Move HiveContext.hiveconf to HiveSessionState

Andrew Or created SPARK-14674: - Summary: Move HiveContext.hiveconf to HiveSessionState Key: SPARK-14674 URL: https://issues.apache.org/jira/browse/SPARK-14674 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14647: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-14673 > Group SQLContext/HiveContext state into

[jira] [Updated] (SPARK-14672) Move HiveContext analyze logic to AnalyzeTable

[ https://issues.apache.org/jira/browse/SPARK-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14672: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-14673 > Move HiveContext analyze logic to

[jira] [Updated] (SPARK-14668) Move current_database to sql/core

[ https://issues.apache.org/jira/browse/SPARK-14668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14668: -- Parent Issue: SPARK-14673 (was: SPARK-14118) > Move current_database to sql/core >

[jira] [Created] (SPARK-14673) Remove HiveContext

Andrew Or created SPARK-14673: - Summary: Remove HiveContext Key: SPARK-14673 URL: https://issues.apache.org/jira/browse/SPARK-14673 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-14672) Move HiveContext analyze logic to AnalyzeTable

Andrew Or created SPARK-14672: - Summary: Move HiveContext analyze logic to AnalyzeTable Key: SPARK-14672 URL: https://issues.apache.org/jira/browse/SPARK-14672 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14670) Allow updating SQLMetrics on driver

Andrew Or created SPARK-14670: - Summary: Allow updating SQLMetrics on driver Key: SPARK-14670 URL: https://issues.apache.org/jira/browse/SPARK-14670 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

Andrew Or created SPARK-14647: - Summary: Group SQLContext/HiveContext state into PersistentState Key: SPARK-14647 URL: https://issues.apache.org/jira/browse/SPARK-14647 Project: Spark Issue

[jira] [Commented] (SPARK-14460) DataFrameWriter JDBC doesn't Quote/Escape column names

[ https://issues.apache.org/jira/browse/SPARK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242231#comment-15242231 ] Andrew Ash commented on SPARK-14460: I also had a problem with a column named "order" so we should

[jira] [Updated] (SPARK-14130) [Table related commands] Alter column

[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14130: -- Assignee: Yin Huai (was: Andrew Or) > [Table related commands] Alter column >

[jira] [Resolved] (SPARK-14592) Create table like

[ https://issues.apache.org/jira/browse/SPARK-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14592. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-14558) In ClosureCleaner, clean the outer pointer if it's a REPL line object

[ https://issues.apache.org/jira/browse/SPARK-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14558. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > In ClosureCleaner,

[jira] [Resolved] (SPARK-14617) Remove deprecated APIs in TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14617. --- Resolution: Fixed > Remove deprecated APIs in TaskMetrics > - >

[jira] [Resolved] (SPARK-14619) Track internal accumulators (metrics) by stage attempt rather than stage

[ https://issues.apache.org/jira/browse/SPARK-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14619. --- Resolution: Fixed > Track internal accumulators (metrics) by stage attempt rather than stage >

[jira] [Resolved] (SPARK-12133) Support dynamic allocation in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12133. --- Resolution: Fixed Fix Version/s: 2.0.0 > Support dynamic allocation in Spark Streaming >

[jira] [Updated] (SPARK-14445) Show columns/partitions

[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Assignee: Dilip Biswal > Show columns/partitions > --- > > Key:

[jira] [Updated] (SPARK-14445) Support native execution of SHOW COLUMNS and SHOW PARTITIONS command

[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-14118 > Support native execution of

[jira] [Updated] (SPARK-14445) Show columns/partitions

[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Summary: Show columns/partitions (was: show columns/partitions) > Show columns/partitions >

[jira] [Updated] (SPARK-14445) show columns/partitions

[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Summary: show columns/partitions (was: Support native execution of SHOW COLUMNS and SHOW PARTITIONS

[jira] [Updated] (SPARK-14499) Add tests to make sure drop partitions of an external table will not delete data

[ https://issues.apache.org/jira/browse/SPARK-14499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14499: -- Assignee: Xiao Li > Add tests to make sure drop partitions of an external table will not delete >

<    1   2   3   4   5   6   7   8   9   10   >