[jira] [Resolved] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-30784. -- Resolution: Not A Bug Resolving it because with Hive 2.3, using regular orc is required.  > Hive 2.3

[jira] [Deleted] (SPARK-30976) Improve Maven Install Logic in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-30976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai deleted SPARK-30976: - > Improve Maven Install Logic in build/mvn > > > K

[jira] [Updated] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30784: - Description: Originally reported at [https://github.com/apache/spark/pull/26619#issuecomment-583802901]

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Attachment: hive-service-rpc-2.3.6-classes spark-hive-thriftserver_2.12-3.0.0-20200207.02

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Description: hive-service-rpc 2.3.6 and spark sql's thrift server module have duplicate classes. Leavin

[jira] [Created] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

Yin Huai created SPARK-30784: Summary: Hive 2.3 profile should still use orc-nohive Key: SPARK-30784 URL: https://issues.apache.org/jira/browse/SPARK-30784 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-30783: Assignee: Yin Huai > Hive 2.3 profile should exclude hive-service-rpc > -

[jira] [Created] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

Yin Huai created SPARK-30783: Summary: Hive 2.3 profile should exclude hive-service-rpc Key: SPARK-30783 URL: https://issues.apache.org/jira/browse/SPARK-30783 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-30450) Exclude .git folder for python linter

[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30450: - Affects Version/s: (was: 2.4.4) 3.0.0 > Exclude .git folder for python linter

[jira] [Updated] (SPARK-30450) Exclude .git folder for python linter

[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30450: - Priority: Minor (was: Major) > Exclude .git folder for python linter >

[jira] [Assigned] (SPARK-30450) Exclude .git folder for python linter

[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-30450: Assignee: Eric Chang > Exclude .git folder for python linter > --

[jira] [Resolved] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-25019. -- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.4.0 [https://github.com/apa

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568554#comment-16568554 ] Yin Huai commented on SPARK-25019: -- [~dongjoon] can you help us fix this issue? Or ther

[jira] [Created] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

Yin Huai created SPARK-25019: Summary: The published spark sql pom does not exclude the normal version of orc-core Key: SPARK-25019 URL: https://issues.apache.org/jira/browse/SPARK-25019 Project: Spark

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559977#comment-16559977 ] Yin Huai commented on SPARK-24895: -- [https://github.com/spotbugs/spotbugs-maven-plugin/

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554932#comment-16554932 ] Yin Huai commented on SPARK-24895: -- [~hyukjin.kwon] [~kiszk] seems this revert indeed f

[jira] [Resolved] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-24895. -- Resolution: Fixed Fix Version/s: 2.4.0 [https://github.com/apache/spark/pull/21865] has been me

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553610#comment-16553610 ] Yin Huai commented on SPARK-24895: -- [~kiszk] [~hyukjin.kwon] since this thing is pretty

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553568#comment-16553568 ] Yin Huai commented on SPARK-24895: --   [~kiszk] and [~hyukjin.kwon] we hit this issue t

[jira] [Updated] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-24895: - Target Version/s: 2.4.0 > Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349679#comment-16349679 ] Yin Huai commented on SPARK-23310: -- [~sitalke...@gmail.com] We found that the commit for

[jira] [Updated] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-23310: - Description: While running all TPC-DS queries with SF set to 1000, we noticed that Q95 (https://github.c

[jira] [Created] (SPARK-23310) Perf regression introduced by SPARK-21113

Yin Huai created SPARK-23310: Summary: Perf regression introduced by SPARK-21113 Key: SPARK-23310 URL: https://issues.apache.org/jira/browse/SPARK-23310 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349325#comment-16349325 ] Yin Huai commented on SPARK-12297: -- [~zi] has this issue got resolved in Hive? I see HIV

[jira] [Updated] (SPARK-23292) python tests related to pandas are skipped

[ https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-23292: - Priority: Critical (was: Blocker) > python tests related to pandas are skipped > ---

[jira] [Commented] (SPARK-23292) python tests related to pandas are skipped

[ https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349040#comment-16349040 ] Yin Huai commented on SPARK-23292: -- So, jenkins does have the right version of pandas an

[jira] [Created] (SPARK-23292) python tests related to pandas are skipped

Yin Huai created SPARK-23292: Summary: python tests related to pandas are skipped Key: SPARK-23292 URL: https://issues.apache.org/jira/browse/SPARK-23292 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340544#comment-16340544 ] Yin Huai commented on SPARK-4502: - I think it makes sense to target for 2.4.0. 2.3.1 is a

[jira] [Commented] (SPARK-22812) Failing cran-check on master

[ https://issues.apache.org/jira/browse/SPARK-22812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295532#comment-16295532 ] Yin Huai commented on SPARK-22812: -- Thank you guys! > Failing cran-check on master > -

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154575#comment-16154575 ] Yin Huai commented on SPARK-21927: -- My worry is that it may mask actual issues related t

[jira] [Updated] (SPARK-21258) Window result incorrect using complex object with spilling

[ https://issues.apache.org/jira/browse/SPARK-21258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-21258: - Fix Version/s: (was: 2.1.2) > Window result incorrect using complex object with spilling > --

[jira] [Commented] (SPARK-21258) Window result incorrect using complex object with spilling

[ https://issues.apache.org/jira/browse/SPARK-21258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075055#comment-16075055 ] Yin Huai commented on SPARK-21258: -- Since this change is not in branch-2.1, I am removin

[jira] [Resolved] (SPARK-21111) Fix test failure in 2.2

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 18316 [https://github.com/

[jira] [Reopened] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-20311: -- > SQL "range(N) as alias" or "range(N) alias" doesn't work > --

[jira] [Commented] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003626#comment-16003626 ] Yin Huai commented on SPARK-20311: -- It introduced a regression (https://github.com/apac

[jira] [Updated] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-20311: - Fix Version/s: (was: 2.2.1) (was: 2.3.0) > SQL "range(N) as alias" or "range(N

[jira] [Assigned] (SPARK-20661) SparkR tableNames() test fails

[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20661: Assignee: Hossein Falaki > SparkR tableNames() test fails > -- > >

[jira] [Resolved] (SPARK-20661) SparkR tableNames() test fails

[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20661. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17903 [https://github.com/

[jira] [Assigned] (SPARK-20358) Executors failing stage on interrupted exception thrown by cancelled tasks

[ https://issues.apache.org/jira/browse/SPARK-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20358: Assignee: Eric Liang > Executors failing stage on interrupted exception thrown by cancelled tasks

[jira] [Resolved] (SPARK-20358) Executors failing stage on interrupted exception thrown by cancelled tasks

[ https://issues.apache.org/jira/browse/SPARK-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20358. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17659 [https://github.com/

[jira] [Assigned] (SPARK-20217) Executor should not fail stage if killed task throws non-interrupted exception

[ https://issues.apache.org/jira/browse/SPARK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20217: Assignee: Eric Liang > Executor should not fail stage if killed task throws non-interrupted except

[jira] [Resolved] (SPARK-20217) Executor should not fail stage if killed task throws non-interrupted exception

[ https://issues.apache.org/jira/browse/SPARK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20217. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17531 [https://github.com/

[jira] [Commented] (SPARK-14388) Create Table

[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932960#comment-15932960 ] Yin Huai commented on SPARK-14388: -- [~erlu] I see. Can you create a jira for this? Let's

[jira] [Assigned] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-19620: Assignee: Carson Wang > Incorrect exchange coordinator Id in physical plan > -

[jira] [Resolved] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19620. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16952 [https://github.com/

[jira] [Updated] (SPARK-19816) DataFrameCallbackSuite doesn't recover the log level

[ https://issues.apache.org/jira/browse/SPARK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19816: - Fix Version/s: 2.1.1 > DataFrameCallbackSuite doesn't recover the log level > ---

[jira] [Commented] (SPARK-19604) Log the start of every Python test

[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869023#comment-15869023 ] Yin Huai commented on SPARK-19604: -- It has been resolved by https://github.com/apache/sp

[jira] [Resolved] (SPARK-19604) Log the start of every Python test

[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19604. -- Resolution: Fixed Fix Version/s: 2.1.1 2.0.3 > Log the start of every Python

[jira] [Assigned] (SPARK-19604) Log the start of every Python test

[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-19604: Assignee: Yin Huai > Log the start of every Python test > -- > >

[jira] [Created] (SPARK-19604) Log the start of every Python test

Yin Huai created SPARK-19604: Summary: Log the start of every Python test Key: SPARK-19604 URL: https://issues.apache.org/jira/browse/SPARK-19604 Project: Spark Issue Type: Test Compone

[jira] [Created] (SPARK-19321) Support Hive 2.x's metastore

Yin Huai created SPARK-19321: Summary: Support Hive 2.x's metastore Key: SPARK-19321 URL: https://issues.apache.org/jira/browse/SPARK-19321 Project: Spark Issue Type: Improvement Compon

[jira] [Resolved] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19295. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16649 [https://github.com/

[jira] [Updated] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19295: - Priority: Minor (was: Major) > IsolatedClientLoader's downloadVersion should log the location of downloa

[jira] [Updated] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19295: - Issue Type: Improvement (was: Bug) > IsolatedClientLoader's downloadVersion should log the location of d

[jira] [Created] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

Yin Huai created SPARK-19295: Summary: IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars Key: SPARK-19295 URL: https://issues.apache.org/jira/browse/SPARK-19295

[jira] [Resolved] (SPARK-18885) unify CREATE TABLE syntax for data source and hive serde tables

[ https://issues.apache.org/jira/browse/SPARK-18885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18885. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16296 [https://github.com/

[jira] [Resolved] (SPARK-19072) Catalyst's IN always returns false for infinity

[ https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19072. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16469 [https://github.com/

[jira] [Updated] (SPARK-19072) Catalyst's IN always returns false for infinity

[ https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19072: - Assignee: Wenchen Fan > Catalyst's IN always returns false for infinity > ---

[jira] [Resolved] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18567. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15996 [https://github.com/

[jira] [Commented] (SPARK-16552) Store the Inferred Schemas into External Catalog Tables when Creating Tables

[ https://issues.apache.org/jira/browse/SPARK-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15783705#comment-15783705 ] Yin Huai commented on SPARK-16552: -- [~smilegator] [~cloud_fan] i think we will not do pa

[jira] [Updated] (SPARK-18990) make DatasetBenchmark fairer for Dataset

[ https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18990: - Fix Version/s: (was: 2.2.0) > make DatasetBenchmark fairer for Dataset >

[jira] [Reopened] (SPARK-18990) make DatasetBenchmark fairer for Dataset

[ https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-18990: -- > make DatasetBenchmark fairer for Dataset > > > K

[jira] [Resolved] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18951. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16359 [https://github.com/

[jira] [Updated] (SPARK-18928) FileScanRDD, JDBCRDD, and UnsafeSorter should support task cancellation

[ https://issues.apache.org/jira/browse/SPARK-18928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18928: - Fix Version/s: 2.0.3 > FileScanRDD, JDBCRDD, and UnsafeSorter should support task cancellation >

[jira] [Updated] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18761: - Fix Version/s: 2.1.1 2.0.3 > Uncancellable / unkillable tasks may starve jobs of resou

[jira] [Created] (SPARK-18953) Do not show the link to a dead worker on the master page

Yin Huai created SPARK-18953: Summary: Do not show the link to a dead worker on the master page Key: SPARK-18953 URL: https://issues.apache.org/jira/browse/SPARK-18953 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18951: - Description: I recently hit a bug of com.thoughtworks.paranamer/paranamer, which causes jackson fail to

[jira] [Assigned] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-18951: Assignee: Yin Huai > Upgrade com.thoughtworks.paranamer/paranamer to 2.6 > ---

[jira] [Created] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer

Yin Huai created SPARK-18951: Summary: Upgrade com.thoughtworks.paranamer/paranamer Key: SPARK-18951 URL: https://issues.apache.org/jira/browse/SPARK-18951 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18951: - Summary: Upgrade com.thoughtworks.paranamer/paranamer to 2.6 (was: Upgrade com.thoughtworks.paranamer/pa

[jira] [Resolved] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18761. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16189 [https://github.com/

[jira] [Resolved] (SPARK-18921) check database existence with Hive.databaseExists instead of getDatabase

[ https://issues.apache.org/jira/browse/SPARK-18921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18921. -- Resolution: Fixed Fix Version/s: 2.1.1 Issue resolved by pull request 16332 [https://github.com/

[jira] [Resolved] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13747. -- Resolution: Fixed Fix Version/s: (was: 2.0.2) (was: 2.1.0)

[jira] [Resolved] (SPARK-18675) CTAS for hive serde table should work for all hive versions

[ https://issues.apache.org/jira/browse/SPARK-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18675. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16104 [https://github.com/

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Assignee: Alex Bozarth > executor page fails to show log links if executors are added after an app is >

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743298#comment-15743298 ] Yin Huai commented on SPARK-18816: -- Yea, log pages are still there. But, without those l

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Priority: Blocker (was: Major) > executor page fails to show log links if executors are added after an a

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743260#comment-15743260 ] Yin Huai commented on SPARK-18816: -- [~ajbozarth] Yea, please take a look. Thanks! The

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15737254#comment-15737254 ] Yin Huai commented on SPARK-18816: -- btw, my testing was done with chrome. I then termi

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Attachment: screenshot-1.png > executor page fails to show log links if executors are added after an app

[jira] [Created] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

Yin Huai created SPARK-18816: Summary: executor page fails to show log links if executors are added after an app is launched Key: SPARK-18816 URL: https://issues.apache.org/jira/browse/SPARK-18816 Project

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Description: How to reproduce with standalone mode: 1. Launch a spark master 2. Launch a spark shell. At

[jira] [Commented] (SPARK-18284) Scheme of DataFrame generated from RDD is diffrent between master and 2.0

[ https://issues.apache.org/jira/browse/SPARK-18284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15723012#comment-15723012 ] Yin Huai commented on SPARK-18284: -- [~kiszk] btw, do we know what caused the nullable se

[jira] [Created] (SPARK-18660) Parquet complains "Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl

Yin Huai created SPARK-18660: Summary: Parquet complains "Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl " Key: SPARK-18660

[jira] [Resolved] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18631. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16065 [https://github.com/

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Target Version/s: (was: 2.1.0) > Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757

[jira] [Assigned] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-18602: Assignee: Yin Huai > Dependency list still shows that the version of > org.codehaus.janino:common

[jira] [Resolved] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18602. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16025 [https://github.com/

[jira] [Created] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

Yin Huai created SPARK-18602: Summary: Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6 Key: SPARK-18602 URL: https://issues.apache.org/jira/browse/SPARK-18602

[jira] [Updated] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18544: - Priority: Blocker (was: Major) > Append with df.saveAsTable writes data to wrong location >

[jira] [Resolved] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15513. -- Resolution: Won't Fix > Bzip2Factory in Hadoop 2.7.1 is not thread safe > -

[jira] [Commented] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684302#comment-15684302 ] Yin Huai commented on SPARK-15513: -- I am closing this jira since the fix has been releas

[jira] [Comment Edited] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684302#comment-15684302 ] Yin Huai edited comment on SPARK-15513 at 11/21/16 6:17 PM: I

[jira] [Resolved] (SPARK-18360) default table path of tables in default database should depend on the location of default database

[ https://issues.apache.org/jira/browse/SPARK-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18360. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15812 [https://github.com/

[jira] [Updated] (SPARK-18360) default table path of tables in default database should depend on the location of default database

[ https://issues.apache.org/jira/browse/SPARK-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18360: - Labels: release_notes releasenotes (was: ) > default table path of tables in default database should dep

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Description: https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-2.1-test-sbt-hadoop-2.4/71/testRepor

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Component/s: (was: SQL) Spark Core > Flaky test: org.apache.spark.sql.hive.HiveSpark

[jira] [Resolved] (SPARK-18186) Migrate HiveUDAFFunction to TypedImperativeAggregate for partial aggregation support

[ https://issues.apache.org/jira/browse/SPARK-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18186. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15703 [https://github.com/

[jira] [Created] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

Yin Huai created SPARK-18468: Summary: Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column Key: SPARK-18468 URL: https://issues.apache.org/jira/browse/SP

[jira] [Commented] (SPARK-18464) Spark SQL fails to load tables created without providing a schema

[ https://issues.apache.org/jira/browse/SPARK-18464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669057#comment-15669057 ] Yin Huai commented on SPARK-18464: -- cc [~cloud_fan] > Spark SQL fails to load tables cr

  1   2   3   4   5   6   7   8   9   10   >