[jira] [Updated] (SPARK-27157) Add Executor level metrics to monitoring doc

2019-03-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-27157: --- Summary: Add Executor level metrics to monitoring doc (was: Add Executor metrics to monitoring

[jira] [Updated] (SPARK-25603) Project Pushdown for Nested fields through various operators

2019-03-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-25603: Summary: Project Pushdown for Nested fields through various operators (was: `Projection` expression

[jira] [Updated] (SPARK-23749) Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23749: Summary: Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage (was:

[jira] [Assigned] (SPARK-27157) Add Executor level metrics to monitoring doc

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27157: Assignee: (was: Apache Spark) > Add Executor level metrics to monitoring doc >

[jira] [Assigned] (SPARK-27026) Upgrade Docker image for release build to Ubuntu 18.04

2019-03-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-27026: --- Assignee: DB Tsai > Upgrade Docker image for release build to Ubuntu 18.04 >

[jira] [Resolved] (SPARK-27026) Upgrade Docker image for release build to Ubuntu 18.04

2019-03-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-27026. - Resolution: Resolved > Upgrade Docker image for release build to Ubuntu 18.04 >

[jira] [Assigned] (SPARK-27122) YARN test failures in Java 9+

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27122: Assignee: (was: Apache Spark) > YARN test failures in Java 9+ >

[jira] [Assigned] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27158: Assignee: (was: Apache Spark) > dev/mima and dev/scalastyle support dynamic profiles

[jira] [Updated] (SPARK-25603) Nested Column Pruning

2019-03-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-25603: Summary: Nested Column Pruning (was: Project Pushdown for Nested fields through various operators) >

[jira] [Created] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27158: --- Summary: dev/mima and dev/scalastyle support dynamic profiles Key: SPARK-27158 URL: https://issues.apache.org/jira/browse/SPARK-27158 Project: Spark Issue

[jira] [Created] (SPARK-27159) Update MsSqlServer dialect

2019-03-14 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-27159: --- Summary: Update MsSqlServer dialect Key: SPARK-27159 URL: https://issues.apache.org/jira/browse/SPARK-27159 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27026) Upgrade Docker image for release build to Ubuntu 18.04

2019-03-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792390#comment-16792390 ] DB Tsai commented on SPARK-27026: - Issue resolved by pull request 23932

[jira] [Commented] (SPARK-27159) Update MsSqlServer dialect

2019-03-14 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792520#comment-16792520 ] Zhu, Lipeng commented on SPARK-27159: - I am working on this. > Update MsSqlServer dialect >

[jira] [Updated] (SPARK-27157) Add Executor level metrics to monitoring docs

2019-03-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-27157: --- Summary: Add Executor level metrics to monitoring docs (was: Add Executor level metrics to

[jira] [Updated] (SPARK-27157) Add Executor level metrics to monitoring docs

2019-03-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-27157: --- Description: {{Executor Task Metrics}} exists in spark docs, we should add an {{Executor Metrics}}

[jira] [Assigned] (SPARK-27122) YARN test failures in Java 9+

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27122: Assignee: Apache Spark > YARN test failures in Java 9+ > - >

[jira] [Assigned] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27158: Assignee: Apache Spark > dev/mima and dev/scalastyle support dynamic profiles >

[jira] [Assigned] (SPARK-27157) Add Executor level metrics to monitoring doc

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27157: Assignee: Apache Spark > Add Executor level metrics to monitoring doc >

[jira] [Resolved] (SPARK-27127) Deduplicate codes reading from/writing to unsafe object

2019-03-14 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-27127. -- Resolution: Won't Fix Please refer 

[jira] [Assigned] (SPARK-27159) Update MsSqlServer dialect

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27159: Assignee: (was: Apache Spark) > Update MsSqlServer dialect >

[jira] [Assigned] (SPARK-27159) Update MsSqlServer dialect

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27159: Assignee: Apache Spark > Update MsSqlServer dialect > -- > >

[jira] [Assigned] (SPARK-27161) improve the document of SQL keywords

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27161: Assignee: Apache Spark (was: Wenchen Fan) > improve the document of SQL keywords >

[jira] [Assigned] (SPARK-27161) improve the document of SQL keywords

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27161: Assignee: Wenchen Fan (was: Apache Spark) > improve the document of SQL keywords >

[jira] [Assigned] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27160: Assignee: Apache Spark > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Assigned] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27160: Assignee: (was: Apache Spark) > Incorrect Literal Casting of DecimalType in

[jira] [Assigned] (SPARK-26152) Flaky test: BroadcastSuite

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26152: - Assignee: Ajith S > Flaky test: BroadcastSuite > -- > >

[jira] [Resolved] (SPARK-26152) Flaky test: BroadcastSuite

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26152. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24056

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.1

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Summary: Upgrade the built-in Hive to 2.3.4 for hadoop-3.1 (was: Upgrade built-in Hive to 2.3.4)

[jira] [Created] (SPARK-27161) improve the document of SQL keywords

2019-03-14 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-27161: --- Summary: improve the document of SQL keywords Key: SPARK-27161 URL: https://issues.apache.org/jira/browse/SPARK-27161 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

2019-03-14 Thread Darcy Shen (JIRA)
Darcy Shen created SPARK-27160: -- Summary: Incorrect Literal Casting of DecimalType in OrcFilters Key: SPARK-27160 URL: https://issues.apache.org/jira/browse/SPARK-27160 Project: Spark Issue

[jira] [Resolved] (SPARK-27138) Remove AdminUtils calls

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27138. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24071

[jira] [Assigned] (SPARK-27138) Remove AdminUtils calls

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27138: - Assignee: Dylan Guedes > Remove AdminUtils calls > --- > >

[jira] [Created] (SPARK-27163) Cleanup and consolidate Pandas UDF functionality

2019-03-14 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-27163: Summary: Cleanup and consolidate Pandas UDF functionality Key: SPARK-27163 URL: https://issues.apache.org/jira/browse/SPARK-27163 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26778) Implement file source V2 partitioning

2019-03-14 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792843#comment-16792843 ] Ryan Blue commented on SPARK-26778: --- [~Gengliang.Wang], can you clarify what this issue is tracking?

[jira] [Comment Edited] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-14 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792939#comment-16792939 ] Tyson Condie edited comment on SPARK-27006 at 3/14/19 6:23 PM: --- I would

[jira] [Updated] (SPARK-27152) Column equality does not work for aliased columns.

2019-03-14 Thread Ryan Radtke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Radtke updated SPARK-27152: Priority: Minor (was: Major) > Column equality does not work for aliased columns. >

[jira] [Updated] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27158: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > dev/mima and

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.1

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Issue Type: Umbrella (was: Improvement) > Upgrade the built-in Hive to 2.3.4 for hadoop-3.1 >

[jira] [Created] (SPARK-27162) Add new method getOriginalMap in CaseInsensitiveStringMap

2019-03-14 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-27162: -- Summary: Add new method getOriginalMap in CaseInsensitiveStringMap Key: SPARK-27162 URL: https://issues.apache.org/jira/browse/SPARK-27162 Project: Spark

[jira] [Assigned] (SPARK-27162) Add new method getOriginalMap in CaseInsensitiveStringMap

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27162: Assignee: (was: Apache Spark) > Add new method getOriginalMap in

[jira] [Assigned] (SPARK-27162) Add new method getOriginalMap in CaseInsensitiveStringMap

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27162: Assignee: Apache Spark > Add new method getOriginalMap in CaseInsensitiveStringMap >

[jira] [Assigned] (SPARK-27163) Cleanup and consolidate Pandas UDF functionality

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27163: Assignee: (was: Apache Spark) > Cleanup and consolidate Pandas UDF functionality >

[jira] [Comment Edited] (SPARK-27152) Column equality does not work for aliased columns.

2019-03-14 Thread Ryan Radtke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792793#comment-16792793 ] Ryan Radtke edited comment on SPARK-27152 at 3/14/19 3:36 PM: -- If you are

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.1

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Description: Spark fail to run on Hadoop 3.x, because Hive's ShimLoader considers Hadoop 3.x to

[jira] [Updated] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-26742: --- Fix Version/s: 2.4.2 > Bump Kubernetes Client Version to 4.1.2 >

[jira] [Commented] (SPARK-27152) Column equality does not work for aliased columns.

2019-03-14 Thread Ryan Radtke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792793#comment-16792793 ] Ryan Radtke commented on SPARK-27152: - If you are abstracting elt then it important.  Also, its just

[jira] [Comment Edited] (SPARK-27152) Column equality does not work for aliased columns.

2019-03-14 Thread Ryan Radtke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792793#comment-16792793 ] Ryan Radtke edited comment on SPARK-27152 at 3/14/19 3:34 PM: -- If you are

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.1

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Description: Upgrade built-in Hive to 2.3.4 for Hadoop-3.1(Please note that this upgrade only

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.1

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Description: Upgrade built-in Hive to 2.3.4 for Hadoop-3.1(Please note that this upgrade only

[jira] [Updated] (SPARK-27163) Cleanup and consolidate Pandas UDF functionality

2019-03-14 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-27163: - Priority: Minor (was: Major) > Cleanup and consolidate Pandas UDF functionality >

[jira] [Updated] (SPARK-27130) Automatically select profile when executing sbt-checkstyle

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27130: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > Automatically select

[jira] [Updated] (SPARK-27054) Remove Calcite dependency

2019-03-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27054: Issue Type: Sub-task (was: Improvement) Parent: SPARK-23710 > Remove Calcite dependency

[jira] [Assigned] (SPARK-27163) Cleanup and consolidate Pandas UDF functionality

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27163: Assignee: Apache Spark > Cleanup and consolidate Pandas UDF functionality >

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-14 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792939#comment-16792939 ] Tyson Condie commented on SPARK-27006: -- I would like to briefly illuminate what I think this SPIP

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

2019-03-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792975#comment-16792975 ] Marcelo Vanzin commented on SPARK-27142: I'm not sure I understand your point, Sean. We expose

[jira] [Comment Edited] (SPARK-5997) Increase partition count without performing a shuffle

2019-03-14 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792964#comment-16792964 ] nirav patel edited comment on SPARK-5997 at 3/14/19 6:56 PM: - Adding another

[jira] [Updated] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-14 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-27006: -- Priority: Major (was: Minor) > SPIP: .NET bindings for Apache Spark >

[jira] [Updated] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-14 Thread Ryan Moore (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Moore updated SPARK-27164: --- Attachment: Screen Shot 2019-03-14 at 1.49.19 PM.png > RDD.countApprox on empty RDDs schedules jobs

[jira] [Resolved] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

2019-03-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27145. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24079

[jira] [Assigned] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

2019-03-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27145: -- Assignee: shahid > Close store after test, in the SQLAppStatusListenerSuite >

[jira] [Commented] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-03-14 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793080#comment-16793080 ] Martin Loncaric commented on SPARK-27098: - I've gotten the debug logs for (1.), but can't make

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2019-03-14 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792964#comment-16792964 ] nirav patel commented on SPARK-5997: Adding another possible use case for this ask - I am hitting 

[jira] [Created] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-14 Thread Ryan Moore (JIRA)
Ryan Moore created SPARK-27164: -- Summary: RDD.countApprox on empty RDDs schedules jobs which never complete Key: SPARK-27164 URL: https://issues.apache.org/jira/browse/SPARK-27164 Project: Spark

[jira] [Updated] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-03-14 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-27098: Attachment: sanitized_stdout_1.txt > Flaky missing file parts when writing to Ceph

[jira] [Commented] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-03-14 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793082#comment-16793082 ] Martin Loncaric commented on SPARK-27098: - [~ste...@apache.org] Does this make more sense to

[jira] [Comment Edited] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-03-14 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793082#comment-16793082 ] Martin Loncaric edited comment on SPARK-27098 at 3/14/19 9:28 PM: --

[jira] [Created] (SPARK-27166) Improve `printSchema` to print up to the given level

2019-03-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-27166: - Summary: Improve `printSchema` to print up to the given level Key: SPARK-27166 URL: https://issues.apache.org/jira/browse/SPARK-27166 Project: Spark Issue

[jira] [Resolved] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27070. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23986

[jira] [Assigned] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

2019-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27070: - Assignee: Yuli Fiterman > DefaultPartitionCoalescer can lock up driver for hours >

[jira] [Assigned] (SPARK-27168) Add docker integration test for MsSql Server

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27168: Assignee: Apache Spark > Add docker integration test for MsSql Server >

[jira] [Commented] (SPARK-27100) dag-scheduler-event-loop" java.lang.StackOverflowError

2019-03-14 Thread KaiXu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793233#comment-16793233 ] KaiXu commented on SPARK-27100: --- hi [~hyukjin.kwon], the workload I'm running is ALS from Hibench, the

[jira] [Assigned] (SPARK-27168) Add docker integration test for MsSql Server

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27168: Assignee: (was: Apache Spark) > Add docker integration test for MsSql Server >

[jira] [Commented] (SPARK-27168) Add docker integration test for MsSql Server

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793234#comment-16793234 ] Apache Spark commented on SPARK-27168: -- User 'lipzhu' has created a pull request for this issue:

[jira] [Created] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-27165: - Summary: Upgrade Apache ORC to 1.5.5 Key: SPARK-27165 URL: https://issues.apache.org/jira/browse/SPARK-27165 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27107: Assignee: Apache Spark > Spark SQL Job failing because of Kryo buffer overflow with ORC

[jira] [Assigned] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27107: Assignee: (was: Apache Spark) > Spark SQL Job failing because of Kryo buffer

[jira] [Assigned] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27165: Assignee: (was: Apache Spark) > Upgrade Apache ORC to 1.5.5 >

[jira] [Updated] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27165: -- Description: This issue aims to update Apache ORC dependency to fix SPARK-27107 . {code:java}

[jira] [Assigned] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

2019-03-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-26990: --- Assignee: Gengliang Wang > Difference in handling of mixed-case partition column names after

[jira] [Updated] (SPARK-26176) Verify column name when creating table via `STORED AS`

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26176: -- Issue Type: Improvement (was: Bug) > Verify column name when creating table via `STORED AS`

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-14 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Description: I use spark to process some data in HDFS and HBASE, I use one thread consume message from a

[jira] [Resolved] (SPARK-26343) Speed up running the kubernetes integration tests locally

2019-03-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26343. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23380

[jira] [Updated] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27165: -- Description: This issue aims to update Apache ORC dependency to fix  SPARK-27107 . (was: This

[jira] [Assigned] (SPARK-27166) Improve `printSchema` to print up to the given level

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27166: Assignee: (was: Apache Spark) > Improve `printSchema` to print up to the given level

[jira] [Commented] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

2019-03-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793222#comment-16793222 ] Ajith S commented on SPARK-27164: - i will be working on this > RDD.countApprox on empty RDDs schedules

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

2019-03-14 Thread acupple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: QQ20190315-102235.png > number of active tasks is negative on executors page >

[jira] [Commented] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793110#comment-16793110 ] Dongjoon Hyun commented on SPARK-27107: --- The vote passed. I'm preparing the PRs. > Spark SQL Job

[jira] [Commented] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793125#comment-16793125 ] Apache Spark commented on SPARK-27107: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-27165) Upgrade Apache ORC to 1.5.5

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27165: Assignee: Apache Spark > Upgrade Apache ORC to 1.5.5 > --- > >

[jira] [Commented] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793118#comment-16793118 ] Apache Spark commented on SPARK-27107: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

2019-03-14 Thread Jerry Garcia (JIRA)
Jerry Garcia created SPARK-27167: Summary: What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ? Key: SPARK-27167 URL: https://issues.apache.org/jira/browse/SPARK-27167

[jira] [Updated] (SPARK-26176) Verify column name when creating table via `STORED AS`

2019-03-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26176: -- Priority: Minor (was: Major) > Verify column name when creating table via `STORED AS` >

[jira] [Updated] (SPARK-27168) Add docker integration test for MsSql Server

2019-03-14 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu, Lipeng updated SPARK-27168: Issue Type: Test (was: Bug) > Add docker integration test for MsSql Server >

[jira] [Created] (SPARK-27168) Add docker integration test for MsSql Server

2019-03-14 Thread Zhu, Lipeng (JIRA)
Zhu, Lipeng created SPARK-27168: --- Summary: Add docker integration test for MsSql Server Key: SPARK-27168 URL: https://issues.apache.org/jira/browse/SPARK-27168 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-27141) Use ConfigEntry for hardcoded configs Yarn

2019-03-14 Thread wangjiaochun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangjiaochun reopened SPARK-27141: -- > Use ConfigEntry for hardcoded configs Yarn > -- > >

[jira] [Commented] (SPARK-26778) Implement file source V2 partitioning pruning

2019-03-14 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793263#comment-16793263 ] Gengliang Wang commented on SPARK-26778: Sorry, I meant file source partition pruning. I have

[jira] [Updated] (SPARK-26778) Implement file source V2 partitioning pruning

2019-03-14 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-26778: --- Summary: Implement file source V2 partitioning pruning (was: Implement file source V2

[jira] [Assigned] (SPARK-27166) Improve `printSchema` to print up to the given level

2019-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27166: Assignee: Apache Spark > Improve `printSchema` to print up to the given level >

[jira] [Resolved] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27158. -- Resolution: Fixed Fix Version/s: 3.0.0 Fixed in

[jira] [Assigned] (SPARK-27158) dev/mima and dev/scalastyle support dynamic profiles

2019-03-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27158: Assignee: Yuming Wang > dev/mima and dev/scalastyle support dynamic profiles >

  1   2   >