spark git commit: [MINOR][SQL] Add a debug log when a SQL text is used for a view

2018-09-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9241e1e7e -> 01c3dfab1 [MINOR][SQL] Add a debug log when a SQL text is used for a view ## What changes were proposed in this pull request? This took me a while to debug and find out. Looks we better at least leave a debug log that SQL tex

svn commit: r29211 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_07_14_02-80567fa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-07 Thread pwendell
Author: pwendell Date: Fri Sep 7 21:16:08 2018 New Revision: 29211 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_07_14_02-80567fa docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r29202 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_07_12_02-9241e1e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-07 Thread pwendell
Author: pwendell Date: Fri Sep 7 19:17:15 2018 New Revision: 29202 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_07_12_02-9241e1e docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[2/3] spark git commit: [SPARK-23429][CORE] Add executor memory metrics to heartbeat and expose in executors REST API

2018-09-07 Thread mcheah
http://git-wip-us.apache.org/repos/asf/spark/blob/9241e1e7/core/src/test/resources/spark-events/application_1506645932520_24630151 -- diff --git a/core/src/test/resources/spark-events/application_1506645932520_24630151 b/core/src

[1/3] spark git commit: [SPARK-23429][CORE] Add executor memory metrics to heartbeat and expose in executors REST API

2018-09-07 Thread mcheah
Repository: spark Updated Branches: refs/heads/master 458f5011b -> 9241e1e7e http://git-wip-us.apache.org/repos/asf/spark/blob/9241e1e7/core/src/test/scala/org/apache/spark/HeartbeatReceiverSuite.scala -- diff --git a/core/src/

[3/3] spark git commit: [SPARK-23429][CORE] Add executor memory metrics to heartbeat and expose in executors REST API

2018-09-07 Thread mcheah
[SPARK-23429][CORE] Add executor memory metrics to heartbeat and expose in executors REST API Add new executor level memory metrics (JVM used memory, on/off heap execution memory, on/off heap storage memory, on/off heap unified memory, direct memory, and mapped memory), and expose via the execu

spark git commit: [MINOR][SS] Fix kafka-0-10-sql trivials

2018-09-07 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 95a48b909 -> 80567fad4 [MINOR][SS] Fix kafka-0-10-sql trivials ## What changes were proposed in this pull request? Fix unused imports & outdated comments on `kafka-0-10-sql` module. (Found while I was working on [SPARK-23539](https://

spark git commit: [MINOR][SS] Fix kafka-0-10-sql trivials

2018-09-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master 22a46ca19 -> 458f5011b [MINOR][SS] Fix kafka-0-10-sql trivials ## What changes were proposed in this pull request? Fix unused imports & outdated comments on `kafka-0-10-sql` module. (Found while I was working on [SPARK-23539](https://gith

svn commit: r29201 - in /dev/spark/2.3.3-SNAPSHOT-2018_09_07_10_02-5b8b6b4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-07 Thread pwendell
Author: pwendell Date: Fri Sep 7 17:16:57 2018 New Revision: 29201 Log: Apache Spark 2.3.3-SNAPSHOT-2018_09_07_10_02-5b8b6b4 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25270] lint-python: Add flake8 to find syntax errors and undefined names

2018-09-07 Thread holden
Repository: spark Updated Branches: refs/heads/master 473f2fb3b -> 22a46ca19 [SPARK-25270] lint-python: Add flake8 to find syntax errors and undefined names ## What changes were proposed in this pull request? Add [flake8](http://flake8.pycqa.org) tests to find Python syntax errors and undefi

spark git commit: [SPARK-21786][SQL][FOLLOWUP] Add compressionCodec test for CTAS

2018-09-07 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 872bad161 -> 95a48b909 [SPARK-21786][SQL][FOLLOWUP] Add compressionCodec test for CTAS ## What changes were proposed in this pull request? Before Apache Spark 2.3, table properties were ignored when writing data to a hive table(created

spark git commit: [SPARK-21786][SQL][FOLLOWUP] Add compressionCodec test for CTAS

2018-09-07 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master f96a8bf8f -> 473f2fb3b [SPARK-21786][SQL][FOLLOWUP] Add compressionCodec test for CTAS ## What changes were proposed in this pull request? Before Apache Spark 2.3, table properties were ignored when writing data to a hive table(created wit

spark git commit: [SPARK-24415][CORE] Fixed the aggregated stage metrics by retaining stage objects in liveStages until all tasks are complete

2018-09-07 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.3 84922e506 -> 5b8b6b4e9 [SPARK-24415][CORE] Fixed the aggregated stage metrics by retaining stage objects in liveStages until all tasks are complete The problem occurs because stage object is removed from liveStages in AppStatusListener

svn commit: r29187 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_07_00_02-f96a8bf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-07 Thread pwendell
Author: pwendell Date: Fri Sep 7 07:17:09 2018 New Revision: 29187 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_07_00_02-f96a8bf docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---