[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/19872 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20226 Thank you, @tejasapatil . I see. Although this is not applicable for ORC/Parquet hive tables, the PR looks useful for me. Could you put the condition and limitation in PR description?

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20206 **[Test build #85946 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85946/testReport)** for PR 20206 at commit

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20226 **[Test build #85945 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85945/testReport)** for PR 20226 at commit

[GitHub] spark issue #20216: [SPARK-23024][WEB-UI]Spark ui about the contents of the ...

Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/20216 Dear Sir, However, the real spark big data environment, a very large number of workers, every day running a very large number of applications, has completed a very large number of

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/20226 Jenkins retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/20206 Jenkins retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

Github user fjh100456 commented on the issue: https://github.com/apache/spark/pull/20087 @gatorsmile I'd change the precedence. For Parquet, if `hive.exec.compress.output` is true, keep the old precedence, otherwise, get compression from HiveOption. For Orc, because

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20214 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85942/ Test FAILed. ---

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20214 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20214 **[Test build #85942 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85942/testReport)** for PR 20214 at commit

[GitHub] spark issue #19885: [SPARK-22587] Spark job fails if fs.defaultFS and applic...

Github user merlintang commented on the issue: https://github.com/apache/spark/pull/19885 @jerryshao and @steveloughran thanks for your comments and review. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20224 I totally agree to add unique ID. This is because all of the generated code by whole-stage codegen has the same class name. It makes us hard to debug in a production environment. On the

[GitHub] spark issue #20096: [SPARK-22908] Add kafka source and sink for continuous p...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20096 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85934/ Test PASSed. ---

[GitHub] spark issue #20096: [SPARK-22908] Add kafka source and sink for continuous p...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20096 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20096: [SPARK-22908] Add kafka source and sink for continuous p...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20096 **[Test build #85934 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85934/testReport)** for PR 20096 at commit

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20087 **[Test build #85944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85944/testReport)** for PR 20087 at commit

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20206 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20206 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85936/ Test FAILed. ---

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20206 **[Test build #85936 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85936/testReport)** for PR 20206 at commit

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/20226 Jenkins test this please. Previous test case failure is not related to the PR ``` org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite.(It is not a test it is a

[GitHub] spark issue #20227: [SPARK-23035] Fix warning: TEMPORARY TABLE ... USING ......

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20227 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20227: [SPARK-23035] Fix warning: TEMPORARY TABLE ... US...

GitHub user xubo245 opened a pull request: https://github.com/apache/spark/pull/20227 [SPARK-23035] Fix warning: TEMPORARY TABLE ... USING ... is deprecated and use TempViewAlreadyExistsException when create temp view Fix warning: TEMPORARY TABLE ... USING ... is deprecated

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85932/ Test FAILed. ---

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85932/testReport)** for PR 19872 at commit

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20226 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85941/ Test FAILed. ---

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20226 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20224 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85940/ Test FAILed. ---

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20226 **[Test build #85941 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85941/testReport)** for PR 20226 at commit

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20224 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20224 **[Test build #85940 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85940/testReport)** for PR 20224 at commit

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20214 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85933/ Test FAILed. ---

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20214 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20214 **[Test build #85933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85933/testReport)** for PR 20214 at commit

[GitHub] spark issue #19885: [SPARK-22587] Spark job fails if fs.defaultFS and applic...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19885 LGTM. @merlintang please fix the PR title, thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20226: [SPARK-23034][SQL][UI] Display tablename for `HiveTableS...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/20226 @dongjoon-hyun : I tried it out over master and since the table scan goes via codegen, it wont show the table name. Will update the PR description with this finding. Lets move this discussion

[GitHub] spark pull request #20226: [SPARK-23034][SQL][UI] Display tablename for `Hiv...

Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/20226#discussion_r160843749 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -62,6 +62,8 @@ case class HiveTableScanExec(

[GitHub] spark issue #20192: [SPARK-22994][k8s] Use a single image for all Spark cont...

Github user mccheah commented on the issue: https://github.com/apache/spark/pull/20192 Good to merge here? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20226: [SPARK-23034][Hive][UI] Display tablename for `HiveTable...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20226 **[Test build #85943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85943/testReport)** for PR 20226 at commit

[GitHub] spark pull request #20226: [SPARK-23034][Hive][UI] Display tablename for `Hi...

Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/20226#discussion_r160843166 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -62,6 +62,8 @@ case class HiveTableScanExec(

[GitHub] spark pull request #20226: [SPARK-23034][Hive][UI] Display tablename for `Hi...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20226#discussion_r160841853 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -62,6 +62,8 @@ case class HiveTableScanExec(

[GitHub] spark issue #20210: [SPARK-23009][PYTHON] Fix for non-str col names to creat...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20210 Thank you! @HyukjinKwon . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20226: [SPARK-23034][Hive][UI] Display tablename for `HiveTable...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20226 Then, specifically, what happens in this PR for Parquet/ORC table which is converted to data source tables with `convertMetastoreParquet/Orc`? Now, both parameters are `true` by default.

[GitHub] spark pull request #20218: [SPARK-23000] [TEST-HADOOP2.6] Fix Flaky test sui...

Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/20218#discussion_r160840909 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala --- @@ -148,6 +148,7 @@ class

[GitHub] spark issue #20226: [SPARK-23034][Hive][UI] Display tablename for `HiveTable...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/20226 @dongjoon-hyun : For Spark native tables, the table scan node is abstracted out as a `WholeStageCodegen` node in the DAG. A codegen node might be doing more things besides table scan so it is

[GitHub] spark issue #20226: [SPARK-23034][Hive][UI] Display tablename for `HiveTable...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20226 It looks useful, @tejasapatil . Given that this is one line addition, why don't you handle the others? > For this JIRA, I am scoping those for hive table scans only. ---

[GitHub] spark issue #20223: [SPARK-23020][core] Fix races in launcher code, test.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20223 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20223: [SPARK-23020][core] Fix races in launcher code, test.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20223 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85929/ Test PASSed. ---

[GitHub] spark issue #20223: [SPARK-23020][core] Fix races in launcher code, test.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20223 **[Test build #85929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85929/testReport)** for PR 20223 at commit

[GitHub] spark issue #20210: [SPARK-23009][PYTHON] Fix for non-str col names to creat...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20210 D'oh. I really did this with the script by `branch-2.3` but I don't know what happened .. Will manually push it. Thanks. ---

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

Github user maropu commented on the issue: https://github.com/apache/spark/pull/19330 Aha, I think we can't touch the stable interface (`MapType`) until the next release (v3.0). So, I think we need to hold this for a while. Or, we need to look for other approaches to fix this. ---

[GitHub] spark pull request #20218: [SPARK-23000] [TEST-HADOOP2.6] Fix Flaky test sui...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20218#discussion_r160838671 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala --- @@ -148,6 +148,7 @@ class

[GitHub] spark issue #20226: [SPARK-23034][Hive][UI] Display tablename for `HiveTable...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20226 **[Test build #85941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85941/testReport)** for PR 20226 at commit

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20214 **[Test build #85942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85942/testReport)** for PR 20214 at commit

[GitHub] spark pull request #20226: [SPARK-23034][Hive][UI] Display tablename for `Hi...

GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/20226 [SPARK-23034][Hive][UI] Display tablename for `HiveTableScan` node in UI ## What changes were proposed in this pull request? For queries which scan multiple tables, it will be

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user rednaxelafx commented on the issue: https://github.com/apache/spark/pull/20224 One comment as to using `ThreadLocal[Integer]` for keeping track of the IDs: I did have an alternative implementation of this PR that declares `WholeStageCodegenExec` as: ```scala case

[GitHub] spark pull request #20217: [SPARK-23026] [PySpark] Add RegisterUDF to PySpar...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20217#discussion_r160834039 --- Diff: python/pyspark/sql/catalog.py --- @@ -255,26 +255,67 @@ def registerFunction(self, name, f, returnType=StringType()): >>> _ =

[GitHub] spark issue #20225: [SPARK-23033] Don't use task level retry for continuous ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20225 **[Test build #85939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85939/testReport)** for PR 20225 at commit

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20224 **[Test build #85940 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85940/testReport)** for PR 20224 at commit

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user rednaxelafx commented on the issue: https://github.com/apache/spark/pull/20224 jenkins retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20216: [SPARK-23024][WEB-UI]Spark ui about the contents of the ...

Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/20216 Since this is a UI change can you post screenshots, and I'm not 100% convinced on the necessity of this when we already have jump links at the top of most pages. ---

[GitHub] spark pull request #20225: [SPARK-23033] Don't use task level retry for cont...

GitHub user jose-torres opened a pull request: https://github.com/apache/spark/pull/20225 [SPARK-23033] Don't use task level retry for continuous processing ## What changes were proposed in this pull request? Continuous processing tasks will fail on any attempt number

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20224 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85938/ Test FAILed. ---

[GitHub] spark issue #20224: [SPARK-23032][SQL] Add a per-query codegenStageId to Who...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20224 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20224: [SPARK-23032][SQL] Add a per-query codegenStageId...

GitHub user rednaxelafx opened a pull request: https://github.com/apache/spark/pull/20224 [SPARK-23032][SQL] Add a per-query codegenStageId to WholeStageCodegenExec ## What changes were proposed in this pull request? **Proposal** Add a per-query ID to the codegen

[GitHub] spark issue #20189: [SPARK-22975] MetricsReporter should not throw exception...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/20189 Could you update the PR title to include the component such as `[SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported`? ---

[GitHub] spark pull request #20189: [SPARK-22975] MetricsReporter should not throw ex...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/20189#discussion_r160829638 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MetricsReporter.scala --- @@ -39,14 +35,18 @@ class MetricsReporter(

[GitHub] spark pull request #20189: [SPARK-22975] MetricsReporter should not throw ex...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/20189#discussion_r160829808 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -424,6 +424,31 @@ class StreamingQuerySuite extends

[GitHub] spark pull request #20189: [SPARK-22975] MetricsReporter should not throw ex...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/20189#discussion_r160829544 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MetricsReporter.scala --- @@ -39,14 +35,18 @@ class MetricsReporter(

[GitHub] spark pull request #20189: [SPARK-22975] MetricsReporter should not throw ex...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/20189#discussion_r160829605 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MetricsReporter.scala --- @@ -39,14 +35,18 @@ class MetricsReporter(

[GitHub] spark pull request #20189: [SPARK-22975] MetricsReporter should not throw ex...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/20189#discussion_r160829571 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MetricsReporter.scala --- @@ -39,14 +35,18 @@ class MetricsReporter(

[GitHub] spark pull request #20211: [SPARK-23011][PYTHON][SQL] Prepend missing groupi...

Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/20211#discussion_r160829658 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -457,13 +458,26 @@ class RelationalGroupedDataset

[GitHub] spark issue #20223: [SPARK-23020][core] Fix races in launcher code, test.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20223 **[Test build #85937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85937/testReport)** for PR 20223 at commit

[GitHub] spark issue #20206: [SPARK-19256][SQL] Remove ordering enforcement from `Fil...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20206 **[Test build #85936 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85936/testReport)** for PR 20206 at commit

[GitHub] spark issue #20163: [SPARK-22966][PySpark] Spark SQL should handle Python UD...

Github user rednaxelafx commented on the issue: https://github.com/apache/spark/pull/20163 Given the above discussion, do we have consensus on all of the following: - Update the documentation for PySpark UDFs to warn about the behavior of mismatched declared `returnType` vs actual

[GitHub] spark issue #20222: [SPARK-23028] Bump master branch version to 2.4.0-SNAPSH...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20222 **[Test build #85935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85935/testReport)** for PR 20222 at commit

[GitHub] spark issue #20096: [SPARK-22908] Add kafka source and sink for continuous p...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20096 **[Test build #85934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85934/testReport)** for PR 20096 at commit

[GitHub] spark issue #20096: [SPARK-22908] Add kafka source and sink for continuous p...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/20096 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20222: [SPARK-23028] Bump master branch version to 2.4.0-SNAPSH...

Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/20222 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20211: [SPARK-23011][PYTHON][SQL] Prepend missing groupi...

Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/20211#discussion_r160826435 --- Diff: python/pyspark/sql/group.py --- @@ -233,6 +233,27 @@ def apply(self, udf): | 2| 1.1094003924504583|

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20214 **[Test build #85933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85933/testReport)** for PR 20214 at commit

[GitHub] spark issue #20214: [SPARK-23023][SQL] Cast field data to strings in showStr...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/20214 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85932/testReport)** for PR 19872 at commit

[GitHub] spark pull request #20204: [SPARK-7721][PYTHON][TESTS] Adds PySpark coverage...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/20204#discussion_r160821469 --- Diff: python/test_coverage/sitecustomize.py --- @@ -0,0 +1,19 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/19872 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85928/ Test FAILed. ---

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85928 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85928/testReport)** for PR 19872 at commit

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20174 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85930/ Test FAILed. ---

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20174 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20174 **[Test build #85930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85930/testReport)** for PR 20174 at commit

[GitHub] spark pull request #20151: [SPARK-22959][PYTHON] Configuration to select the...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20151#discussion_r160817581 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -34,17 +34,39 @@ private[spark] class

[GitHub] spark pull request #20218: [SPARK-23000] [TEST-HADOOP2.6] Fix Flaky test sui...

Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/20218#discussion_r160816667 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala --- @@ -148,6 +148,7 @@ class

[GitHub] spark pull request #20174: [SPARK-22951][SQL] fix aggregation after dropDupl...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20174 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user liancheng commented on the issue: https://github.com/apache/spark/pull/20174 LGTM, merging to master and branch-2.3. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20222: [SPARK-23028] Bump master branch version to 2.4.0-SNAPSH...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/20222 argh. i'll bump the job timeout now. On Wed, Jan 10, 2018 at 12:19 PM, UCB AMPLab wrote: > Test FAILed. > Refer to this link for build results

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20174 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85927/ Test PASSed. ---

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20174 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20174: [SPARK-22951][SQL] fix aggregation after dropDuplicates ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20174 **[Test build #85927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85927/testReport)** for PR 20174 at commit

<    1   2   3   4   5   >