[GitHub] [spark] AmplabJenkins commented on issue #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs.
AmplabJenkins commented on issue #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs. URL: https://github.com/apache/spark/pull/26353#issuecomment-548687376 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17996/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs.
AmplabJenkins commented on issue #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs. URL: https://github.com/apache/spark/pull/26353#issuecomment-548687372 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] shahidki31 opened a new pull request #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs.
shahidki31 opened a new pull request #26353: [SPARK-29590][WEBUI]JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs. URL: https://github.com/apache/spark/pull/26353 ### What changes were proposed in this pull request? Currently, JDBC/ODBC tab in the WEBUI doesn't support hiding table. Other tabs in the web ui like, Jobs, stages, SQL etc supports hiding table (refer https://github.com/apache/spark/pull/22592). In this PR, added the support for hide table in the jdbc/odbc tab also. ### Why are the changes needed? Spark ui about the contents of the form need to have hidden and show features, when the table records very much. Because sometimes you do not care about the record of the table, you just want to see the contents of the next table, but you have to scroll the scroll bar for a long time to see the contents of the next table. ### Does this PR introduce any user-facing change? No, except support of hide table ### How was this patch tested? Manually tested   This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548685618 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548685624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113072/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548685618 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548685624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113072/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
SparkQA removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548672130 **[Test build #113072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113072/testReport)** for PR 26322 at commit [`11dbab4`](https://github.com/apache/spark/commit/11dbab46e0c0866307d15376d670ebde9b4fc1df). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
SparkQA commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548685415 **[Test build #113072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113072/testReport)** for PR 26322 at commit [`11dbab4`](https://github.com/apache/spark/commit/11dbab46e0c0866307d15376d670ebde9b4fc1df). * This patch passes all tests. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class _RobustScalerParams(HasInputCol, HasOutputCol, HasRelativeError):` * `class _VectorIndexerParams(HasInputCol, HasOutputCol, HasHandleInvalid):` * `class _ALSParams(_ALSModelParams, HasMaxIter, HasRegParam, HasCheckpointInterval, HasSeed):` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mob-ai commented on a change in pull request #26124: [SPARK-29224][ML]Implement Factorization Machines as a ml-pipeline component
mob-ai commented on a change in pull request #26124: [SPARK-29224][ML]Implement
Factorization Machines as a ml-pipeline component
URL: https://github.com/apache/spark/pull/26124#discussion_r341465703
##
File path:
mllib/src/main/scala/org/apache/spark/ml/classification/FMClassifier.scala
##
@@ -0,0 +1,360 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.ml.classification
+
+import org.apache.hadoop.fs.Path
+
+import org.apache.spark.annotation.Since
+import org.apache.spark.internal.Logging
+import org.apache.spark.ml.linalg._
+import org.apache.spark.ml.param._
+import org.apache.spark.ml.regression._
+import org.apache.spark.ml.util._
+import org.apache.spark.ml.util.Instrumentation.instrumented
+import org.apache.spark.mllib.linalg.{Vector => OldVector}
+import org.apache.spark.mllib.linalg.VectorImplicits._
+import org.apache.spark.mllib.optimization.GradientDescent
+import org.apache.spark.mllib.regression.{LabeledPoint => OldLabeledPoint}
+import org.apache.spark.rdd.RDD
+import org.apache.spark.sql.{Dataset, Row}
+import org.apache.spark.sql.functions.col
+import org.apache.spark.storage.StorageLevel
+
+/**
+ * Params for FMClassifier.
+ */
+private[classification] trait FMClassifierParams extends
ProbabilisticClassifierParams
+ with FactorizationMachinesParams {
+}
+
+/**
+ * Factorization Machines learning algorithm for classification.
+ * It supports normal gradient descent and AdamW solver.
+ *
+ * The implementation is based upon:
+ * https://www.csie.ntu.edu.tw/~b97053/paper/Rendle2010FM.pdf";>
+ * S. Rendle. "Factorization machines" 2010.
+ *
+ * FM is able to estimate interactions even in problems with huge sparsity
+ * (like advertising and recommendation system).
+ * FM formula is:
+ * {{{
+ * y = w_0 + \sum\limits^n_{i-1} w_i x_i +
+ * \sum\limits^n_{i=1} \sum\limits^n_{j=i+1} \langle v_i, v_j \rangle x_i
x_j
+ * }}}
+ * First two terms denote global bias and linear term (as same as linear
regression),
+ * and last term denotes pairwise interactions term. {{{v_i}}} describes the
i-th variable
+ * with k factors.
+ *
+ * FM classification model uses logistic loss which can be solved by gradient
descent method, and
+ * regularization terms like L2 are usually added to the loss function to
prevent overfitting.
+ *
+ * @note Multiclass labels are not currently supported.
+ */
+@Since("3.0.0")
+class FMClassifier @Since("3.0.0") (
+ @Since("3.0.0") override val uid: String)
+ extends ProbabilisticClassifier[Vector, FMClassifier, FMClassifierModel]
+ with FMClassifierParams with DefaultParamsWritable with Logging {
+
+ import
org.apache.spark.ml.regression.BaseFactorizationMachinesGradient.{LogisticLoss,
parseLoss}
+ import org.apache.spark.ml.regression.FMRegressor.initCoefficients
+
+ @Since("3.0.0")
+ def this() = this(Identifiable.randomUID("fmc"))
+
+ /**
+ * Set the dimensionality of the factors.
+ * Default is 8.
+ *
+ * @group setParam
+ */
+ @Since("3.0.0")
+ def setNumFactors(value: Int): this.type = set(numFactors, value)
+ setDefault(numFactors -> 8)
+
+ /**
+ * Set whether to fit global bias term.
+ * Default is true.
+ *
+ * @group setParam
+ */
+ @Since("3.0.0")
+ def setFitBias(value: Boolean): this.type = set(fitBias, value)
+ setDefault(fitBias -> true)
+
+ /**
+ * Set whether to fit linear term.
+ * Default is true.
+ *
+ * @group setParam
+ */
+ @Since("3.0.0")
+ def setFitLinear(value: Boolean): this.type = set(fitLinear, value)
+ setDefault(fitLinear -> true)
+
+ /**
+ * Set the L2 regularization parameter.
+ * Default is 0.0.
+ *
+ * @group setParam
+ */
+ @Since("3.0.0")
+ def setRegParam(value: Double): this.type = set(regParam, value)
+ setDefault(regParam -> 0.0)
+
+ /**
+ * Set the mini-batch fraction parameter.
+ * Default is 1.0.
+ *
+ * @group setParam
+ */
+ @Since("3.0.0")
+ def setMiniBatchFraction(value: Double): this.type = {
+require(value > 0 && value <= 1.0,
+ s"Fraction for mini-batch SGD must be in range (0, 1] but got $value")
+set(miniBatchFraction, value)
+ }
+ setDefault(miniBatchFraction -> 1.0)
+
+ /**
+ * Set the standard deviati
[GitHub] [spark] cloud-fan commented on a change in pull request #26338: [SPARK-29680][SQL] ALTER TABLE CHANGE COLUMN should look up catalog/table like v2 commands
cloud-fan commented on a change in pull request #26338: [SPARK-29680][SQL] ALTER TABLE CHANGE COLUMN should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26338#discussion_r341465698 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -151,7 +151,7 @@ statement | ALTER TABLE multipartIdentifier (ALTER | CHANGE) COLUMN? qualifiedName (TYPE dataType)? (COMMENT comment=STRING)? colPosition? #alterTableColumn -| ALTER TABLE tableIdentifier partitionSpec? +| ALTER TABLE multipartIdentifier partitionSpec? Review comment: The v2 rule ``` (ALTER | CHANGE) COLUMN? qualifiedName (TYPE dataType)? (COMMENT comment=STRING)? ``` The `colType` ``` colName=errorCapturingIdentifier dataType (COMMENT STRING)? ``` Seems like the v1 rule is more powerful and can rename a column and change data type together. If other DBs support it as well, maybe Spark should also support it. Otherwise, maybe 3.0 is a good time to drop this syntax. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] JkSelf commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage
JkSelf commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage URL: https://github.com/apache/spark/pull/26309#issuecomment-548684063 @cloud-fan please help retest again. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on issue #26285: [SPARK-29623][SQL] do not allow multiple unit TO unit statements in interval literal syntax
cloud-fan commented on issue #26285: [SPARK-29623][SQL] do not allow multiple unit TO unit statements in interval literal syntax URL: https://github.com/apache/spark/pull/26285#issuecomment-548684091 I believe the Spark R failure is not related. Any more comments before merging it? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
AmplabJenkins removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548681786 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113064/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
AmplabJenkins removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548681783 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
AmplabJenkins commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548681783 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
AmplabJenkins commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548681786 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113064/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
SparkQA commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548681456 **[Test build #113064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113064/testReport)** for PR 26108 at commit [`7213d42`](https://github.com/apache/spark/commit/7213d4266b7bfa2bd05225c68e2184a7abb24469). * This patch passes all tests. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * ` /** Helper class for representing data (value, matched). */` * ` case class ValueAndMatchPair(value: UnsafeRow, matched: Boolean)` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows
SparkQA removed a comment on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-548642910 **[Test build #113064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113064/testReport)** for PR 26108 at commit [`7213d42`](https://github.com/apache/spark/commit/7213d4266b7bfa2bd05225c68e2184a7abb24469). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands
AmplabJenkins removed a comment on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26303#issuecomment-548681105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17995/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands
AmplabJenkins commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26303#issuecomment-548681103 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands
AmplabJenkins removed a comment on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26303#issuecomment-548681103 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands
AmplabJenkins commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26303#issuecomment-548681105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17995/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands
SparkQA commented on issue #26303: [SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26303#issuecomment-548680833 **[Test build #113076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113076/testReport)** for PR 26303 at commit [`07dbe47`](https://github.com/apache/spark/commit/07dbe479acb2fd710627f91da78960141fedfd20). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
AmplabJenkins removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679702 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113075/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
SparkQA removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679341 **[Test build #113075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113075/testReport)** for PR 25287 at commit [`a5148f0`](https://github.com/apache/spark/commit/a5148f0fd967e3157d1cfdb856b3f89fd793f24b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
AmplabJenkins removed a comment on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679699 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
AmplabJenkins commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548679564 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
SparkQA commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679690 **[Test build #113075 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113075/testReport)** for PR 25287 at commit [`a5148f0`](https://github.com/apache/spark/commit/a5148f0fd967e3157d1cfdb856b3f89fd793f24b). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `trait HasRelativeError extends Params ` * `class _ImputerParams(HasInputCol, HasInputCols, HasOutputCol, HasOutputCols, HasRelativeError):` * `class _RobustScalerParams(HasInputCol, HasOutputCol, HasRelativeError):` * `class HasRelativeError(Params):` * `case class AlterTableRenamePartitionStatement(` * `case class ShowColumnsStatement(` * `case class DataSourceV2ScanRelation(` * `case class OptimizeLocalShuffleReader(conf: SQLConf) extends Rule[SparkPlan] ` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
AmplabJenkins removed a comment on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548679569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17994/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
AmplabJenkins commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679702 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113075/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
AmplabJenkins commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679699 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
AmplabJenkins removed a comment on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548679564 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
AmplabJenkins commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548679569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17994/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
SparkQA commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548679340 **[Test build #113074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113074/testReport)** for PR 26325 at commit [`e17dc68`](https://github.com/apache/spark/commit/e17dc687cb78f4735e2d27160416738dea600663). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix
SparkQA commented on issue #25287: [SPARK-28552][SQL]Identification of different dialects insensitive to case by JDBC URL prefix URL: https://github.com/apache/spark/pull/25287#issuecomment-548679341 **[Test build #113075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113075/testReport)** for PR 25287 at commit [`a5148f0`](https://github.com/apache/spark/commit/a5148f0fd967e3157d1cfdb856b3f89fd793f24b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] yaooqinn commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values
yaooqinn commented on issue #26325: [SPARK-29663][SQL] Support sum with interval type values URL: https://github.com/apache/spark/pull/26325#issuecomment-548678081 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] yaooqinn commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values
yaooqinn commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548677324 cc @cloud-fan @wangyum @gatorsmile This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values
AmplabJenkins removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548676933 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values
AmplabJenkins removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548676936 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113058/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values
AmplabJenkins commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548676933 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values
AmplabJenkins commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548676936 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113058/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values
SparkQA commented on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548676563 **[Test build #113058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113058/testReport)** for PR 26347 at commit [`91792ea`](https://github.com/apache/spark/commit/91792ea7a60b4dcb642e36293085b706c9423a1a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values
SparkQA removed a comment on issue #26347: [SPARK-29688][SQL] Support average for interval type values URL: https://github.com/apache/spark/pull/26347#issuecomment-548637033 **[Test build #113058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113058/testReport)** for PR 26347 at commit [`91792ea`](https://github.com/apache/spark/commit/91792ea7a60b4dcb642e36293085b706c9423a1a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548676248 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548676253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113060/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548676248 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548676253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113060/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548638445 **[Test build #113060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113060/testReport)** for PR 26274 at commit [`c6c16a4`](https://github.com/apache/spark/commit/c6c16a469268b180175961c13c5f7c88ec54a9bf). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)
SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-548675947 **[Test build #113060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113060/testReport)** for PR 26274 at commit [`c6c16a4`](https://github.com/apache/spark/commit/c6c16a469268b180175961c13c5f7c88ec54a9bf). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AngersZhuuuu commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation.
AngersZh commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25028#issuecomment-548675869 > Another test query: > > ``` > SELECT TRANSFORM(key, abs(key)) > USING 'cat' > FROM (SELECT DISTINCT key FROM src); > ``` > > The physical plan looks different with this PR applied. in particular, HashAggregate gets another output column, while it should be just one: > > `HashAggregate(keys=[key#18], functions=[], output=[key#18, **another_output**]) ` Since we can solve every thing with path a `Seq(UnresolvedStar(None))` to` ScriptTrasnform` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548675086 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17993/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548675086 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17993/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548675084 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548675084 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548674854 **[Test build #113073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113073/testReport)** for PR 26134 at commit [`2f90189`](https://github.com/apache/spark/commit/2f901894eb24d7deec31947708b9afdaae2a4866). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548673979 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113066/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548673976 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
SparkQA removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548653334 **[Test build #113066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113066/testReport)** for PR 24898 at commit [`f72a38d`](https://github.com/apache/spark/commit/f72a38d189e053baef21c7aa0e673268a61e7cb6). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548673979 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113066/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548673976 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-548673824 **[Test build #113066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113066/testReport)** for PR 24898 at commit [`f72a38d`](https://github.com/apache/spark/commit/f72a38d189e053baef21c7aa0e673268a61e7cb6). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
SparkQA commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548672130 **[Test build #113072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113072/testReport)** for PR 26322 at commit [`11dbab4`](https://github.com/apache/spark/commit/11dbab46e0c0866307d15376d670ebde9b4fc1df). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548671169 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17992/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548671165 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins removed a comment on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548671165 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql
AmplabJenkins commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql URL: https://github.com/apache/spark/pull/26352#issuecomment-548671122 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth
AmplabJenkins commented on issue #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#issuecomment-548671169 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17992/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql
AmplabJenkins removed a comment on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql URL: https://github.com/apache/spark/pull/26352#issuecomment-548671122 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql
AmplabJenkins commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql URL: https://github.com/apache/spark/pull/26352#issuecomment-548671125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17991/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql
AmplabJenkins removed a comment on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql URL: https://github.com/apache/spark/pull/26352#issuecomment-548671125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17991/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql
SparkQA commented on issue #26352: [WIP][SPARK-29696][SQL][TESTS] Port groupingsets.sql URL: https://github.com/apache/spark/pull/26352#issuecomment-548670945 **[Test build #113071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113071/testReport)** for PR 26352 at commit [`94b7e79`](https://github.com/apache/spark/commit/94b7e79a97ab303fb227dd2f256990efd3c93849). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
AmplabJenkins commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548668927 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
AmplabJenkins commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548668929 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113057/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
AmplabJenkins removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548668929 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113057/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
AmplabJenkins removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548668927 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
SparkQA removed a comment on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548629778 **[Test build #113057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113057/testReport)** for PR 26167 at commit [`65fc525`](https://github.com/apache/spark/commit/65fc525ab5e2556781fb6887e341cea046505ea6). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan
SparkQA commented on issue #26167: [SPARK-28893][SQL] Support MERGE INTO in the parser and add the corresponding logical plan URL: https://github.com/apache/spark/pull/26167#issuecomment-548668653 **[Test build #113057 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113057/testReport)** for PR 26167 at commit [`65fc525`](https://github.com/apache/spark/commit/65fc525ab5e2556781fb6887e341cea046505ea6). * This patch passes all tests. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class MergeIntoStatement(` * `sealed abstract class MergeClause(condition: Option[Expression])` * `case class DeleteClause(deleteCondition: Option[Expression]) extends MergeClause(deleteCondition)` * `case class UpdateClause(updateCondition: Option[Expression],` * `case class InsertClause(insertCondition: Option[Expression],` * `case class MergeIntoTable(` * `sealed abstract class MergeAction(` * `case class DeleteAction(deleteCondition: Option[Expression]) extends MergeAction(deleteCondition)` * `case class UpdateAction(` * `case class InsertAction(` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation
dongjoon-hyun commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548668176 @mstill3 . Please update the PR to use `os.path.join(tempfile.mkdtemp(), 'data'` according to @HyukjinKwon 's advice. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #26266: [SPARK-29611][WEBUI] Sort Kafka metadata by the number of messages
dongjoon-hyun commented on issue #26266: [SPARK-29611][WEBUI] Sort Kafka metadata by the number of messages URL: https://github.com/apache/spark/pull/26266#issuecomment-548664464 I believe that the real production Spark streaming jobs against KAFKA clusters needs that option always. Given that conf, we need to confirm what value this PR can give. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #26266: [SPARK-29611][WEBUI] Sort Kafka metadata by the number of messages
dongjoon-hyun commented on issue #26266: [SPARK-29611][WEBUI] Sort Kafka metadata by the number of messages URL: https://github.com/apache/spark/pull/26266#issuecomment-548664258 Please don't forget https://github.com/apache/spark/pull/26266#discussion_r340225799 , @dengziming . This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #25932: [WIP][SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1
dongjoon-hyun commented on issue #25932: [WIP][SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-548663846 What do you mean? We are tracking here, SPARK-29250 . This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] alfozan commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation.
alfozan commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25028#issuecomment-548663422 Another test query: ``` SELECT TRANSFORM(key, abs(key)) USING 'cat' FROM (SELECT DISTINCT key FROM src); ``` The physical plan looks different with this PR applied. in particular, HashAggregate gets another output column, while it should be just one: `HashAggregate(keys=[key#18], functions=[], output=[key#18, **another_output**]) ` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
SparkQA commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548663478 **[Test build #113070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113070/testReport)** for PR 26331 at commit [`62974f8`](https://github.com/apache/spark/commit/62974f8a7170ae682ff7a5fcdf64134c971dc148). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548663134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113059/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548663131 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548663131 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548663134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113059/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548638442 **[Test build #113059 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113059/testReport)** for PR 26330 at commit [`0b37b71`](https://github.com/apache/spark/commit/0b37b71167c192f726600fecd4a29b33e928c245). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests
SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548662859 **[Test build #113059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113059/testReport)** for PR 26330 at commit [`0b37b71`](https://github.com/apache/spark/commit/0b37b71167c192f726600fecd4a29b33e928c245). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548662479 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548662482 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17990/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
AmplabJenkins commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548662482 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/17990/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
AmplabJenkins commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548662479 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
AmplabJenkins removed a comment on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548108840 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dbtsai commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable
dbtsai commented on issue #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331#issuecomment-548662201 Jenkins, test this please. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] uncleGen edited a comment on issue #26343: [SPARK-29683][YARN] Job will fail due to executor failures all available nodes are blacklisted
uncleGen edited a comment on issue #26343: [SPARK-29683][YARN] Job will fail due to executor failures all available nodes are blacklisted URL: https://github.com/apache/spark/pull/26343#issuecomment-548659551 @srowen Yes, the new added config is used to loosen condition of checking if all node blacklisted in some particular use cases in my description. It makes the check more soft not to lead to job fail directly, but not generalize. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548660857 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113061/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
AmplabJenkins removed a comment on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548660853 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds
SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-548660756 **[Test build #113061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113061/testReport)** for PR 26134 at commit [`2dd8e43`](https://github.com/apache/spark/commit/2dd8e432ed2183db052e8a3ffb4465af745c5e79). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
