[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-02 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-653085638


   **[Test build #124917 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124917/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-02 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-653086750


   **[Test build #124917 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124917/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).
* This patch **fails build dependency tests**.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
 * `public final class MapOutputCommitMessage `
 * `class ExecutorResourceRequest(`
 * `class ExecutorResourceRequests() extends Serializable `
 * `class ResourceProfileBuilder() `
 * `class TaskResourceRequest(val resourceName: String, val amount: Double)`
 * `class TaskResourceRequests() extends Serializable `
 * `sealed trait LogisticRegressionSummary extends ClassificationSummary `
 * `sealed trait RandomForestClassificationSummary extends 
ClassificationSummary `
 * `class _ClassificationSummary(JavaWrapper):`
 * `class _TrainingSummary(JavaWrapper):`
 * `class _BinaryClassificationSummary(_ClassificationSummary):`
 * `class LinearSVCModel(_JavaClassificationModel, _LinearSVCParams, 
JavaMLWritable, JavaMLReadable,`
 * `class LinearSVCSummary(_BinaryClassificationSummary):`
 * `class LinearSVCTrainingSummary(LinearSVCSummary, _TrainingSummary):`
 * `class LogisticRegressionSummary(_ClassificationSummary):`
 * `class LogisticRegressionTrainingSummary(LogisticRegressionSummary, 
_TrainingSummary):`
 * `class BinaryLogisticRegressionSummary(_BinaryClassificationSummary,`
 * `class RandomForestClassificationSummary(_ClassificationSummary):`
 * `class 
RandomForestClassificationTrainingSummary(RandomForestClassificationSummary,`
 * `class 
BinaryRandomForestClassificationSummary(_BinaryClassificationSummary):`
 * `class 
BinaryRandomForestClassificationTrainingSummary(BinaryRandomForestClassificationSummary,`
 * `trait TimestampFormatterHelper extends TimeZoneAwareExpression `
 * `case class Hour(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Minute(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Second(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `trait GetDateField extends UnaryExpression with ImplicitCastInputTypes 
with NullIntolerant `
 * `case class DayOfYear(child: Expression) extends GetDateField `
 * `case class Year(child: Expression) extends GetDateField `
 * `case class YearOfWeek(child: Expression) extends GetDateField `
 * `case class Quarter(child: Expression) extends GetDateField `
 * `case class Month(child: Expression) extends GetDateField `
 * `case class DayOfMonth(child: Expression) extends GetDateField `
 * `case class DayOfWeek(child: Expression) extends GetDateField `
 * `case class WeekDay(child: Expression) extends GetDateField `
 * `case class WeekOfYear(child: Expression) extends GetDateField `
 * `case class CheckOverflowInSum(`
 * `case class WidthBucket(`
 * `trait PredicateHelper extends Logging `
 * `sealed abstract class MergeAction extends Expression with Unevaluable `
 * `case class DeleteAction(condition: Option[Expression]) extends 
MergeAction`
 * `  case class TimeFormatters(date: DateFormatter, timestamp: 
TimestampFormatter)`
 * `case class CoalesceBucketsInSortMergeJoin(conf: SQLConf) extends 
Rule[SparkPlan] `
 * `case class ProcessingTimeTrigger(intervalMs: Long) extends Trigger `
 * `case class ContinuousTrigger(intervalMs: Long) extends Trigger `
 * `class StateStoreConf(`



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-652718078


   **[Test build #124818 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124818/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).
* This patch **fails Spark unit tests**.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
 * `public final class MapOutputCommitMessage `
 * `class ExecutorResourceRequest(`
 * `class ExecutorResourceRequests() extends Serializable `
 * `class ResourceProfileBuilder() `
 * `class TaskResourceRequest(val resourceName: String, val amount: Double)`
 * `class TaskResourceRequests() extends Serializable `
 * `sealed trait LogisticRegressionSummary extends ClassificationSummary `
 * `sealed trait RandomForestClassificationSummary extends 
ClassificationSummary `
 * `class _ClassificationSummary(JavaWrapper):`
 * `class _TrainingSummary(JavaWrapper):`
 * `class _BinaryClassificationSummary(_ClassificationSummary):`
 * `class LinearSVCModel(_JavaClassificationModel, _LinearSVCParams, 
JavaMLWritable, JavaMLReadable,`
 * `class LinearSVCSummary(_BinaryClassificationSummary):`
 * `class LinearSVCTrainingSummary(LinearSVCSummary, _TrainingSummary):`
 * `class LogisticRegressionSummary(_ClassificationSummary):`
 * `class LogisticRegressionTrainingSummary(LogisticRegressionSummary, 
_TrainingSummary):`
 * `class BinaryLogisticRegressionSummary(_BinaryClassificationSummary,`
 * `class RandomForestClassificationSummary(_ClassificationSummary):`
 * `class 
RandomForestClassificationTrainingSummary(RandomForestClassificationSummary,`
 * `class 
BinaryRandomForestClassificationSummary(_BinaryClassificationSummary):`
 * `class 
BinaryRandomForestClassificationTrainingSummary(BinaryRandomForestClassificationSummary,`
 * `trait TimestampFormatterHelper extends TimeZoneAwareExpression `
 * `case class Hour(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Minute(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Second(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `trait GetDateField extends UnaryExpression with ImplicitCastInputTypes 
with NullIntolerant `
 * `case class DayOfYear(child: Expression) extends GetDateField `
 * `case class Year(child: Expression) extends GetDateField `
 * `case class YearOfWeek(child: Expression) extends GetDateField `
 * `case class Quarter(child: Expression) extends GetDateField `
 * `case class Month(child: Expression) extends GetDateField `
 * `case class DayOfMonth(child: Expression) extends GetDateField `
 * `case class DayOfWeek(child: Expression) extends GetDateField `
 * `case class WeekDay(child: Expression) extends GetDateField `
 * `case class WeekOfYear(child: Expression) extends GetDateField `
 * `case class CheckOverflowInSum(`
 * `case class WidthBucket(`
 * `trait PredicateHelper extends Logging `
 * `sealed abstract class MergeAction extends Expression with Unevaluable `
 * `case class DeleteAction(condition: Option[Expression]) extends 
MergeAction`
 * `  case class TimeFormatters(date: DateFormatter, timestamp: 
TimestampFormatter)`
 * `case class CoalesceBucketsInSortMergeJoin(conf: SQLConf) extends 
Rule[SparkPlan] `
 * `case class ProcessingTimeTrigger(intervalMs: Long) extends Trigger `
 * `case class ContinuousTrigger(intervalMs: Long) extends Trigger `
 * `class StateStoreConf(`



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-652652767


   **[Test build #124818 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124818/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-652571016


   **[Test build #124788 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124788/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).
* This patch **fails Spark unit tests**.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
 * `public final class MapOutputCommitMessage `
 * `class ExecutorResourceRequest(`
 * `class ExecutorResourceRequests() extends Serializable `
 * `class ResourceProfileBuilder() `
 * `class TaskResourceRequest(val resourceName: String, val amount: Double)`
 * `class TaskResourceRequests() extends Serializable `
 * `sealed trait LogisticRegressionSummary extends ClassificationSummary `
 * `sealed trait RandomForestClassificationSummary extends 
ClassificationSummary `
 * `class _ClassificationSummary(JavaWrapper):`
 * `class _TrainingSummary(JavaWrapper):`
 * `class _BinaryClassificationSummary(_ClassificationSummary):`
 * `class LinearSVCModel(_JavaClassificationModel, _LinearSVCParams, 
JavaMLWritable, JavaMLReadable,`
 * `class LinearSVCSummary(_BinaryClassificationSummary):`
 * `class LinearSVCTrainingSummary(LinearSVCSummary, _TrainingSummary):`
 * `class LogisticRegressionSummary(_ClassificationSummary):`
 * `class LogisticRegressionTrainingSummary(LogisticRegressionSummary, 
_TrainingSummary):`
 * `class BinaryLogisticRegressionSummary(_BinaryClassificationSummary,`
 * `class RandomForestClassificationSummary(_ClassificationSummary):`
 * `class 
RandomForestClassificationTrainingSummary(RandomForestClassificationSummary,`
 * `class 
BinaryRandomForestClassificationSummary(_BinaryClassificationSummary):`
 * `class 
BinaryRandomForestClassificationTrainingSummary(BinaryRandomForestClassificationSummary,`
 * `trait TimestampFormatterHelper extends TimeZoneAwareExpression `
 * `case class Hour(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Minute(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `case class Second(child: Expression, timeZoneId: Option[String] = None) 
extends GetTimeField `
 * `trait GetDateField extends UnaryExpression with ImplicitCastInputTypes 
with NullIntolerant `
 * `case class DayOfYear(child: Expression) extends GetDateField `
 * `case class Year(child: Expression) extends GetDateField `
 * `case class YearOfWeek(child: Expression) extends GetDateField `
 * `case class Quarter(child: Expression) extends GetDateField `
 * `case class Month(child: Expression) extends GetDateField `
 * `case class DayOfMonth(child: Expression) extends GetDateField `
 * `case class DayOfWeek(child: Expression) extends GetDateField `
 * `case class WeekDay(child: Expression) extends GetDateField `
 * `case class WeekOfYear(child: Expression) extends GetDateField `
 * `case class CheckOverflowInSum(`
 * `case class WidthBucket(`
 * `trait PredicateHelper extends Logging `
 * `sealed abstract class MergeAction extends Expression with Unevaluable `
 * `case class DeleteAction(condition: Option[Expression]) extends 
MergeAction`
 * `  case class TimeFormatters(date: DateFormatter, timestamp: 
TimestampFormatter)`
 * `case class CoalesceBucketsInSortMergeJoin(conf: SQLConf) extends 
Rule[SparkPlan] `
 * `case class ProcessingTimeTrigger(intervalMs: Long) extends Trigger `
 * `case class ContinuousTrigger(intervalMs: Long) extends Trigger `
 * `class StateStoreConf(`



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-07-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-652453885


   **[Test build #124788 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124788/testReport)**
 for PR 27928 at commit 
[`e21d97d`](https://github.com/apache/spark/commit/e21d97dfbbfa1bf485b0b54b61069a7d5d9f76b5).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-06-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-637155938


   **[Test build #123391 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123391/testReport)**
 for PR 27928 at commit 
[`bae2c0c`](https://github.com/apache/spark/commit/bae2c0ce513b6fe9ae24a751c334f16bdf8ee74a).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-06-01 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-637033685


   **[Test build #123391 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123391/testReport)**
 for PR 27928 at commit 
[`bae2c0c`](https://github.com/apache/spark/commit/bae2c0ce513b6fe9ae24a751c334f16bdf8ee74a).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-05-04 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-623622981


   **[Test build #122267 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122267/testReport)**
 for PR 27928 at commit 
[`7df0040`](https://github.com/apache/spark/commit/7df0040691dd860582db9ce0ccf9211efb2af5ba).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
 * `class AuthRpcHandler extends AbstractAuthRpcHandler `
 * `public class SaslRpcHandler extends AbstractAuthRpcHandler `
 * `public abstract class AbstractAuthRpcHandler extends RpcHandler `
 * `class AbortableRpcFuture[T: ClassTag](val future: Future[T], onAbort: 
Throwable => Unit) `
 * `public class JavaFValueTestExample `
 * `class AvroDeserializer(rootAvroType: Schema, rootCatalystType: 
DataType, rebaseDateTime: Boolean) `
 * `class AvroSerializer(`
 * `class ExecutorResourceRequest(object):`
 * `class ExecutorResourceRequests(object):`
 * `class ResourceProfile(object):`
 * `class ResourceProfileBuilder(object):`
 * `class TaskResourceRequest(object):`
 * `class TaskResourceRequests(object):`
 * `case class AggregateWithHaving(`
 * `abstract class CurrentTimestampLike() extends LeafExpression with 
CodegenFallback `
 * `case class CurrentTimestamp() extends CurrentTimestampLike `
 * `case class Now() extends CurrentTimestampLike `
 * `case class YearOfWeek(child: Expression) extends UnaryExpression with 
ImplicitCastInputTypes `
 * `case class DatetimeSub(`
 * `case class DateAddInterval(`
 * `case class Extract(field: Expression, source: Expression, child: 
Expression)`
 * `case class Rand(child: Expression, hideSeed: Boolean = false)`
 * `case class Randn(child: Expression, hideSeed: Boolean = false)`
 * `class CacheManager extends Logging with AdaptiveSparkPlanHelper `
 * `case class AdaptiveExecutionContext(session: SparkSession, qe: 
QueryExecution) `
 * `class ParquetReadSupport(`



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-05-04 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-623477853


   **[Test build #122267 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122267/testReport)**
 for PR 27928 at commit 
[`7df0040`](https://github.com/apache/spark/commit/7df0040691dd860582db9ce0ccf9211efb2af5ba).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-05-04 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-623294824


   **[Test build #122250 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122250/testReport)**
 for PR 27928 at commit 
[`9704c60`](https://github.com/apache/spark/commit/9704c606983a4cf6bdd5bec41be8208fb5db63bc).
* This patch **fails due to an unknown error code, -9**.
* This patch merges cleanly.
* This patch adds the following public classes _(experimental)_:
 * `public class JavaUserDefinedScalar `
 * `public class SparkAvroKeyOutputFormat extends 
AvroKeyOutputFormat `
 * `  static class SparkRecordWriterFactory extends 
RecordWriterFactory `
 * `  class FMClassifierWrapperWriter(instance: FMClassifierWrapper) 
extends MLWriter `
 * `  class FMClassifierWrapperReader extends MLReader[FMClassifierWrapper] 
`
 * `  class FMRegressorWrapperWriter(instance: FMRegressorWrapper) extends 
MLWriter `
 * `  class FMRegressorWrapperReader extends MLReader[FMRegressorWrapper] `
 * `  class LinearRegressionWrapperWriter(instance: 
LinearRegressionWrapper) extends MLWriter `
 * `  class LinearRegressionWrapperReader extends 
MLReader[LinearRegressionWrapper] `
 * `case class LengthOfJsonArray(child: Expression) extends UnaryExpression`
 * `case class JsonObjectKeys(child: Expression) extends UnaryExpression 
with CodegenFallback`
 * `case class ShowViews(`
 * `case class ShowViewsCommand(`
 * `  class JDBCConfiguration(`



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] [spark] SparkQA commented on pull request #27928: [SPARK-31167][BUILD] Refactor how we track Python test/build dependencies

2020-05-04 Thread GitBox


SparkQA commented on pull request #27928:
URL: https://github.com/apache/spark/pull/27928#issuecomment-623285658


   **[Test build #122250 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122250/testReport)**
 for PR 27928 at commit 
[`9704c60`](https://github.com/apache/spark/commit/9704c606983a4cf6bdd5bec41be8208fb5db63bc).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org