[GitHub] [spark] AmplabJenkins removed a comment on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
AmplabJenkins removed a comment on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428#issuecomment-485226434 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428#issuecomment-485226500 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
AmplabJenkins removed a comment on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428#issuecomment-485226413 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428#issuecomment-485226434 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
AmplabJenkins commented on issue #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428#issuecomment-485226413 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] shivusondur opened a new pull request #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex"
shivusondur opened a new pull request #24428: [SPARK-27532][Doc] Correct the default value in the Documentation for "spark.redaction.regex" URL: https://github.com/apache/spark/pull/24428 ## What changes were proposed in this pull request? Corrected the default value in the Documentation for "spark.redaction.regex" ## How was this patch tested? NA This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] wangyum closed pull request #24422: [SPARK-27524][BUILD] Remove the parquet-provided support
wangyum closed pull request #24422: [SPARK-27524][BUILD] Remove the parquet-provided support URL: https://github.com/apache/spark/pull/24422 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] felixcheung commented on issue #24422: [SPARK-27524][BUILD] Remove the parquet-provided support
felixcheung commented on issue #24422: [SPARK-27524][BUILD] Remove the parquet-provided support URL: https://github.com/apache/spark/pull/24422#issuecomment-485209159 I don't know that's confusing? ML model is persisted in parquet format. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
AmplabJenkins commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485205879 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485205879 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485205887 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104780/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
AmplabJenkins commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485205887 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104780/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
SparkQA removed a comment on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178841 **[Test build #104780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104780/testReport)** for PR 24427 at commit [`88aab62`](https://github.com/apache/spark/commit/88aab6233eb69efcbd37c301c701d74c66bd707a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command.
SparkQA commented on issue #24427: [SPARK-27531] Improve `EXPLAIN DESC TABLE` to show the input parameters of the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485205622 **[Test build #104780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104780/testReport)** for PR 24427 at commit [`88aab62`](https://github.com/apache/spark/commit/88aab6233eb69efcbd37c301c701d74c66bd707a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485180127 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485180131 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104779/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485180131 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104779/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485180127 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151379 **[Test build #104779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104779/testReport)** for PR 24387 at commit [`71db855`](https://github.com/apache/spark/commit/71db855468691b18f9365f70ca376225fc046989). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485179774 **[Test build #104779 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104779/testReport)** for PR 24387 at commit [`71db855`](https://github.com/apache/spark/commit/71db855468691b18f9365f70ca376225fc046989). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10092/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
AmplabJenkins removed a comment on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178565 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
SparkQA commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178841 **[Test build #104780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104780/testReport)** for PR 24427 at commit [`88aab62`](https://github.com/apache/spark/commit/88aab6233eb69efcbd37c301c701d74c66bd707a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
AmplabJenkins commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178565 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
AmplabJenkins commented on issue #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427#issuecomment-485178571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10092/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dilipbiswal opened a new pull request #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command.
dilipbiswal opened a new pull request #24427: [SPARK-27531] Improve explain output of describe table command to show the inputs to the command. URL: https://github.com/apache/spark/pull/24427 ## What changes were proposed in this pull request? Currently "EXPLAIN DESC TABLE" is special cased and outputs a single row relation as following. This is not consistent with how we handle explain processing for other commands. Current output: ``` spark-sql> EXPLAIN DESCRIBE TABLE t1; == Physical Plan == *(1) Scan OneRowRelation[] ``` After change: ``` spark-sql> EXPLAIN DESC EXTENDED t == Physical Plan == Execute DescribeTableCommand +- DescribeTableCommand `t`, true ``` ## How was this patch tested? Added new tests in SQLQueryTestSuite. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485174179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104778/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485174176 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485174179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104778/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485174176 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485149116 **[Test build #104778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104778/testReport)** for PR 24387 at commit [`7d9bdb0`](https://github.com/apache/spark/commit/7d9bdb0700a5dd586904b9fcbddc37b3ca3681d3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485173869 **[Test build #104778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104778/testReport)** for PR 24387 at commit [`7d9bdb0`](https://github.com/apache/spark/commit/7d9bdb0700a5dd586904b9fcbddc37b3ca3681d3). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485171567 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485171569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104777/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485171567 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485171569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104777/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485171275 **[Test build #104777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104777/testReport)** for PR 24387 at commit [`600aa9a`](https://github.com/apache/spark/commit/600aa9a0122cb62ec3fa9b556c76a41f084cfa8d). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148134 **[Test build #104777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104777/testReport)** for PR 24387 at commit [`600aa9a`](https://github.com/apache/spark/commit/600aa9a0122cb62ec3fa9b556c76a41f084cfa8d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485161951 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104776/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485161951 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104776/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485161949 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485161949 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143639 **[Test build #104776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104776/testReport)** for PR 24425 at commit [`02a03ae`](https://github.com/apache/spark/commit/02a03aebe989f291357a651ab0cf0e4e660e071d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485161608 **[Test build #104776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104776/testReport)** for PR 24425 at commit [`02a03ae`](https://github.com/apache/spark/commit/02a03aebe989f291357a651ab0cf0e4e660e071d). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
AmplabJenkins removed a comment on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426#issuecomment-485151693 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426#issuecomment-485151856 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151736 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10091/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
AmplabJenkins removed a comment on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426#issuecomment-485151664 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151733 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151733 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151736 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10091/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426#issuecomment-485151693 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
AmplabJenkins commented on issue #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426#issuecomment-485151664 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151379 **[Test build #104779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104779/testReport)** for PR 24387 at commit [`71db855`](https://github.com/apache/spark/commit/71db855468691b18f9365f70ca376225fc046989). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
mengxr commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151324 LGTM pending Jenkins. @cloud-fan Do you want to make a pass? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] Andrew-Crosby opened a new pull request #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark
Andrew-Crosby opened a new pull request #24426: [SPARK-26970][PYTHON] Add Spark ML interaction transformer to PySpark URL: https://github.com/apache/spark/pull/24426 ## What changes were proposed in this pull request? Adds the Spark ML Interaction transformer to PySpark (I've set the version added to 1.6.0 to match the Scala code. Not certain if that's the right thing to do.) ## How was this patch tested? - Added Python doctest - Ran the newly added example code - Manually confirmed that a PipelineModel that contains an Interaction transformer can now be loaded in PySpark This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
mengxr commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485151267 @WeichenXu123 I pushed some changes to your branch that added more tests. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485149116 **[Test build #104778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104778/testReport)** for PR 24387 at commit [`7d9bdb0`](https://github.com/apache/spark/commit/7d9bdb0700a5dd586904b9fcbddc37b3ca3681d3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148988 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10090/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10090/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148988 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10089/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins removed a comment on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148602 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10089/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
AmplabJenkins commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148602 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
SparkQA commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148134 **[Test build #104777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104777/testReport)** for PR 24387 at commit [`600aa9a`](https://github.com/apache/spark/commit/600aa9a0122cb62ec3fa9b556c76a41f084cfa8d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] WeichenXu123 commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source
WeichenXu123 commented on issue #24387: [SPARK-27473][SQL] Support filter push down for status fields in binary file data source URL: https://github.com/apache/spark/pull/24387#issuecomment-485148092 Thanks @mengxr 's update! Looks good to me. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143639 **[Test build #104776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104776/testReport)** for PR 24425 at commit [`02a03ae`](https://github.com/apache/spark/commit/02a03aebe989f291357a651ab0cf0e4e660e071d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143507 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10088/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143505 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143507 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10088/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485143505 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485141825 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104775/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485141823 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131796 **[Test build #104775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104775/testReport)** for PR 24425 at commit [`0edfed2`](https://github.com/apache/spark/commit/0edfed2361c4eb41e851f1c4057c44867c91d3d0). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485141823 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485141775 **[Test build #104775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104775/testReport)** for PR 24425 at commit [`0edfed2`](https://github.com/apache/spark/commit/0edfed2361c4eb41e851f1c4057c44867c91d3d0). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485141825 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104775/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
AmplabJenkins removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485139431 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
AmplabJenkins removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485139435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104774/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
AmplabJenkins commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485139435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104774/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
AmplabJenkins commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485139431 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
SparkQA removed a comment on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485117285 **[Test build #104774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104774/testReport)** for PR 24424 at commit [`a759fa4`](https://github.com/apache/spark/commit/a759fa4672f076c141b6a6df69f07dd5ab6dfd93). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
SparkQA commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485139257 **[Test build #104774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104774/testReport)** for PR 24424 at commit [`a759fa4`](https://github.com/apache/spark/commit/a759fa4672f076c141b6a6df69f07dd5ab6dfd93). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] srowen commented on issue #24270: [SPARK-27343][KAFKA][SS]Avoid hardcoded for spark-sql-kafka-0-10
srowen commented on issue #24270: [SPARK-27343][KAFKA][SS]Avoid hardcoded for spark-sql-kafka-0-10 URL: https://github.com/apache/spark/pull/24270#issuecomment-485135378 @gaborgsomogyi what do you think at this point? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] srowen commented on issue #24423: [SPARK-27525][SQL] Exclude commons-httpclient when interacting with different versions of the HiveMetastoreClient
srowen commented on issue #24423: [SPARK-27525][SQL] Exclude commons-httpclient when interacting with different versions of the HiveMetastoreClient URL: https://github.com/apache/spark/pull/24423#issuecomment-485135339 Hm, you're saying this makes something _not_ work or is that a typo? Why does it fail to download? that seems like the issue. Can we exclude this if it's used? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly.
beliefer commented on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly. URL: https://github.com/apache/spark/pull/24372#issuecomment-485132519 cc @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer removed a comment on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly.
beliefer removed a comment on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly. URL: https://github.com/apache/spark/pull/24372#issuecomment-484741363 @srowen @cloud-fan @maropu @HyukjinKwon Could you help me review this PR? Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer removed a comment on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly.
beliefer removed a comment on issue #24372: [SPARK-27462][SQL] Enhance insert into hive table that could choose some columns in target table flexibly. URL: https://github.com/apache/spark/pull/24372#issuecomment-484914038 @srowen Could you make this PR to test? Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131329 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
SparkQA commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131796 **[Test build #104775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104775/testReport)** for PR 24425 at commit [`0edfed2`](https://github.com/apache/spark/commit/0edfed2361c4eb41e851f1c4057c44867c91d3d0). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131531 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins removed a comment on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131533 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10087/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131531 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131533 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10087/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
AmplabJenkins commented on issue #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425#issuecomment-485131329 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] MaxGekk opened a new pull request #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default
MaxGekk opened a new pull request #24425: [WIP][SPARK-27528][SQL] Use Parquet logical type TIMESTAMP_MICROS by default URL: https://github.com/apache/spark/pull/24425 ## What changes were proposed in this pull request? In the PR, I propose to use the `TIMESTAMP_MICROS` logical type for timestamps written to parquet files. The type matches semantically to Catalyst's `TimestampType`, and stores microseconds since epoch in UTC time zone. This will allow to avoid conversions of microseconds to nanoseconds and to Julian calendar. Also this will reduce sizes of written parquet files. ## How was this patch tested? By existing test suites. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] tgravescs commented on issue #24371: [SPARK-27176][FOLLOW-UP][SQL] Shade Parquet to sql/core
tgravescs commented on issue #24371: [SPARK-27176][FOLLOW-UP][SQL] Shade Parquet to sql/core URL: https://github.com/apache/spark/pull/24371#issuecomment-485119568 Sorry I guess this addresses shading but not hive factorization not working This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types
SparkQA commented on issue #24424: [SPARK-27527][SQL][DOCS] Improve descriptions of Timestamp and Date types URL: https://github.com/apache/spark/pull/24424#issuecomment-485117285 **[Test build #104774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104774/testReport)** for PR 24424 at commit [`a759fa4`](https://github.com/apache/spark/commit/a759fa4672f076c141b6a6df69f07dd5ab6dfd93). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
