[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 **[Test build #98833 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98833/testReport)** for PR 22911 at commit [`d8416cd`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #23033: [SPARK-26036][PYTHON] Break large tests.py files into sm...

2018-11-14 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/23033 Looks like ML is using `QuietTest` also, so the import needs to be updated --- - To unsubscribe, e-mail: reviews-unsubscr...@

[GitHub] spark issue #23038: [SPARK-25451][CORE][WEBUI]Aggregated metrics table doesn...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23038 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23038: [SPARK-25451][CORE][WEBUI]Aggregated metrics table doesn...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23038 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22989: [SPARK-25986][Build] Add rules to ban throw Error...

2018-11-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22989 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #23038: [SPARK-25451][CORE][WEBUI]Aggregated metrics table doesn...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23038 **[Test build #98840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98840/testReport)** for PR 23038 at commit [`ed98958`](https://github.com/apache/spark/commit/ed

[GitHub] spark pull request #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN...

2018-11-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22867 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #23038: [SPARK-25451][CORE][WEBUI]Aggregated metrics tabl...

2018-11-14 Thread shahidki31
GitHub user shahidki31 opened a pull request: https://github.com/apache/spark/pull/23038 [SPARK-25451][CORE][WEBUI]Aggregated metrics table doesn't show the right number of the total tasks ## What changes were proposed in this pull request? Total tasks in the aggregated table an

[GitHub] spark issue #22989: [SPARK-25986][Build] Add rules to ban throw Errors in ap...

2018-11-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22989 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/22867 Merging to master / 2.4. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revie

[GitHub] spark issue #23009: [SPARK-26011][SPARK-SUBMIT] Yarn mode pyspark app withou...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23009 **[Test build #4425 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4425/testReport)** for PR 23009 at commit [`c8424af`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21688 **[Test build #98839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98839/testReport)** for PR 21688 at commit [`b438af5`](https://github.com/apache/spark/commit/b4

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 **[Test build #98838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98838/testReport)** for PR 22911 at commit [`d4a84bc`](https://github.com/apache/spark/commit/d4

[GitHub] spark pull request #22993: [SPARK-24421][BUILD][CORE] Accessing sun.misc.Cle...

2018-11-14 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/22993 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22993: [SPARK-24421][BUILD][CORE] Accessing sun.misc.Cleaner in...

2018-11-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22993 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@

[GitHub] spark issue #22612: [SPARK-24958] Add executors' process tree total memory i...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22612 **[Test build #98837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98837/testReport)** for PR 22612 at commit [`8f20857`](https://github.com/apache/spark/commit/8f

[GitHub] spark issue #23037: [MINOR][k8s] Add Copy pyspark into corresponding dir cmd...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23037: [MINOR][k8s] Add Copy pyspark into corresponding dir cmd...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23037: [MINOR][k8s] Add Copy pyspark into corresponding dir cmd...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23037: [MINOR][k8s] Add Copy pyspark into corresponding ...

2018-11-14 Thread AzureQ
GitHub user AzureQ opened a pull request: https://github.com/apache/spark/pull/23037 [MINOR][k8s] Add Copy pyspark into corresponding dir cmd in pyspark Dockerfile When I try to run `./bin/pyspark` cmd in a pod in Kubernetes(image built without change from pyspark Dockerfile), I'm

[GitHub] spark pull request #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark ...

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/23027#discussion_r233603036 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/FilterPushdownBenchmark.scala --- @@ -131,6 +134,15 @@ object FilterPushdo

[GitHub] spark pull request #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark ...

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/23027#discussion_r233600662 --- Diff: sql/core/benchmarks/FilterPushdownBenchmark-results.txt --- @@ -2,669 +2,809 @@ Pushdown for many distinct value case

[GitHub] spark pull request #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark ...

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/23027#discussion_r23362 --- Diff: sql/core/benchmarks/FilterPushdownBenchmark-results.txt --- @@ -2,669 +2,809 @@ Pushdown for many distinct value case

[GitHub] spark issue #22967: [SPARK-25956] Make Scala 2.12 as default Scala version i...

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22967 Could you take a look at this once more, @HyukjinKwon and @felixcheung , @gatorsmile ? --- - To unsubscribe, e-mail: revie

[GitHub] spark issue #22966: [SPARK-25965][SQL][TEST] Add avro read benchmark

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22966 Oh, it's closed successfully finally. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional com

[GitHub] spark pull request #22911: [SPARK-25815][k8s] Support kerberos in client mod...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/22911#discussion_r233591350 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DelegationTokenFeatureStep.scala --- @@ -0,0 +1,114 @@ +

[GitHub] spark pull request #22966: [SPARK-25965][SQL][TEST] Add avro read benchmark

2018-11-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22966 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #22911: [SPARK-25815][k8s] Support kerberos in client mod...

2018-11-14 Thread ifilonenko
Github user ifilonenko commented on a diff in the pull request: https://github.com/apache/spark/pull/22911#discussion_r233588339 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DelegationTokenFeatureStep.scala --- @@ -0,0 +1,114 @@

[GitHub] spark issue #22966: [SPARK-25965][SQL][TEST] Add avro read benchmark

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22966 Thank you, @gengliangwang . Could you close this? The patch is merged, but https://github.com/apache/spark/pull/22966#discussion_r233585890 change causes this conflicts. --- ---

[GitHub] spark pull request #22966: [SPARK-25965][SQL][TEST] Add avro read benchmark

2018-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/22966#discussion_r233585890 --- Diff: external/avro/src/test/scala/org/apache/spark/sql/execution/benchmark/AvroReadBenchmark.scala --- @@ -0,0 +1,216 @@ +/* + * License

[GitHub] spark issue #21339: [SPARK-24287][Core] Spark -packages option should suppor...

2018-11-14 Thread fangshil
Github user fangshil commented on the issue: https://github.com/apache/spark/pull/21339 Sorry. I will start the progress now --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #23036: [SPARK-26065][SQL] Change query hint from a `LogicalPlan...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23036 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #23036: [SPARK-26065][SQL] Change query hint from a `LogicalPlan...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23036 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5031/

[GitHub] spark issue #23036: [SPARK-26065][SQL] Change query hint from a `LogicalPlan...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23036 **[Test build #98836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98836/testReport)** for PR 23036 at commit [`785a423`](https://github.com/apache/spark/commit/78

[GitHub] spark issue #23036: [SPARK-26065][SQL] Change query hint from a `LogicalPlan...

2018-11-14 Thread maryannxue
Github user maryannxue commented on the issue: https://github.com/apache/spark/pull/23036 @gatorsmile @cloud-fan @rxin @juliuszsompolski --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additio

[GitHub] spark pull request #23036: [SPARK-26065][SQL] Change query hint from a `Logi...

2018-11-14 Thread maryannxue
GitHub user maryannxue opened a pull request: https://github.com/apache/spark/pull/23036 [SPARK-26065][SQL] Change query hint from a `LogicalPlan` to a field ## What changes were proposed in this pull request? The existing query hint implementation relies on a logical plan n

[GitHub] spark pull request #22911: [SPARK-25815][k8s] Support kerberos in client mod...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/22911#discussion_r233578429 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DelegationTokenFeatureStep.scala --- @@ -0,0 +1,114 @@ +

[GitHub] spark issue #23035: [SPARK-26057][SQL] Transform also analyzed plans when de...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23035 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98829/ Test PASSed. ---

[GitHub] spark issue #23035: [SPARK-26057][SQL] Transform also analyzed plans when de...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23035 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233577372 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark issue #23035: [SPARK-26057][SQL] Transform also analyzed plans when de...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23035 **[Test build #98829 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98829/testReport)** for PR 23035 at commit [`62a895f`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #23034: [WIP][SPARK-26035][PYTHON] Break large streaming/tests.p...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23034 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #23034: [WIP][SPARK-26035][PYTHON] Break large streaming/tests.p...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23034 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98830/ Test FAILed. ---

[GitHub] spark issue #23034: [WIP][SPARK-26035][PYTHON] Break large streaming/tests.p...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23034 **[Test build #98830 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98830/testReport)** for PR 23034 at commit [`950eed9`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #23023: [SPARK-26042][SS][TESTS]Fix a potential hang in K...

2018-11-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/23023 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #23023: [SPARK-26042][SS][TESTS]Fix a potential hang in KafkaCon...

2018-11-14 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/23023 Thanks! Merging to master and 2.4. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-11-14 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/21688 Hi @pgandhi999 Thanks for the work. One minor comment here: Currently the table header looks like this ![image](https://user-images.githubusercontent.com/1097932/48502853-841e4d80-

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread rvesse
Github user rvesse commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233560448 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98831/ Test PASSed. ---

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22867 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22867 **[Test build #98831 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98831/testReport)** for PR 22867 at commit [`c539c94`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort based ...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23024 **[Test build #98835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98835/testReport)** for PR 23024 at commit [`58293b3`](https://github.com/apache/spark/commit/58

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5030/

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5030/ --- --

[GitHub] spark pull request #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort...

2018-11-14 Thread shahidki31
Github user shahidki31 commented on a diff in the pull request: https://github.com/apache/spark/pull/23024#discussion_r233557648 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -92,16 +93,7 @@ private[ui] class ExecutorTable(stage: StageData, store

[GitHub] spark issue #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort based ...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23024 **[Test build #98834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98834/testReport)** for PR 23024 at commit [`55aebe6`](https://github.com/apache/spark/commit/55

[GitHub] spark pull request #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort...

2018-11-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23024#discussion_r233556532 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -92,16 +93,7 @@ private[ui] class ExecutorTable(stage: StageData, store: A

[GitHub] spark pull request #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort...

2018-11-14 Thread shahidki31
Github user shahidki31 commented on a diff in the pull request: https://github.com/apache/spark/pull/23024#discussion_r233555975 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -70,6 +70,7 @@ private[ui] class ExecutorTable(stage: StageData, store:

[GitHub] spark pull request #23024: [SPARK-26044][WEBUI]Aggregated Metrics table sort...

2018-11-14 Thread shahidki31
Github user shahidki31 commented on a diff in the pull request: https://github.com/apache/spark/pull/23024#discussion_r233554755 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -92,16 +93,7 @@ private[ui] class ExecutorTable(stage: StageData, store

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5030/ ---

[GitHub] spark issue #23033: [SPARK-26036][PYTHON] Break large tests.py files into sm...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23033 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98828/ Test FAILed. ---

[GitHub] spark issue #23033: [SPARK-26036][PYTHON] Break large tests.py files into sm...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23033 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #23033: [SPARK-26036][PYTHON] Break large tests.py files into sm...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23033 **[Test build #98828 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98828/testReport)** for PR 23033 at commit [`1fe6b88`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233549712 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5029/

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 **[Test build #98833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98833/testReport)** for PR 22911 at commit [`d8416cd`](https://github.com/apache/spark/commit/d8

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5029/ --- --

[GitHub] spark issue #23012: [SPARK-26014][R] Deprecate R prior to version 3.4 in Spa...

2018-11-14 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/23012 @felixcheung @HyukjinKwon yes: deprecation in this case means we test against R-3.1.1 --- - To unsubscribe, e-mail:

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233545844 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233545303 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5029/ ---

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22911 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98832/ Test FAILed. ---

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 **[Test build #98832 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98832/testReport)** for PR 22911 at commit [`a129314`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #22911: [SPARK-25815][k8s] Support kerberos in client mod...

2018-11-14 Thread ifilonenko
Github user ifilonenko commented on a diff in the pull request: https://github.com/apache/spark/pull/22911#discussion_r233542062 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkPod.scala --- @@ -18,7 +18,30 @@ package org.apache.spark.de

[GitHub] spark pull request #22911: [SPARK-25815][k8s] Support kerberos in client mod...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/22911#discussion_r233541147 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkPod.scala --- @@ -18,7 +18,30 @@ package org.apache.spark.deploy

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22911 **[Test build #98832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98832/testReport)** for PR 22911 at commit [`a129314`](https://github.com/apache/spark/commit/a1

[GitHub] spark issue #23012: [SPARK-26014][R] Deprecate R prior to version 3.4 in Spa...

2018-11-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/23012 Yea there are some problem with some packages we depend on that are not installable from CRAN (eg too old) so it will be hard to a new version of R and new installation. So to clarify,

[GitHub] spark issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keyt...

2018-11-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/22911 To address the comments I had to change a whole bunch of things; mainly because I noticed that the client and cluster paths were really different, when they should for the most part be similar. Chec

[GitHub] spark issue #22989: [SPARK-25986][Build] Add rules to ban throw Errors in ap...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22989 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22989: [SPARK-25986][Build] Add rules to ban throw Errors in ap...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22989 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98826/ Test PASSed. ---

[GitHub] spark issue #22989: [SPARK-25986][Build] Add rules to ban throw Errors in ap...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22989 **[Test build #98826 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98826/testReport)** for PR 22989 at commit [`210d942`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread ifilonenko
Github user ifilonenko commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233537461 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry f

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22867 **[Test build #98831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98831/testReport)** for PR 22867 at commit [`c539c94`](https://github.com/apache/spark/commit/c5

[GitHub] spark issue #22867: [SPARK-25778] WriteAheadLogBackedBlockRDD in YARN Cluste...

2018-11-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/22867 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.

[GitHub] spark pull request #23017: [WIP][SPARK-26015][K8S] Set a default UID for Spa...

2018-11-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/23017#discussion_r233529869 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh --- @@ -30,6 +30,10 @@ set -e # If there is no passwd entry for t

[GitHub] spark issue #23031: [SPARK-26060][CORE][SQL] Track SparkConf entries and mak...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23031 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #23031: [SPARK-26060][CORE][SQL] Track SparkConf entries and mak...

2018-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23031 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98827/ Test FAILed. ---

[GitHub] spark issue #23031: [SPARK-26060][CORE][SQL] Track SparkConf entries and mak...

2018-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23031 **[Test build #98827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98827/testReport)** for PR 23031 at commit [`3f1841c`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #23029: [SPARK-26055][CORE] InterfaceStability annotations shoul...

2018-11-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/23029 Since you're here do you want to add `@Documented` to `Private` too? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apach

[GitHub] spark pull request #22504: [SPARK-25118][Submit] Persist Driver Logs in Clie...

2018-11-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22504 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22504: [SPARK-25118][Submit] Persist Driver Logs in Client mode...

2018-11-14 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/22504 Merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h..

[GitHub] spark pull request #22986: [SPARK-25959][ML] GBTClassifier picks wrong impur...

2018-11-14 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/22986#discussion_r233514040 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -258,11 +258,7 @@ private[ml] object TreeClassifierParams { private[ml]

[GitHub] spark issue #16732: [SPARK-19368][MLlib] BlockMatrix.toIndexedRowMatrix() op...

2018-11-14 Thread akaltsikis
Github user akaltsikis commented on the issue: https://github.com/apache/spark/pull/16732 > Looks good @uzadude ; just saw this very old PR. However what about @akaltsikis 's comment? @srowen Tbh after 1 year and half i really can't recall many details. I guess due to the

[GitHub] spark issue #22331: [SPARK-25331][SS] Make FileStreamSink ignore partitions ...

2018-11-14 Thread gaborgsomogyi
Github user gaborgsomogyi commented on the issue: https://github.com/apache/spark/pull/22331 I've taken a look at the things and I think the issue solved in the mentioned PR but not yet documented. If somebody would like to use the output directory of a spark application which uses a

[GitHub] spark pull request #22986: [SPARK-25959][ML] GBTClassifier picks wrong impur...

2018-11-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22986#discussion_r233506625 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -258,11 +258,7 @@ private[ml] object TreeClassifierParams { private[ml] t

[GitHub] spark pull request #22779: [SPARK-25786][CORE]If the ByteBuffer.hasArray is ...

2018-11-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22779#discussion_r233504880 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -338,7 +338,7 @@ private[spark] class KryoSerializerInstance(ks: KryoS

[GitHub] spark pull request #22779: [SPARK-25786][CORE]If the ByteBuffer.hasArray is ...

2018-11-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22779#discussion_r233502464 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -41,7 +41,7 @@ import org.apache.spark.internal.Logging import org

<    1   2   3   4   5   >