[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75342/ Test PASSed. ---

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17463 **[Test build #75342 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75342/testReport)** for PR 17463 at commit

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75340/ Test PASSed. ---

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17463 **[Test build #75340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75340/testReport)** for PR 17463 at commit

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17430: [SPARK-20096][Spark Submit][Minor]Expose the righ...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17430#discussion_r108594377 --- Diff: core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala --- @@ -148,6 +148,17 @@ class SparkSubmitSuite appArgs.childArgs

[GitHub] spark pull request #17435: [SPARK-20098][PYSPARK] dataType's typeName fix

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17435#discussion_r108593342 --- Diff: python/pyspark/sql/types.py --- @@ -57,7 +57,25 @@ def __ne__(self, other): @classmethod def typeName(cls): -

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17388 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17388 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75334/ Test PASSed. ---

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17388 **[Test build #75334 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75334/testReport)** for PR 17388 at commit

[GitHub] spark pull request #17435: [SPARK-20098][PYSPARK] dataType's typeName fix

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17435#discussion_r108593127 --- Diff: python/pyspark/sql/types.py --- @@ -57,7 +57,25 @@ def __ne__(self, other): @classmethod def typeName(cls): -

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75336/ Test PASSed. ---

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/17463 I'm just curious why this solves the problem? if the problem is that the streaming context doesn't shut down or doesn't shut down quickly, then I'd suspect that it's not because shutting down

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #75336 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75336/testReport)** for PR 17346 at commit

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75335/ Test PASSed. ---

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75335/testReport)** for PR 17415 at commit

[GitHub] spark issue #17442: [SPARK-20107][DOC] Add spark.hadoop.mapreduce.fileoutput...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17442 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17442: [SPARK-20107][DOC] Add spark.hadoop.mapreduce.fileoutput...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17442 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75341/ Test PASSed. ---

[GitHub] spark issue #17442: [SPARK-20107][DOC] Add spark.hadoop.mapreduce.fileoutput...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17442 **[Test build #75341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75341/testReport)** for PR 17442 at commit

[GitHub] spark issue #17464: [SPARK-20134][SQL] SQLMetrics.postDriverMetricUpdates to...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17464 **[Test build #75343 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75343/testReport)** for PR 17464 at commit

[GitHub] spark pull request #17464: [SPARK-20134][SQL] SQLMetrics.postDriverMetricUpd...

GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/17464 [SPARK-20134][SQL] SQLMetrics.postDriverMetricUpdates to simplify driver side metric updates ## What changes were proposed in this pull request? It is not super intuitive how to update SQLMetric

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17463 **[Test build #75342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75342/testReport)** for PR 17463 at commit

[GitHub] spark issue #17442: [SPARK-20107][DOC] Speed up HadoopMapReduceCommitProtoco...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17442 **[Test build #75341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75341/testReport)** for PR 17442 at commit

[GitHub] spark issue #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apache.spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17463 **[Test build #75340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75340/testReport)** for PR 17463 at commit

[GitHub] spark pull request #17463: [SPARK-20131][DStream][Test] Flaky Test: org.apac...

GitHub user uncleGen opened a pull request: https://github.com/apache/spark/pull/17463 [SPARK-20131][DStream][Test] Flaky Test: org.apache.spark.streaming.StreamingContextSuite ## What changes were proposed in this pull request? do not stop the `SparkContext` in thread.

[GitHub] spark issue #17406: [SPARK-20009][SQL] Support DDL strings for defining sche...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17406 oh, my bad. Fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17406: [SPARK-20009][SQL] Use DDL strings for defining schema i...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17406 Could you update the PR title? ``` [SPARK-20009][SQL] Support DDL strings for defining schema in functions.from_json ``` --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16746: [SPARK-15648][SQL] Add teradataDialect for JDBC connecti...

Github user klinvill commented on the issue: https://github.com/apache/spark/pull/16746 Hi @dongjoon-hyun @gatorsmile, just circling back. Is it going to be impractical to check the PR against a VM rather than against a docker image? --- If your project is set up for it, you can

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

Github user dbolshak commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108589069 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -103,7 +103,7 @@ private[ui] class StagePage(parent: StagesTab) extends

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17297 **[Test build #75339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75339/testReport)** for PR 17297 at commit

[GitHub] spark issue #17355: [SPARK-19955][PySpark] Jenkins Python Conda based test.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75333/ Test PASSed. ---

[GitHub] spark issue #17355: [SPARK-19955][PySpark] Jenkins Python Conda based test.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75338/testReport)** for PR 17379 at commit

[GitHub] spark issue #17355: [SPARK-19955][PySpark] Jenkins Python Conda based test.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75333/testReport)** for PR 17355 at commit

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75337/testReport)** for PR 17379 at commit

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user kunalkhamar commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108586704 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala --- @@ -32,15 +32,15 @@ import

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user kunalkhamar commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108586634 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/sessionStateBuilders.scala --- @@ -134,6 +135,14 @@ abstract class

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user kunalkhamar commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108586629 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -37,38 +37,42 @@ import

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108585042 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,138 @@ case

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108584962 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,138 @@ case

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108584830 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,138 @@ case

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108584825 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,138 @@ case

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17297 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17297 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75332/ Test FAILed. ---

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17297 **[Test build #75332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75332/testReport)** for PR 17297 at commit

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108583642 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,138 @@ case

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #75336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75336/testReport)** for PR 17346 at commit

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17346 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user ron8hu commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108583109 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,135 @@ case

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108582862 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2747,6 +2747,17 @@ class Dataset[T] private[sql]( } }

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75335/testReport)** for PR 17415 at commit

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user ron8hu commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108582594 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -515,8 +530,135 @@ case

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

Github user ron8hu commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108582540 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -509,8 +524,131 @@ case

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108581072 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2828,4 +2839,16 @@ class Dataset[T] private[sql](

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17388 **[Test build #75334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75334/testReport)** for PR 17388 at commit

[GitHub] spark pull request #17388: [SPARK-20059][YARN] Use the correct classloader f...

Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17388#discussion_r108580909 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -485,12 +485,17 @@ object SparkSubmit extends CommandLineUtils {

[GitHub] spark pull request #17421: [SPARK-20040][ML][python] pyspark wrapper for Chi...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108579124 --- Diff: python/pyspark/sql/tests.py --- @@ -56,6 +56,15 @@ from pyspark.sql.utils import AnalysisException, ParseException, IllegalArgumentException

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17421 Merging with master Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108576926 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/sessionStateBuilders.scala --- @@ -134,6 +135,14 @@ abstract class BaseSessionStateBuilder(

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108562157 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -37,38 +37,42 @@ import

[GitHub] spark pull request #17379: [SPARK-20048][SQL] Cloning SessionState does not ...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/17379#discussion_r108577718 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala --- @@ -32,15 +32,15 @@ import

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75331/ Test PASSed. ---

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75331/testReport)** for PR 17379 at commit

[GitHub] spark issue #17442: [SPARK-20107][SQL] Speed up HadoopMapReduceCommitProtoco...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17442 The PR title and description also have nothing to do with the change anymore. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/17297 Agreed. Let's establish what we want to do before trying to discuss the details of how we are going to do it. On Tue, Mar 28, 2017 at 8:17 AM, Imran Rashid

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17421 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75330/ Test PASSed. ---

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17421 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17421 **[Test build #75330 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75330/testReport)** for PR 17421 at commit

[GitHub] spark issue #17355: [SPARK-19955][PySpark] Jenkins Python Conda based test.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75333/testReport)** for PR 17355 at commit

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/17297 @squito - Sounds good to me, let me compile the list of pain points related to fetch failure we are seeing and also a design doc to have better handling of the issues. --- If your project is

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17297 **[Test build #75332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75332/testReport)** for PR 17297 at commit

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17421 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17421 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75329/ Test PASSed. ---

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17421 **[Test build #75329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75329/testReport)** for PR 17421 at commit

[GitHub] spark issue #17406: [SPARK-20009][SQL] Use DDL strings for defining schema i...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17406 @gatorsmile okay, please. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17401: [SPARK-18364][YARN] Expose metrics for YarnShuffleServic...

Github user ash211 commented on the issue: https://github.com/apache/spark/pull/17401 @jerryshao ready for re-review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17401: [SPARK-18364][YARN] Expose metrics for YarnShuffl...

Github user ash211 commented on a diff in the pull request: https://github.com/apache/spark/pull/17401#discussion_r108562943 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleServiceMetrics.java --- @@ -0,0 +1,123 @@ +/* + * Licensed to

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75331/testReport)** for PR 17379 at commit

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108560956 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -103,7 +103,7 @@ private[ui] class StagePage(parent: StagesTab) extends

[GitHub] spark pull request #17407: [SPARK-20043][ML] DecisionTreeModel: ImpurityCalc...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17407 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17407: [SPARK-20043][ML] DecisionTreeModel: ImpurityCalculator ...

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17407 Merging with master and branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17446: [SPARK-17075][SQL][followup] Add Estimation of Co...

Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/17446 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17446: [SPARK-17075][SQL][followup] Add Estimation of Constant ...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17446 Since this PR does not correctly handle the cases like `Not(Not(null))`, I close this PR at first. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #15332: [SPARK-10364][SQL] Support Parquet logical type T...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/15332#discussion_r108547399 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala --- @@ -965,6 +972,18 @@ class

[GitHub] spark pull request #15332: [SPARK-10364][SQL] Support Parquet logical type T...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/15332#discussion_r108548142 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -237,6 +238,30 @@ object DateTimeUtils {

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75328/ Test PASSed. ---

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75328/testReport)** for PR 17379 at commit

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/17421 LGTM pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17462: [SPARK-20050][DStream] Kafka 0.10 DirectStream doesn't c...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17462 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17462: [SPARK-20050][DStream] Kafka 0.10 DirectStream do...

GitHub user sasakitoa opened a pull request: https://github.com/apache/spark/pull/17462 [SPARK-20050][DStream] Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown ## What changes were proposed in this pull request? When we use

[GitHub] spark issue #17407: [SPARK-20043][ML] DecisionTreeModel: ImpurityCalculator ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17407 **[Test build #3618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3618/testReport)** for PR 17407 at commit

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17421 **[Test build #75330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75330/testReport)** for PR 17421 at commit

[GitHub] spark issue #17421: [SPARK-20040][ML][python] pyspark wrapper for ChiSquareT...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17421 **[Test build #75329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75329/testReport)** for PR 17421 at commit

[GitHub] spark issue #17436: [SPARK-20101][SQL] Use OffHeapColumnVector when "spark.m...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17436 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75327/ Test FAILed. ---

  1   2   3   4   >