[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13933 The problem also exists in the other APIs: like parquet, json and others.

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61439/ Test PASSed. ---

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] support optimization for meta...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r68881745 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/MetadataOnlyOptimizer.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61439/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-06-28 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 Let me check which code portion inserts ```Cast``` in this tree. > And we do have a chance to optimize it: if the target array type's element type is primitive and the input array type's

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] support optimization for meta...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r68881475 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/MetadataOnlyOptimizer.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13961 **[Test build #3136 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3136/consoleFull)** for PR 13961 at commit

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13962 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61442/ Test FAILed. ---

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13962 **[Test build #61442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61442/consoleFull)** for PR 13962 at commit

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61444/consoleFull)** for PR 13912 at commit

[GitHub] spark pull request #13846: [SPARK-16134][SQL] optimizer rules for typed filt...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13846#discussion_r68880969 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ReferenceToExpressions.scala --- @@ -45,6 +45,7 @@ case class

[GitHub] spark issue #13912: [SPARK-16216][SQL] CSV data source supports custom date ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13912 **[Test build #61443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61443/consoleFull)** for PR 13912 at commit

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61434/ Test FAILed. ---

[GitHub] spark issue #13906: [SPARK-16208][SQL] Add `CollapseEmptyPlan` optimizer

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13906 Some more thoughts about it: Currently we only execute `Project` locally if the underlying relation is `LocalRelation`. Is it possible that we can also execute `Aggregate` locally? If it's too

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61434/consoleFull)** for PR 13960 at commit

[GitHub] spark pull request #13940: [SPARK-16241] [ML] model loading backward compati...

2016-06-28 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/13940#discussion_r68880589 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/NaiveBayes.scala --- @@ -28,8 +28,9 @@ import org.apache.spark.ml.util._ import

[GitHub] spark issue #13953: [SPARK-16265][SUBMIT] Addition of --driver-jre Flag to S...

2016-06-28 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/13953 This seems pretty weird use case -- and can get into a lot of problems --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13962 **[Test build #61442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61442/consoleFull)** for PR 13962 at commit

[GitHub] spark issue #13517: [SPARK-14839][SQL] Support for other types as option in ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13517 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61429/ Test PASSed. ---

[GitHub] spark issue #13517: [SPARK-14839][SQL] Support for other types as option in ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13517 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13517: [SPARK-14839][SQL] Support for other types as option in ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13517 **[Test build #61429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61429/consoleFull)** for PR 13517 at commit

[GitHub] spark issue #13712: [SPARK-15990][YARN] Add rolling log aggregation support ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13712 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13712: [SPARK-15990][YARN] Add rolling log aggregation support ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13712 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61437/ Test PASSed. ---

[GitHub] spark issue #13712: [SPARK-15990][YARN] Add rolling log aggregation support ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13712 **[Test build #61437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61437/consoleFull)** for PR 13712 at commit

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #61441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61441/consoleFull)** for PR 13778 at commit

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61433/ Test FAILed. ---

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61433/consoleFull)** for PR 13960 at commit

[GitHub] spark pull request #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of P...

2016-06-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13778#discussion_r68879222 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -349,11 +349,12 @@ object MapObjects {

[GitHub] spark pull request #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should...

2016-06-28 Thread renozhang
Github user renozhang commented on a diff in the pull request: https://github.com/apache/spark/pull/13962#discussion_r68878989 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -259,6 +264,43 @@ private[spark] class SaveExecutorInfo extends

[GitHub] spark issue #13493: [SPARK-15750][MLLib][PYSPARK] Constructing FPGrowth fail...

2016-06-28 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13493 Shall we change the logic in the Python wrapper and set `numPartitions` correctly if it is `-1`? Please also update the PR description to add more details to the changes. --- If your project is

[GitHub] spark issue #13940: [SPARK-16241] [ML] model loading backward compatibility ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13940 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61440/ Test FAILed. ---

[GitHub] spark issue #13940: [SPARK-16241] [ML] model loading backward compatibility ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13940 **[Test build #61440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61440/consoleFull)** for PR 13940 at commit

[GitHub] spark issue #13940: [SPARK-16241] [ML] model loading backward compatibility ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13940 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13940: [SPARK-16241] [ML] model loading backward compatibility ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13940 **[Test build #61440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61440/consoleFull)** for PR 13940 at commit

[GitHub] spark issue #13937: [SPARK-16245] [ML] model loading backward compatibility ...

2016-06-28 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13937 Merged into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13962 **[Test build #61438 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61438/consoleFull)** for PR 13962 at commit

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13962 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61438/ Test FAILed. ---

[GitHub] spark pull request #13937: [SPARK-16245] [ML] model loading backward compati...

2016-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13937 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13962 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61439/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13940: [SPARK-16241] [ML] model loading backward compatibility ...

2016-06-28 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13940 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should return...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13962 **[Test build #61438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61438/consoleFull)** for PR 13962 at commit

[GitHub] spark pull request #13962: [SPARK-16095][YARN][WIP] Yarn cluster mode should...

2016-06-28 Thread renozhang
GitHub user renozhang opened a pull request: https://github.com/apache/spark/pull/13962 [SPARK-16095][YARN][WIP] Yarn cluster mode should return correct state for SparkLauncher ## What changes were proposed in this pull request? Yarn cluster mode should return correct state for

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13961 **[Test build #3137 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3137/consoleFull)** for PR 13961 at commit

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13961 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamRead...

2016-06-28 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13955#discussion_r68877628 --- Diff: python/pyspark/sql/streaming.py --- @@ -224,6 +226,494 @@ def _to_java_trigger(self, sqlContext): self.interval)

[GitHub] spark issue #13712: [SPARK-15990][YARN] Add rolling log aggregation support ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13712 **[Test build #61437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61437/consoleFull)** for PR 13712 at commit

[GitHub] spark pull request #13939: [SPARK-16248][SQL] Whitelist the list of Hive fal...

2016-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13939 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #11863: [SPARK-12177][Streaming][Kafka] Update KafkaDStreams to ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11863 **[Test build #61436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61436/consoleFull)** for PR 11863 at commit

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13939 Merging in master/2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13939 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61426/ Test PASSed. ---

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13939 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13939 **[Test build #61426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61426/consoleFull)** for PR 13939 at commit

[GitHub] spark issue #12384: [SPARK-14608] [ML] transformSchema needs better document...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12384 **[Test build #3135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3135/consoleFull)** for PR 12384 at commit

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #61435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61435/consoleFull)** for PR 13778 at commit

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61428/ Test FAILed. ---

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13829 **[Test build #61428 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61428/consoleFull)** for PR 13829 at commit

[GitHub] spark issue #13829: [SPARK-16071][SQL] Checks size limit when doubling the a...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13829 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61432/ Test FAILed. ---

[GitHub] spark pull request #13712: [SPARK-15990][YARN] Add rolling log aggregation s...

2016-06-28 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/13712#discussion_r68876375 --- Diff: docs/running-on-yarn.md --- @@ -472,6 +472,29 @@ To use a custom metrics.properties for the application master and executors, upd

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61432 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61432/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13933: [SPARK-16236] [SQL] Add Path Option back to Load API in ...

2016-06-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13933 @zsxwing Let me try to fix it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-06-28 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13775 @rxin @hvanhovell Available to review this? Or wait for after 2.0 release? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61434/consoleFull)** for PR 13960 at commit

[GitHub] spark pull request #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamRead...

2016-06-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13955#discussion_r68875632 --- Diff: python/pyspark/sql/streaming.py --- @@ -224,6 +226,494 @@ def _to_java_trigger(self, sqlContext): self.interval)

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61431/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13955 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61431/ Test FAILed. ---

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13704 > the `Cast` performs conversion from `UnsafeArrayData` to `GenericArrayData`. `Cast` is used to cast one type to another, not cast one kind of data representation to another, so I don't

[GitHub] spark issue #13960: [SPARK-16269][SQL] Support null handling for vectorized ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61433/consoleFull)** for PR 13960 at commit

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13961 **[Test build #3136 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3136/consoleFull)** for PR 13961 at commit

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13961 Jenkins, add to whitelist. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13961 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13961: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-06-28 Thread petermaxlee
GitHub user petermaxlee opened a pull request: https://github.com/apache/spark/pull/13961 [SPARK-16271][SQL] Implement Hive's UDFXPathUtil ## What changes were proposed in this pull request? This patch ports Hive's UDFXPathUtil over to Spark, which can be used to implement

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61432/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13955: [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13955 **[Test build #61431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61431/consoleFull)** for PR 13955 at commit

[GitHub] spark issue #13960: [SQL] Support null handling for vectorized hashmap durin...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13960: [SQL] Support null handling for vectorized hashmap durin...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13960 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61430/ Test FAILed. ---

[GitHub] spark issue #13960: [SQL] Support null handling for vectorized hashmap durin...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61430/consoleFull)** for PR 13960 at commit

[GitHub] spark issue #13960: [SQL] Support null handling for vectorized hashmap durin...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13960 **[Test build #61430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61430/consoleFull)** for PR 13960 at commit

[GitHub] spark issue #13960: [SQL] Support null handling for vectorized hashmap durin...

2016-06-28 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/13960 JIRA will be added after server is up. cc @davies @sameeragarwal @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #13960: [SQL] Support null handling for vectorized hashma...

2016-06-28 Thread ooq
GitHub user ooq opened a pull request: https://github.com/apache/spark/pull/13960 [SQL] Support null handling for vectorized hashmap during hash aggregate ## What changes were proposed in this pull request? The current impl of vectorized hashmap does not support null keys.

[GitHub] spark pull request #13958: [SPARK-16268][PySpark]SQLContext should import Da...

2016-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13956: [SPARK-16267][TEST] Replace deprecated `CREATE TEMPORARY...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13956 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13956: [SPARK-16267][TEST] Replace deprecated `CREATE TEMPORARY...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61422/ Test PASSed. ---

[GitHub] spark issue #13956: [SPARK-16267][TEST] Replace deprecated `CREATE TEMPORARY...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13956 **[Test build #61422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61422/consoleFull)** for PR 13956 at commit

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61421/ Test PASSed. ---

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13816 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13958: [SPARK-16268][PySpark]SQLContext should import DataStrea...

2016-06-28 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/13958 My patch #13955 has the partial fix, but I realized that there are no tests so my patch did not actually fix this. Let merge this and then update my patch. --- If your project is set up for it, you

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13816 **[Test build #61421 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61421/consoleFull)** for PR 13816 at commit

[GitHub] spark pull request #13829: [SPARK-16071][SQL] Checks size limit when doublin...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13829#discussion_r68872391 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -45,7 +45,13 @@ public

[GitHub] spark pull request #13829: [SPARK-16071][SQL] Checks size limit when doublin...

2016-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13829#discussion_r68872200 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -45,7 +45,13 @@ public

[GitHub] spark pull request #13517: [SPARK-14839][SQL] Support for other types as opt...

2016-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13517#discussion_r68871740 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -45,11 +45,11 @@ statement | ALTER DATABASE

[GitHub] spark issue #13517: [SPARK-14839][SQL] Support for other types as option in ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13517 **[Test build #61429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61429/consoleFull)** for PR 13517 at commit

[GitHub] spark issue #13959: [SPARK-14351] [MLlib] [ML] Optimize findBestSplits metho...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13959: [SPARK-14351] [MLlib] [ML] Optimize findBestSplits metho...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61427/ Test FAILed. ---

<    1   2   3   4   5   6   7   8   >