[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16987 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16987 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73124/ Test FAILed. ---

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101911409 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -173,25 +188,22 @@ private[csv] class

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101911057 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -45,24 +45,39 @@ private[csv] class

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101911027 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -45,24 +46,35 @@ private[csv] class

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101911095 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -202,21 +214,30 @@ private[csv] class

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101910362 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala --- @@ -95,6 +104,9 @@ private[csv] class

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101910256 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala --- @@ -101,6 +101,11 @@ class CSVFileFormat

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r101911173 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -202,21 +214,30 @@ private[csv] class

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73125/testReport)** for PR 16988 at commit

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #73131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73131/testReport)** for PR 16944 at commit

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16990 ``` [info] *** 34 TESTS FAILED *** [error] Failed: Total 2311, Failed 34, Errors 0, Passed 2277, Ignored 597 [error] Failed tests: [error]

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73131/ Test PASSed. ---

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16976 hmm, I understand the motivation for this, though my understanding with csv generally either avoid having newline in field or some implementation would require quotes around field value with

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #73131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73131/testReport)** for PR 16944 at commit

[GitHub] spark issue #16968: [SPARK-19337] [ML] [Doc] Documentation and examples for ...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16968 **[Test build #73132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73132/testReport)** for PR 16968 at commit

[GitHub] spark issue #16968: [SPARK-19337] [ML] [Doc] Documentation and examples for ...

2017-02-19 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/16968 Thanks for the review. Updated to binary. Also add the reference to R example. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16968: [SPARK-19337] [ML] [Doc] Documentation and examples for ...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16968 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16968: [SPARK-19337] [ML] [Doc] Documentation and examples for ...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73132/ Test PASSed. ---

[GitHub] spark issue #16968: [SPARK-19337] [ML] [Doc] Documentation and examples for ...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16968 **[Test build #73132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73132/testReport)** for PR 16968 at commit

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16944 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r101911700 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -0,0 +1,531 @@ +/*

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r101912258 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -0,0 +1,531 @@ +/*

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r101912584 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -0,0 +1,623 @@ +/*

[GitHub] spark issue #16790: [SPARK-19450] Replace askWithRetry with askSync.

2017-02-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16790 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16990 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16990 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73128/ Test FAILed. ---

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16990 **[Test build #73128 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73128/testReport)** for PR 16990 at commit

[GitHub] spark issue #16993: Dynamic Batch Interval Adjustment

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16993 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16993: Dynamic Batch Interval Adjustment

2017-02-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16993 Please read http://spark.apache.org/contributing.html and start not with code but with a design doc. However, this has been discussed before on JIRA too IIRC and rejected. --- If your project is

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73125/ Test FAILed. ---

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73125/testReport)** for PR 16988 at commit

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16987 **[Test build #73126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73126/testReport)** for PR 16987 at commit

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-02-19 Thread jinxing64
GitHub user jinxing64 opened a pull request: https://github.com/apache/spark/pull/16989 [SPARK-19659] Fetch big blocks to disk when shuffle-read. ## What changes were proposed in this pull request? Currently the whole block is fetched into memory(off heap by default) when

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-02-19 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16989 @vanzin @squito Would you mind to take a look at this when have time ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #16983: [SPARK-19550][BUILD][WIP] Addendum: select Java 1...

2017-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16983 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16790: [SPARK-19450] Replace askWithRetry with askSync.

2017-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16790 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16790: [SPARK-19450] Replace askWithRetry with askSync.

2017-02-19 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16790 @srowen @vanzin Thanks a lot for the work on this ~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16987 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16990 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16990 **[Test build #73127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73127/testReport)** for PR 16990 at commit

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16990 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73127/ Test FAILed. ---

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16990 **[Test build #73127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73127/testReport)** for PR 16990 at commit

[GitHub] spark pull request #16987: [SPARK-19633][SS] FileSource read from FileSink

2017-02-19 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16987#discussion_r101917807 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala --- @@ -76,12 +76,13 @@ abstract class FileStreamSourceTest

[GitHub] spark pull request #16992: [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler...

2017-02-19 Thread erenavsarogullari
GitHub user erenavsarogullari opened a pull request: https://github.com/apache/spark/pull/16992 [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler Unit Test coverage for different build cases ## What changes were proposed in this pull request? Fair Scheduler can be built via one

[GitHub] spark issue #16992: [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler Unit T...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16992 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16992: [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler Unit T...

2017-02-19 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16992 cc @kayousterhout @markhamstra @squito --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16991: [SPARK-19594][Structured Streaming] StreamingQuer...

2017-02-19 Thread eyalzit
GitHub user eyalzit opened a pull request: https://github.com/apache/spark/pull/16991 [SPARK-19594][Structured Streaming] StreamingQueryListener fails to handle QueryTerminatedEvent if more then one listeners exists ## What changes were proposed in this pull request?

[GitHub] spark issue #16983: [SPARK-19550][BUILD][WIP] Addendum: select Java 1.7 for ...

2017-02-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16983 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16987 **[Test build #73126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73126/testReport)** for PR 16987 at commit

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16987 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73126/ Test PASSed. ---

[GitHub] spark issue #16987: [WIP][SPARK-][SS] FileSource read from FileSink

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16987 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16990: [SPARK-19660][CORE][SQL] Replace the configuratio...

2017-02-19 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/16990 [SPARK-19660][CORE][SQL] Replace the configuration property names that are deprecated in the version of Hadoop 2.6 ## What changes were proposed in this pull request? Replace all the

[GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16990 **[Test build #73128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73128/testReport)** for PR 16990 at commit

[GitHub] spark issue #16991: [SPARK-19594][Structured Streaming] StreamingQueryListen...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16991 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16928 I'll update in a day, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16993: Dynamic Batch Interval Adjustment

2017-02-19 Thread zhangqiang2
GitHub user zhangqiang2 opened a pull request: https://github.com/apache/spark/pull/16993 Dynamic Batch Interval Adjustment The current Spark Streaming version cannot support the change of batch interval at runtime, given that the speed of input data streams may not highly dynamic

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16981 I'll update in a day, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-19 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16944 @viirya I've updated the PR to include the initial catalog table checks you've suggested in the

[GitHub] spark issue #16611: [SPARK-17967][SPARK-17878][SQL][PYTHON] Support for arra...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16611 @rxin, does this sounds okay to you? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExe...

2017-02-19 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16994 [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to extract `outputOrdering` information ### What changes were proposed in this pull request? `outputOrdering` is also dependent on whether

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16395 **[Test build #73133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73133/testReport)** for PR 16395 at commit

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16909 **[Test build #73134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73134/testReport)** for PR 16909 at commit

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16994 cc @tejasapatil @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16956: [SPARK-19598][SQL]Remove the alias parameter in U...

2017-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16956 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16994 **[Test build #73135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73135/testReport)** for PR 16994 at commit

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16977 Are tests flaky right now? Otherwise it seems like this has introduced legitimate issue with the test timing out. Three times in a row. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16909 **[Test build #73134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73134/testReport)** for PR 16909 at commit

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73134/ Test FAILed. ---

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16395 **[Test build #73133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73133/testReport)** for PR 16395 at commit

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73133/ Test PASSed. ---

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16395 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16395: [SPARK-17075][SQL] implemented filter estimation

2017-02-19 Thread ron8hu
Github user ron8hu commented on the issue: https://github.com/apache/spark/pull/16395 @cloud-fan I have updated code based on your feedback. Please review it again. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16977 **[Test build #3580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3580/testReport)** for PR 16977 at commit

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16976 I initially left the similar comment in the same JIRAs. However, that there are a quite bit of similar JIRAs complaining about this and the original CSV (as the thirdparty library) tries to

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16988 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16956 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16956 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16968: [SPARK-19337] [ML] [Doc] Documentation and exampl...

2017-02-19 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16968#discussion_r101924719 --- Diff: docs/ml-classification-regression.md --- @@ -363,6 +363,44 @@ Refer to the [R API docs](api/R/spark.mlp.html) for more details.

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73129/ Test PASSed. ---

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16956 **[Test build #73129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73129/testReport)** for PR 16956 at commit

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16956 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73130/testReport)** for PR 16988 at commit

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16964: [SPARK-19534][TESTS] Convert Java tests to use lambdas, ...

2017-02-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16964 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16964: [SPARK-19534][TESTS] Convert Java tests to use la...

2017-02-19 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/16964 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16956: [SPARK-19598][SQL]Remove the alias parameter in Unresolv...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16956 **[Test build #73129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73129/testReport)** for PR 16956 at commit

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16988 **[Test build #73130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73130/testReport)** for PR 16988 at commit

[GitHub] spark pull request #16961: [SPARK-19533][EXAMPLES] Convert Java tests to use...

2017-02-19 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/16961 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16961: [SPARK-19533][EXAMPLES] Convert Java tests to use lambda...

2017-02-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16961 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16977 **[Test build #3580 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3580/testReport)** for PR 16977 at commit

[GitHub] spark issue #16988: [SPARK-19658] [SQL] Set NumPartitions of RepartitionByEx...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16988 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73130/ Test PASSed. ---

[GitHub] spark pull request #16997: Updated the SQL programming guide to explain abou...

2017-02-19 Thread HarshSharma8
GitHub user HarshSharma8 opened a pull request: https://github.com/apache/spark/pull/16997 Updated the SQL programming guide to explain about the Encoding opera… ## What changes were proposed in this pull request? Made some updates to SQL programming guide to explain

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73151/ Test PASSed. ---

[GitHub] spark issue #16997: Updated the SQL programming guide to explain about the E...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16997 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16996 **[Test build #73152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73152/testReport)** for PR 16996 at commit

  1   2   3   >