spark git commit: [BUILD][TEST][SPARKR] add sparksubmitsuite to appveyor tests

2017-09-10 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6273a711b -> 828fab035 [BUILD][TEST][SPARKR] add sparksubmitsuite to appveyor tests ## What changes were proposed in this pull request? more file regex ## How was this patch tested? Jenkins, AppVeyor Author: Felix Cheung

spark git commit: [SPARK-21610][SQL] Corrupt records are not handled properly when creating a dataframe from a file

2017-09-10 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 520d92a19 -> 6273a711b [SPARK-21610][SQL] Corrupt records are not handled properly when creating a dataframe from a file ## What changes were proposed in this pull request? ``` echo '{"field": 1} {"field": 2} {"field": "3"}'

[4/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_mllib.R -- diff --git a/R/pkg/tests/fulltests/test_mllib.R b/R/pkg/tests/fulltests/test_mllib.R new file mode 100644 index 000..8fe3a87 ---

[8/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_mllib.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib.R b/R/pkg/inst/tests/testthat/test_mllib.R deleted file mode 100644 index

[5/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_take.R -- diff --git a/R/pkg/inst/tests/testthat/test_take.R b/R/pkg/inst/tests/testthat/test_take.R deleted file mode 100644 index

[7/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_shuffle.R -- diff --git a/R/pkg/inst/tests/testthat/test_shuffle.R b/R/pkg/inst/tests/testthat/test_shuffle.R deleted file mode 100644

[9/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
[SPARKR][BACKPORT-2.1] backporting package and test changes ## What changes were proposed in this pull request? cherrypick or manually porting changes to 2.1 ## How was this patch tested? Jenkins Author: Felix Cheung Author: hyukjinkwon

[3/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_shuffle.R -- diff --git a/R/pkg/tests/fulltests/test_shuffle.R b/R/pkg/tests/fulltests/test_shuffle.R new file mode 100644 index

[1/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 6a8a726f3 -> ae4e8ae41 http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_take.R -- diff --git a/R/pkg/tests/fulltests/test_take.R

[6/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[2/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_sparkSQL.R -- diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R new file mode 100644 index

spark git commit: [SPARK-20098][PYSPARK] dataType's typeName fix

2017-09-10 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.2 182478e03 -> b1b5a7fdc [SPARK-20098][PYSPARK] dataType's typeName fix ## What changes were proposed in this pull request? `typeName` classmethod has been fixed by using type -> typeName map. ## How was this patch tested? local build

spark git commit: [SPARK-20098][PYSPARK] dataType's typeName fix

2017-09-10 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f76790557 -> 520d92a19 [SPARK-20098][PYSPARK] dataType's typeName fix ## What changes were proposed in this pull request? `typeName` classmethod has been fixed by using type -> typeName map. ## How was this patch tested? local build