Updated Branches:
  refs/heads/master 92092879c -> f7fd80d9a

Merge pull request #540 from sslavic/patch-3. Closes #540.

Fix line end character stripping for Windows

LogQuery Spark example would produce unwanted result when run on Windows 
platform because of different, platform specific trailing line end characters 
(not only \n but \r too).

This fix makes use of Scala's standard library string functions to properly 
strip all trailing line end characters, letting Scala handle the platform 
specific stuff.

Author: Stevo Slavić <ssla...@gmail.com>

== Merge branch commits ==

commit 1e43ba0ea773cc005cf0aef78b6c1755f8e88b27
Author: Stevo Slavić <ssla...@gmail.com>
Date:   Wed Feb 5 14:48:29 2014 +0100

    Fix line end character stripping for Windows

    LogQuery Spark example would produce unwanted result when run on Windows 
platform because of different, platform specific trailing line end characters 
(not only \n but \r too).

    This fix makes use of Scala's standard library string functions to properly 
strip all trailing line end characters, letting Scala handle the platform 
specific stuff.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/f7fd80d9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/f7fd80d9
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/f7fd80d9

Branch: refs/heads/master
Commit: f7fd80d9a71069cba94294e6b77c0eaeb90e73d7
Parents: 9209287
Author: Stevo Slavić <ssla...@gmail.com>
Authored: Wed Feb 5 10:29:45 2014 -0800
Committer: Reynold Xin <r...@apache.org>
Committed: Wed Feb 5 10:29:45 2014 -0800

----------------------------------------------------------------------
 examples/src/main/scala/org/apache/spark/examples/LogQuery.scala | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/f7fd80d9/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala
----------------------------------------------------------------------
diff --git a/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala 
b/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala
index bddb54b..544c782 100644
--- a/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala
+++ b/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala
@@ -29,13 +29,13 @@ object LogQuery {
       | GTB7.4; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 
3.0.04506.648; .NET CLR
       | 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 1.0.3705; .NET CLR 
1.1.4322; .NET CLR
       | 3.5.30729; Release=ARP)" "UD-1" - "image/jpeg" "whatever" 0.350 "-" - 
"" 265 923 934 ""
-      | 62.24.11.25 images.com 1358492167 - 
Whatup""".stripMargin.replace("\n", ""),
+      | 62.24.11.25 images.com 1358492167 - 
Whatup""".stripMargin.lines.mkString,
     """10.10.10.10 - "FRED" [18/Jan/2013:18:02:37 +1100] "GET 
http://images.com/2013/Generic.jpg
       | HTTP/1.1" 304 306 "http:/referall.com" "Mozilla/4.0 (compatible; MSIE 
7.0; Windows NT 5.1;
       | GTB7.4; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 
3.0.04506.648; .NET CLR
       | 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 1.0.3705; .NET CLR 
1.1.4322; .NET CLR
       | 3.5.30729; Release=ARP)" "UD-1" - "image/jpeg" "whatever" 0.352 "-" - 
"" 256 977 988 ""
-      | 0 73.23.2.15 images.com 1358492557 - 
Whatup""".stripMargin.replace("\n", "")
+      | 0 73.23.2.15 images.com 1358492557 - 
Whatup""".stripMargin.lines.mkString
   )
 
   def main(args: Array[String]) {

Reply via email to