Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223862708
--- Diff: examples/src/main/scala/org/apache/spark/examples/HdfsTest.scala
---
@@ -41,6 +41,8 @@ object HdfsTest {
val end = System.currentTimeMillis()
println(s"Iteration $iter took ${end-start} ms")
}
+ println(s"File contents:
${file.map(_.toString).take(1).mkString(",").slice(0, 10)}")
+ println(s"Returned length(s) of:
${file.map(_.length).collect().mkString(",")}")
--- End diff --
This is printing the same thing as before my previous comment, right? In my
run this printed pages and pages of "1,1,1,1,1,1,1,1,1" which is not really
useful even for debugging things.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
