Thanks for the detailed answer. As a work-around, can we suppress the sc output? BTW, should I open a jira bug for this? Eran
בתאריך יום ג׳, 21 ביולי 2015, 21:53 מאת DuyHai Doan <[email protected]>: > Ha, this is a very CLASSICAL caveat with Zeppelin display system. > > How is that ? Because to determine the type of the returned message > (InterpreterResult class), Zeppelin is using this piece of code: > > private Type getType(String msg) { > if (msg == null) { > return Type.TEXT; > } > Type[] types = Type.values(); > for (Type t : types) { > String magic = "%" + t.name().toLowerCase(); > if (msg.startsWith(magic + " ") || msg.startsWith(magic + "\n")) { > return t; > } > } > return Type.TEXT; > } > > > Obviously, the statement "val bankText = sc.parallelize(1 to 10)" is > interpreter by the Spark REPL and will generate the output > > "bankText: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[4] at" > > So the returned message does NOT start with %table but with the above text > so for Zeppelin, the Type is Type.TEXT. > > The caveat here is that Zeppelin code is using msg.startsWith(xxx) to check > for the %magic. > > We should definitely refactor the result message display system with: > > 1) parse the whole output String and every time the is a %magic mixed with > plain text, return a Type.COMPOSITE (new type to be added) > > 2) On the AngularJS side, we need to extract any %magic bloc, display them > properly and display the remaining text as plain text > > Again, I'll have a look into it when I have some bandwidth > > > > On Tue, Jul 21, 2015 at 7:14 PM, IT CTO <[email protected]> wrote: > > > Code is very simple > > /// Not working paragraph : > > %spark > > val bankText = sc.parallelize(1 to 10) > > println("%table col1\tcol2\naaa\t123\n") > > > > OUTPUT IS: > > > > bankText: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[4] at > > parallelize at <console>:23 %table col1 col2 aaa 123 > > > > > > > > /// working paragraph: > > println("%table col1\tcol2\naaa\t123\n") > > > > OUTPUT is the table display as expected with all buttons and options > > col1col2aaa123 > > Eran > > > > On Tue, Jul 21, 2015 at 8:09 PM madhuka udantha < > [email protected]> > > wrote: > > > > > Hi Eran, > > > > > > We can't see the images that you are sharing. I think it is not > possible > > to > > > attach them directly on ML. IMO you could try dropbox etc. > > > > > > Thanks. > > > > > > On Tue, Jul 21, 2015 at 7:52 PM, IT CTO <[email protected]> wrote: > > > > > > > Just install the latest build and tried the following: > > > > [image: Selection_001.png] > > > > > > > > this is not what I was expecting from the print. > > > > actually, if I remove the sc line it works well... > > > > [image: Selection_002.png] > > > > > > > > Any idea why this is happening? > > > > Eran > > > > > > > > > > > > > > > > -- > > > Cheers, > > > Madhuka Udantha > > > http://madhukaudantha.blogspot.com > > > > > >
