Ha, this is a very CLASSICAL caveat with Zeppelin display system.
How is that ? Because to determine the type of the returned message
(InterpreterResult class), Zeppelin is using this piece of code:
private Type getType(String msg) {
if (msg == null) {
return Type.TEXT;
}
Type[] types = Type.values();
for (Type t : types) {
String magic = "%" + t.name().toLowerCase();
if (msg.startsWith(magic + " ") || msg.startsWith(magic + "\n")) {
return t;
}
}
return Type.TEXT;
}
Obviously, the statement "val bankText = sc.parallelize(1 to 10)" is
interpreter by the Spark REPL and will generate the output
"bankText: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[4] at"
So the returned message does NOT start with %table but with the above text
so for Zeppelin, the Type is Type.TEXT.
The caveat here is that Zeppelin code is using msg.startsWith(xxx) to check
for the %magic.
We should definitely refactor the result message display system with:
1) parse the whole output String and every time the is a %magic mixed with
plain text, return a Type.COMPOSITE (new type to be added)
2) On the AngularJS side, we need to extract any %magic bloc, display them
properly and display the remaining text as plain text
Again, I'll have a look into it when I have some bandwidth
On Tue, Jul 21, 2015 at 7:14 PM, IT CTO <[email protected]> wrote:
> Code is very simple
> /// Not working paragraph :
> %spark
> val bankText = sc.parallelize(1 to 10)
> println("%table col1\tcol2\naaa\t123\n")
>
> OUTPUT IS:
>
> bankText: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[4] at
> parallelize at <console>:23 %table col1 col2 aaa 123
>
>
>
> /// working paragraph:
> println("%table col1\tcol2\naaa\t123\n")
>
> OUTPUT is the table display as expected with all buttons and options
> col1col2aaa123
> Eran
>
> On Tue, Jul 21, 2015 at 8:09 PM madhuka udantha <[email protected]>
> wrote:
>
> > Hi Eran,
> >
> > We can't see the images that you are sharing. I think it is not possible
> to
> > attach them directly on ML. IMO you could try dropbox etc.
> >
> > Thanks.
> >
> > On Tue, Jul 21, 2015 at 7:52 PM, IT CTO <[email protected]> wrote:
> >
> > > Just install the latest build and tried the following:
> > > [image: Selection_001.png]
> > >
> > > this is not what I was expecting from the print.
> > > actually, if I remove the sc line it works well...
> > > [image: Selection_002.png]
> > >
> > > Any idea why this is happening?
> > > Eran
> > >
> >
> >
> >
> > --
> > Cheers,
> > Madhuka Udantha
> > http://madhukaudantha.blogspot.com
> >
>
