bug in livy when jar has been uploaded

2018-05-25 Thread Harsch, Tim
Hi, I posted a question on stack overflow (see link below). Livy is throwing an error for any spark code I try. The error comes after uploading a jar to the shared session (one that has been verified in spark-shell on the same system). It looks like a bug in Livy. I would appreciate some

%json magick fails to render dataframe schema

2018-05-15 Thread Harsch, Tim
Hi, I am attempting to use %json magick to get back schema info of a dataframe. It fails to populate the dataType field. e.g. { "dataType": {}, "metadata": { "map": {} }, "name": "venueid", "nullable": true } This gist shows the dataframe schema does provide datatype: