Hi,
I am attempting to use %json magick to get back schema info of a dataframe. It
fails to populate the dataType field. e.g.
{
"dataType": {},
"metadata": {
"map": {}
},
"name": "venueid",
"nullable": true
}
This gist shows the dataframe schema does provide datatype:
https://gist.githubusercontent.com/harschware/c8c1a2a0e7f4fc5753d006ad8000e7bc/raw/114f806b21b11ad7dc1d7ceaf17c56ae96d2903a/livyResultForSchema.json
This gist shows the %json of the dataframe schema, and all datatype fields are
empty objects '{}'
https://gist.githubusercontent.com/harschware/6c0912feaf1851d4a4329066cd253188/raw/913592d8582c6586bac4d24961c5b94d6a0a0007/livyResultForSchemaAsJson.json
I'm pretty sure this is a bug in %json, can anyone confirm? happy to file a
Jira for it if needed
Thanks,
Tim
