Re: Wide Datasets (v1.6.1)

2016-05-21 Thread Don Drake
I was able to verify the similar exceptions occur in Spark 2.0.0-preview. I have create this JIRA: https://issues.apache.org/jira/browse/SPARK-15467 You mentioned using beans instead of case classes, do you have an example (or test case) that I can see? -Don On Fri, May 20, 2016 at 3:49 PM,

Re: Wide Datasets (v1.6.1)

2016-05-20 Thread Michael Armbrust
> > I can provide an example/open a Jira if there is a chance this will be > fixed. > Please do! Ping me on it. Michael

Wide Datasets (v1.6.1)

2016-05-20 Thread Don Drake
I have been working to create a Dataframe that contains a nested structure. The first attempt is to create an array of structures. I've written previously on this list how it doesn't work in Dataframes in 1.6.1, but it does in 2.0. I've continued my experimenting and have it working in