Re: SPARK-10835 in 2.0

2016-09-20 Thread Sean Owen
You can probably just do an identity transformation on the column to make its type a nullable String array -- ArrayType(StringType, true). Of course, I'm not sure why Word2Vec must reject a non-null array type when it can of course handle nullable, but the previous discussion indicated that this

Re: SPARK-10835 in 2.0

2016-09-20 Thread janardhan shetty
Thanks Sean. On Sep 20, 2016 7:45 AM, "Sean Owen" wrote: > Ah, I think that this was supposed to be changed with SPARK-9062. Let > me see about reopening 10835 and addressing it. > > On Tue, Sep 20, 2016 at 3:24 PM, janardhan shetty > wrote: > > Is

Re: SPARK-10835 in 2.0

2016-09-20 Thread Sean Owen
Ah, I think that this was supposed to be changed with SPARK-9062. Let me see about reopening 10835 and addressing it. On Tue, Sep 20, 2016 at 3:24 PM, janardhan shetty wrote: > Is this a bug? > > On Sep 19, 2016 10:10 PM, "janardhan shetty" wrote:

Re: SPARK-10835 in 2.0

2016-09-20 Thread janardhan shetty
Is this a bug? On Sep 19, 2016 10:10 PM, "janardhan shetty" wrote: > Hi, > > I am hitting this issue. https://issues.apache.org/jira/browse/SPARK-10835 > . > > Issue seems to be resolved but resurfacing in 2.0 ML. Any workaround is > appreciated ? > > Note: > Pipeline has