Nobody here who can help me on this? :/
On 19/04/16 13:15, Stefan Falk wrote:
Hello Sparklings!
I am trying to train a word vector model but as I call
Word2VecModel#save() I am getting a org.apache.spark.SparkException
saying that this would exceed the frameSize limit (stackoverflow
question [1]).
Increasing the frameSize would only help me in this particular case I
guess, but as soon as the model exceeds 2GB the problem is going to
occur again.
I am not aware of my options here - what can I do to save a
Word2VecModel of arbitrary size?
Thanks for any help!
BR; Stefan
[1]
http://stackoverflow.com/questions/36692386/exceeding-spark-akka-framesize-when-saving-word2vecmodel
--
Stefan R. Falk
Know-Center Graz
Inffeldgasse 13 / 6. Stock
8010 Graz, Austria
Email :sf...@know-center.at
Tel: +43 316 873 30869
http://www.know-center.at
--
Stefan R. Falk
Know-Center Graz
Inffeldgasse 13 / 6. Stock
8010 Graz, Austria
Email : sf...@know-center.at
Tel: +43 316 873 30869
http://www.know-center.at
