I've been trying to use the Naive Bayes classifier. Each example in the dataset is about 2 million features, only about 20-50 of which are non-zero, so the vectors are very sparse. I keep running out of memory though, even for about 1000 examples on 30gb RAM while the entire dataset is 4 million examples. And I would also like to note that I'm using the sparse vector class.
- Running out of memory Naive Bayes John King
- Re: Running out of memory Naive Bayes John King
- Re: Running out of memory Naive Bayes DB Tsai
- Re: Running out of memory Naive Bayes Xiangrui Meng
- Re: Running out of memory Naive Bayes John King
- Re: Running out of memory Naive Bayes Xiangrui Meng
- Re: Running out of memory Naive Ba... DB Tsai
- Re: Running out of memory Naiv... Xiangrui Meng
- Re: Running out of memory Naiv... DB Tsai
- Re: Running out of memory Naiv... Matei Zaharia
