[MLlib] StackOverflow Error spark mllib 1.6.1 FpGrowth Algorithm for Association rule generation

2016-12-27 Thread Maitray Thaker
Hi, I am getting stackoverflow error when I run FpGrowth algorithm on my 21 million transactions with a low support, since I want almost every products association with other product. I know the problem is caused by the recursive lineage of the algorithm, but I don't know how to get around this pro

StackOverflow Error spark mllib 1.6.1 FpGrowth Algorithm for Association rule generation

2016-12-27 Thread Maitray Thaker
Hi, I am getting stackoverflow error when I run FpGrowth algorithm on my 21 million transactions with a low support, since I want almost every products association with other product. I know the problem is caused by the recursive lineage of the algorithm, but I don't know how to get around this pro

Re: Already subscribed to user@spark.apache.org

2016-11-06 Thread Maitray Thaker
t; EzeQk+p6CxykVlmBNR2rAEfJnmoyyudhUeXjTVIjy3Aj75lDsAtOVeRP4T5GHEBH+ > sav > h+/eerx2kygaP2XyA5V4YJ/wGYH4fQD/pnnFuHpOiNuwZu7LuqxVCuvlGG7LYo > /QwOG8 > S+TeF0QAzj+RhYaPkxAs+hv6GM1bAq2aJdzNgUFqhJmVHV0biP4 > D69hM10BL0i9FUIvR > d2Kg== > X-Gm-Message-Stat

Fwd: Spark optimization problem

2016-10-22 Thread Maitray Thaker
Hi, I have a query regarding spark stage optimization. I have asked the question in more detail at Stackoverflow, please find the following link: http://stackoverflow.com/questions/40192302/why-is- that-two-stages-in-apache-spark-are-computing-same-thing