Hello, I'm HsienYu Meng from Taiwan. I'm currently in my first year of graduate studies at Tsinghua Univ. As you mentioned, the SGD project should implement HOGWILD! algorithm and consider to set stepsize at each iteration. However, the paper indicates that they assume the stepsize to be a constant value so that the formula 7 make sense. I wonder if we change the stepsize at each time, will the properties of HOGWILD! still holds? Another question is, if the dataset is large and we partition it in memory, which kind of losk-release should we apply? Sequential consistency, Release consistency or lazy release consistency?
Appreciate for your patience .Thanks! -- *孟憲妤* *MengHsienyu**Department of Computer Science ,Tsinghua university * *Beijing ,China* *100084* *Mobile:(+86)18201162149* * (+886)0952424693*
_______________________________________________ mlpack mailing list [email protected] http://knife.lugatgt.org/cgi-bin/mailman/listinfo/mlpack
