Hi everyone,
My apologies if this has been asked many times before, but would this be an appropriate way to calculated the Mutual Information for a 4-gram made of of words A B C and D? Mi(ABCD) = log(P(ABCD) / (P (A) x P (B) x P (C) x P (D))) If not, what is a better way? Why is this bad? Thanks for your help, Cyrus