I noticed that all n-gram tools transformed new line character into space so the that n-gran may span more than one line
I asked how can we modify the code such that computing n-gram will be on one line only my data is a text file each line contain a phrase I want the left tokens and the right tokens will be computed only from the same line only and do not across the next line
