Tan,
It's difficult to tell through email if the character is ASCII
or Unicode. On my system it appears to be ASCII. Can you save those two
sentences in a UTF-8 text file, tarball them and forward?
Tom
On
Tue, 07 Aug 2012 12:12:52 +0700, Tom Hoar wrote:
If you're using
Moses' tokenizer.perl script, the English handling separates the
"company's" into "company 's". In recent (~2 months) moses github
releases, the tokenizer.perl script also escapes the string to this
"company 's". The English detokenizer unescapes the "'s" to "'s" and
restores it without the preceding space.
On Tue, 7 Aug 2012 00:33:07
-0400, wrote:
Hi all,
When I using Moses to translate some
sentences contain apostrophes, it doesn't work correctly.
SOURCE:
EMC Corporation (NYSE:EMC) today reported strong financial results for
the second quarter of 2012, marking the company's 10th consecutive
quarter of double-digit year-over-year growth for consolidated revenue,
GAAP net income, and GAAP and non-GAAP EPS. EMC expects to achieve its
full-year 2012 goals for consolidated revenue, non-GAAP EPS and free
cash flow.
TRANSLATION RESULT:
2012 年 7 月 24 日 -- EMC 公司 （ NYSE ：
EMC) 今天 报告 了 强有力 的 财务 业绩 2012 年 第 2 季度 ， 标志 着 公司 's 连续 10 个 季度 实现 两 位 数
的 同比 增长 ， 以 实现 整合 的 收入 、 GAAP 净 收入 和 GAAP 和 非 GAAP 每 股 收益 。 EMC 预计 到
2012 年 实现 其 目标 的 要求 年 全 年 的 合并 收入 、 非 GAAP EPS 和 自由 现金流 。
As we can
see, the translation result of "COMPANY'S" is "公司 'S"，and translation of
the apostrophes(') and the letter (s) got failed.
Does anybody know
the cause of this issue? Do I need some other module to handle it? Does
anybody know how to fix it? Below is an example:
Thanks _______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
