Dear Eduard,
Here is our suggestions as MT Vendor.
1. Classification of MT System for certification shpould be based on formal
objective criteria that can be understandable between everybody.
2. If you mention about 50,000 root entries - that you need publish of all
50,000 root entries that should be in MT to be classified as STANDARD
LEVEL.
3. Also - all root entries should have ALL MORPHOLOGICAL WORD FORMS in MT
System.
4. All grammar quality in MT should be based on list of examples that can be
translated correctly by MT System.
I can provide list of examples to classified Advanced or Standard system.
5. Difference between MT system SHOULD BASED only on quality of translation
and dictionaries.
"Network ability" is not feature of MT, it is supported software component.
It can be MT with bad translation quality , but with network function.
Customer can understand it himself.
6. Also, important point - what happen if Certification agency will assign
MT as Standard level, but MT Vendor sure for 100% that this is Advanced
level. After that MT vendor will never come to certification, they simply
will produce paper where some independent scientist will make statement
that their MT is Advanced Level. Regular customer will never feel difference
from
the professor A from IAMT or the professor B from NOWHERE. It still will be
all subjective. Only format criteria can resolved this problem and make very
good background for futire formal evaluation.
Dear Eduard - if you agree a little bit with my letters, I can prepare
formal criteria for differenecs between MT systems.
It can be done based on two idea - complete morphological dictionary (
50,000 entries) and
correct translation of basic grammar structures (1,000 typical structures).
It is only example, but real formal criteria can avoid all subjective
problems and improve quality of all MT - it will be better for everyone.
Also, I agree with letter of David Mowatt
Yuri Mordovskoi
CTO
LanguageForce Inc.
http://www.languageforce.com
--
For MT-List info, see http://www.eamt.org/mt-list.html