Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread mansur
One more example: - Фәнис Яруллин � - Фәнис Яруллинга багышланган чараларның һәрберсендә катнашырга тырышам, - диде әдипнең дусты Мохтар Афзалов. ^-/-$ ^Фәнис/Фәнис$ ^Яруллин/Яруллин$ �-/-$ ^Фәнис/Фәнис$ ^Яруллинга/Яруллин$ ^багышланган/багышла$ ^чараларның/чара$ ^һәрберсендә/*һәрберсендә$

[Apertium-stuff] New contributor

2018-11-08 Thread ashwath s via Apertium-stuff
Hello everyone im a newcomer into apertium, im a beginner in nlp please guide me on how to get started ___ Apertium-stuff mailing list Apertium-stuff@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/apertium-stuff

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread mansur
Hello! > I don't think so, I think Mansur wants the tagger to disambiguate > according > to the context, but have it in line-by-line output, like TreeTagger or > UDpipe Fran, no, no, I don't think so, Kevin was right :) I think tagger should not disambiguate across lines. Because in corpus

Re: [Apertium-stuff] Stop merging lines (off-topic)

2018-11-08 Thread Tino Didriksen
No, you're not allowed to hijack a topic. You've already posted to the mailing list about this - if nobody replied, it's either because people are busy or aren't interested. Do NOT reply to random threads with off-topic posts - that'll just make everyone unhappy. -- Tino Didriksen On Thu, 8

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread saurabh dubey
Hello sir, I am a student from JIIT Noida, India. Currently, I'm working on Deep learning and Specifically on NLP( Natural language processing) and NMT( Neural machine translation). As your open source organization already contributing in this field from a very long time, So you can be a great

Re: [Apertium-stuff] Apertium - new language pair

2018-11-08 Thread Xavi Ivars
Missatge de takajima kawasaki del dia dj., 8 de nov. 2018 a les 15:12: > Hi, > > May I ask on how to create a new language pair for the apertium app? > examples like japanese , mandarin , and korean . > Hi, This is a good starting point http://wiki.apertium.org/wiki/Apertium-init You

[Apertium-stuff] Apertium - new language pair

2018-11-08 Thread takajima kawasaki
Hi, May I ask on how to create a new language pair for the apertium app? examples like japanese , mandarin , and korean . The link http://code.google.com/intl/ca/soc seems to be down. Thank you! Sincerely Takajima G. Kawasaki ___

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Kevin Brubeck Unhammer
Francis Tyers čálii: >> >> Maybe it'd make sense to have that as an option to apertium-destxt or >> similar? So "apertium -f lines -d . tat-mansur" would add the -z's and >> run with NUL's on each line, making the tools treat each line >> separately, as if you'd just typed 'echo "$line"|apertium

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Kevin Brubeck Unhammer
Francis Tyers čálii: [...] >>> That would be a good feature, but wouldn't get past the issue of the >>> tagger/cg. E.g. if we do that then the tagger can't take into account >>> context. >> >> Isn't that the whole point? (Ie. treat each line as completely >> independent, no context.) > > I

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Francis Tyers
El 2018-11-08 14:13, Kevin Brubeck Unhammer escribió: Francis Tyers čálii: Maybe it'd make sense to have that as an option to apertium-destxt or similar? So "apertium -f lines -d . tat-mansur" would add the -z's and run with NUL's on each line, making the tools treat each line separately,

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Francis Tyers
El 2018-11-08 13:45, Francis Tyers escribió: El 2018-11-08 09:57, Kevin Brubeck Unhammer escribió: mansur <6688000-re5jqeeqqe8avxtiumw...@public.gmane.org> čálii: Some examples of Apertium's tagger messing with lines. Original: Китаплар да, кешеләр дә кайтты. Аңа ярдәм итәргә кирәк. Output

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Francis Tyers
El 2018-11-08 09:57, Kevin Brubeck Unhammer escribió: mansur <6688000-re5jqeeqqe8avxtiumw...@public.gmane.org> čálii: Some examples of Apertium's tagger messing with lines. Original: Китаплар да, кешеләр дә кайтты. Аңа ярдәм итәргә кирәк. Output lines where partial merging occurred:

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread Kevin Brubeck Unhammer
mansur <6688000-re5jqeeqqe8avxtiumw...@public.gmane.org> čálii: > Some examples of Apertium's tagger messing with lines. > > Original: > Китаплар да, кешеләр > дә кайтты. > > Аңа ярдәм > итәргә кирәк. > > Output lines where partial merging occurred: > ^Китаплар да/Китап+да$^,/,$ ^кешеләр >

Re: [Apertium-stuff] Stop merging lines

2018-11-08 Thread mansur
Some examples of Apertium's tagger messing with lines. Original: Китаплар да, кешеләр дә кайтты. Аңа ярдәм итәргә кирәк. Output lines where partial merging occurred: ^Китаплар да/Китап+да$^,/,$ ^кешеләр дә/кеше+да$ ^кайтты/кайт$^./.$ ^Аңа/Ул$ ^ярдәм итәргә/ярдәм ит$ ^кирәк/кирәк+и$^./.$ It is