Revision: 16875
http://sourceforge.net/p/gate/code/16875
Author: markagreenwood
Date: 2013-09-10 13:43:55 +0000 (Tue, 10 Sep 2013)
Log Message:
-----------
added the lang_id models
Modified Paths:
--------------
gate/trunk/plugins/Twitter/resources/twitie-en.xgapp
Added Paths:
-----------
gate/trunk/plugins/Twitter/resources/lang_id/
gate/trunk/plugins/Twitter/resources/lang_id/default-names.conf
gate/trunk/plugins/Twitter/resources/lang_id/dutch-tweet.lm
gate/trunk/plugins/Twitter/resources/lang_id/english-tweet.lm
gate/trunk/plugins/Twitter/resources/lang_id/french-tweet.lm
gate/trunk/plugins/Twitter/resources/lang_id/german-tweet.lm
gate/trunk/plugins/Twitter/resources/lang_id/spanish-tweet.lm
Added: gate/trunk/plugins/Twitter/resources/lang_id/default-names.conf
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/default-names.conf
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/default-names.conf
2013-09-10 13:43:55 UTC (rev 16875)
@@ -0,0 +1,5 @@
+german-tweet.lm german
+english-tweet.lm english
+french-tweet.lm french
+spanish-tweet.lm spanish
+dutch-tweet.lm dutch
Added: gate/trunk/plugins/Twitter/resources/lang_id/dutch-tweet.lm
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/dutch-tweet.lm
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/dutch-tweet.lm 2013-09-10
13:43:55 UTC (rev 16875)
@@ -0,0 +1,400 @@
+_ 9556
+e 3387
+n 1803
+a 1595
+i 1321
+o 1295
+t 1283
+r 1149
+d 837
+n_ 776
+l 771
+en 717
+s 716
+k 624
+g 600
+e_ 577
+t_ 540
+h 532
+m 501
+er 472
+u 462
+. 439
+en_ 437
+; 429
+j 425
+_; 420
+v 390
+w 380
+r_ 371
+_d 330
+p 319
+an 313
+b 312
+et 310
+ee 309
+aa 301
+de 281
+ie 274
+_h 260
+s_ 252
+in 249
+_v 245
+c 245
+._ 243
+_m 237
+ge 236
+z 234
+_i 231
+ij 230
+te 219
+_e 218
+_w 217
+et_ 206
+_n 203
+_o 201
+he 200
+;_ 198
+el 196
+oo 192
+_;_ 192
+k_ 191
+f 189
+er_ 182
+ar 176
+or 169
+! 166
+_b 166
+_g 162
+.. 158
+me 158
+_he 158
+we 157
+g_ 154
+_t 153
+le 153
+_z 150
+st 149
+nd 148
+at 147
+de_ 145
+an_ 143
+d_ 141
+da 139
+_a 138
+, 138
+,_ 136
+ke 133
+oe 128
+_de 128
+l_ 127
+_k 127
+je 126
+_j 126
+ch 125
+al 124
+aar 124
+: 124
+!_ 123
+ve 122
+on 121
+li 115
+_de_ 111
+op 111
+va 110
+een 110
+re 110
+is 109
+_s 108
+be 107
+ni 100
+ne 100
+at_ 99
+_ge 98
+ar_ 97
+oor 97
+ng 96
+je_ 96
+p_ 94
+aar_ 94
+_va 94
+_we 93
+een_ 92
+wa 92
+_l 92
+ti 91
+in_ 91
+ik 91
+ha 90
+es 90
+_me 90
+_in 89
+van 87
+it 87
+vo 86
+nt 86
+_van 85
+_da 84
+gen 82
+ma 82
+_ee 82
+? 82
+_een 80
+D 80
+la 80
+:_ 80
+ra 78
+ed 78
+a_ 77
+_wa 76
+... 76
+het 76
+ri 76
+E 75
+di 75
+eer 75
+nie 75
+ze 74
+na 74
+_een_ 74
+_be 74
+_op 73
+- 73
+om 72
+N 72
+het_ 72
+to 72
+ek 71
+_je 71
+ik_ 71
+_het 71
+_: 70
+_het_ 70
+.._ 70
+ie_ 70
+_je_ 69
+_ik 69
+ver 68
+rd 67
+_ik_ 67
+or_ 67
+_in_ 67
+A 66
+ag 66
+op_ 66
+_vo 66
+_ni 65
+?_ 65
+iet 64
+van_ 64
+eg 64
+_van_ 64
+ll 64
+n. 63
+_nie 63
+ter 63
+ns 63
+no 62
+oor_ 62
+ing 62
+j_ 62
+zo 62
+_en 62
+zi 61
+ij_ 61
+L 61
+) 61
+ht 61
+aan 61
+ijk 60
+jk 60
+ten 60
+wee 59
+ou 59
+nde 58
+_op_ 58
+ro 58
+is_ 58
+el_ 58
+cht 58
+mo 57
+ui 57
+M 57
+_en_ 57
+G 57
+bi 56
+der 56
+m_ 56
+do 56
+)_ 56
+ev 55
+H 55
+ig 55
+eb 55
+T 55
+as 54
+niet 54
+pe 53
+O 53
+f_ 52
+eu 52
+met 52
+u_ 52
+il 52
+B 52
+en. 51
+te_ 51
+_p 51
+voo 51
+rs 51
+_ma 51
+and 50
+_voo 50
+voor 50
+_met 50
+_al 50
+ken 49
+em 49
+_di 49
+og 49
+_voor 49
+ho 48
+mi 48
+_f 48
+hi 48
+ei 48
+o_ 47
+den 47
+ak 47
+maa 47
+W 47
+_niet 47
+ta 47
+_zo 47
+lij 47
+tr 47
+met_ 47
+_met_ 47
+..._ 47
+_is 46
+S 46
+I 46
+ur 46
+wi 45
+eer_ 45
+ol 45
+_D 45
+se 45
+rt 45
+_mo 44
+_do 44
+jn 44
+iet_ 44
+us 44
+voor_ 44
+ijn 44
+_no 44
+ga 44
+_ze 43
+ko 43
+kk 43
+_ve 43
+gen_ 43
+dat 43
+_is_ 43
+niet_ 42
+!! 42
+rg 42
+_le 42
+lle 42
+n._ 42
+_na 42
+_te 41
+' 41
+dat_ 41
+ers 41
+ka 40
+_bi 40
+_c 40
+_r 40
+ere 39
+ah 39
+aan_ 39
+uw 39
+ng_ 39
+ste 38
+_zi 38
+eve 38
+am 38
+ac 38
+ot 38
+men 38
+nd_ 38
+lijk 37
+ent 37
+heb 37
+_B 37
+die 37
+_ha 37
+ok 37
+_dat 36
+_ver 36
+ker 36
+ja 36
+ten_ 36
+h_ 36
+en._ 36
+ren 36
+_heb 36
+al_ 35
+_mi 35
+ens 35
+_wee 35
+_E 35
+kke 35
+y 34
+it_ 34
+_N 34
+st_ 34
+_st 34
+ns_ 34
+lo 34
+ec 34
+og_ 34
+_dat_ 34
+_maa 34
+ond 33
+_G 33
+nog 33
+ru 33
+_:_ 33
+naa 33
+P 33
+end 32
+oc 32
+_nog 32
+rk 32
+ap 32
+wo 32
+_W 32
+bij 32
+wat 32
+aha 31
+weer 31
+_u 31
+_aa 31
+x 31
+jn_ 31
+ijn_ 31
+_to 31
+nog_ 31
+_die 30
+ag_ 30
+_. 30
+_H 30
+ic 30
+_ga 30
+_nog_ 30
+ts 30
+ven 30
+ijk_ 30
Property changes on: gate/trunk/plugins/Twitter/resources/lang_id/dutch-tweet.lm
___________________________________________________________________
Added: svn:executable
## -0,0 +1 ##
+*
\ No newline at end of property
Added: gate/trunk/plugins/Twitter/resources/lang_id/english-tweet.lm
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/english-tweet.lm
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/english-tweet.lm
2013-09-10 13:43:55 UTC (rev 16875)
@@ -0,0 +1,400 @@
+_ 10226
+e 2213
+o 1760
+t 1617
+a 1524
+n 1359
+i 1352
+s 1231
+r 1133
+l 824
+h 820
+u 650
+d 643
+e_ 629
+m 514
+g 483
+. 480
+y 470
+s_ 444
+c 444
+; 444
+t_ 435
+_t 426
+_; 415
+in 380
+w 361
+p 357
+f 356
+_a 323
+th 296
+b 283
+er 271
+he 270
+n_ 270
+d_ 258
+on 255
+ou 240
+._ 240
+_s 237
+r_ 236
+y_ 234
+_i 233
+re 232
+k 231
+an 231
+_th 221
+o_ 212
+v 207
+ng 204
+I 201
+or 199
+_o 191
+.. 187
+st 187
+at 183
+: 182
+to 181
+ing 180
+;_ 177
+a_ 175
+_m 173
+_w 171
+ha 169
+! 168
+es 164
+en 164
+_;_ 164
+g_ 163
+_f 160
+_b 159
+is 159
+_h 155
+nd 155
+it 152
+the 151
+ng_ 147
+ne 145
+' 144
+_I 143
+ing_ 141
+ed 140
+al 135
+_the 135
+te 134
+_to 133
+ve 133
+T 133
+, 131
+S 130
+me 130
+ea 129
+se 127
+he_ 127
+ar 126
+A 125
+!_ 125
+_c 125
+l_ 124
+as 124
+ti 123
+,_ 122
+:_ 120
+ee 113
+oo 113
+ur 113
+le 112
+nt 112
+ll 111
+_: 107
+_l 107
+li 106
+m_ 106
+_d 104
+to_ 103
+M 101
+C 100
+_n 99
+D 99
+_the_ 99
+- 99
+the_ 99
+_to_ 98
+_a_ 96
+h_ 96
+_y 95
+_p 95
+us 95
+ri 95
+om 93
+L 92
+ed_ 92
+... 91
+nd_ 91
+O 91
+yo 90
+_g 90
+hi 90
+E 88
+er_ 88
+lo 87
+ra 86
+and 85
+ot 85
+ho 84
+et 84
+ro 84
+H 84
+fo 84
+de 84
+you 84
+ay 84
+_an 82
+on_ 82
+ow 82
+B 82
+el 81
+is_ 81
+ut 81
+_T 81
+? 81
+in_ 80
+ta 80
+_yo 80
+_you 80
+_r 80
+f_ 79
+N 78
+st_ 78
+so 78
+) 78
+I_ 78
+P 77
+.._ 76
+of 75
+be 73
+at_ 73
+co 73
+_S 72
+w_ 72
+ch 72
+or_ 72
+x 71
+R 71
+_C 71
+_fo 71
+_in 70
+io 70
+re_ 69
+F 69
+no 67
+)_ 67
+_of 66
+W 66
+di 66
+and_ 66
+_M 66
+..._ 66
+ke 65
+ic 65
+ol 65
+pe 65
+_I_ 65
+ce 65
+_on 64
+na 64
+_A 64
+k_ 64
+ni 63
+ge 62
+for 62
+_and 62
+la 62
+es_ 62
+_ha 62
+si 62
+ve_ 61
+our 61
+rs 61
+_e 61
+ss 61
+id 60
+G 60
+-_ 60
+?_ 59
+_B 59
+ent 58
+_- 58
+u_ 57
+_and_ 57
+wa 56
+do 56
+ie 56
+me_ 56
+ma 55
+un 54
+_-_ 54
+am 54
+ll_ 54
+we 54
+_so 53
+tt 53
+_for 53
+rt 53
+hat 53
+_F 53
+_is 52
+ir 52
+sh 52
+_in_ 52
+ion 52
+of_ 51
+ca 51
+_it 51
+il 51
+_be 51
+_:_ 50
+_H 50
+_D 50
+ec 50
+gh 50
+ur_ 50
+_of_ 50
+go 49
+_L 49
+_is_ 49
+it_ 48
+for_ 48
+her 48
+ad 48
+ou_ 48
+_co 48
+_re 48
+tr 48
+ia 48
+_for_ 47
+mo 47
+ac 47
+_P 47
+ry 46
+j 46
+ow_ 46
+_do 45
+ts 45
+our_ 45
+hat_ 45
+ly 45
+p_ 44
+nt_ 44
+_he 44
+'s 44
+od 44
+_go 44
+ig 44
+ay_ 44
+i_ 43
+em 43
+vi 43
+one 43
+wi 42
+_. 42
+_me 42
+'s_ 42
+_li 42
+ns 42
+bo 41
+ne_ 41
+pl 41
+nc 41
+da 41
+Th 41
+th_ 41
+ag 40
+_N 40
+_on_ 40
+_wa 40
+ew 40
+as_ 40
+op 40
+wo 40
+ver 40
+my 39
+_u 39
+you_ 39
+ut_ 39
+_W 39
+Y 39
+av 39
+bu 39
+_G 38
+!! 38
+_lo 38
+thi 38
+& 38
+wh 38
+ly_ 38
+en_ 38
+_you_ 38
+tio 37
+ts_ 37
+su 37
+le_ 37
+_se 37
+_no 37
+ki 37
+al_ 36
+tion 36
+ck 36
+( 36
+_st 36
+ev 36
+ul 36
+ot_ 36
+U 36
+_R 36
+_ma 36
+ine 36
+_my 36
+iv 36
+fe 35
+J 35
+ov 35
+ai 35
+an_ 35
+ers 35
+ht 35
+ere 34
+ba 34
+tin 34
+rn 34
+ak 34
+ke_ 34
+tha 34
+mi 34
+ome 34
+_ne 34
+_wh 34
+my_ 34
+ct 34
+e. 34
+ab 33
+gi 33
+os 33
+_j 33
+_wo 32
+_tha 32
+ust 32
+pr 32
+ast 32
+up 32
+_my_ 32
+fr 32
+se_ 32
+_it_ 32
+po 32
+ess 31
+_bu 31
+oi 31
+_wi 31
+ght 31
+_mo 31
Property changes on:
gate/trunk/plugins/Twitter/resources/lang_id/english-tweet.lm
___________________________________________________________________
Added: svn:executable
## -0,0 +1 ##
+*
\ No newline at end of property
Added: gate/trunk/plugins/Twitter/resources/lang_id/french-tweet.lm
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/french-tweet.lm
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/french-tweet.lm
2013-09-10 13:43:55 UTC (rev 16875)
@@ -0,0 +1,400 @@
+_ 10555
+e 2898
+s 1575
+a 1546
+i 1472
+n 1416
+r 1354
+o 1285
+t 1235
+u 1202
+e_ 1052
+l 983
+s_ 759
+d 688
+c 621
+m 586
+p 572
+\xC3 492
+_d 443
+; 431
+_; 416
+es 403
+t_ 386
+. 374
+n_ 347
+en 329
+_l 321
+v 321
+_p 317
+le 316
+on 314
+de 309
+r_ 306
+ou 299
+é 284
+\xA9 284
+re 268
+ai 267
+es_ 261
+_s 258
+ur 255
+_de 252
+er 252
+a_ 250
+' 248
+f 244
+_c 238
+b 229
+is 225
+nt 223
+h 222
+an 216
+_m 212
+_a 206
+te 205
+: 195
+g 195
+de_ 185
+_e 185
+;_ 180
+.. 180
+._ 175
+_;_ 171
+in 170
+, 169
+_de_ 163
+ie 162
+me 161
+! 158
+,_ 157
+it 156
+_t 155
+ne 152
+_le 151
+le_ 147
+:_ 146
+st 145
+j 144
+qu 143
+_: 143
+q 143
+ti 142
+se 142
+u_ 142
+i_ 141
+A 135
+ur_ 135
+la 134
+on_ 133
+_v 130
+is_ 128
+us 125
+ma 124
+ar 124
+eu 122
+ce 122
+ns 121
+ra 120
+x 119
+co 119
+E 117
+_j 117
+y 112
+et 112
+ro 112
+ll 112
+_\xC3 111
+D 111
+er_ 111
+- 111
+ve 111
+ri 110
+re_ 109
+ue 109
+ent 108
+our 108
+pa 108
+ais 107
+L 107
+M 106
+_b 106
+!_ 105
+) 104
+_r 103
+un 102
+S 102
+nt_ 102
+_f 101
+_:_ 100
+pr 100
+il 99
+ne_ 98
+oi 98
+as 96
+_pa 95
+_n 93
+ui 93
+li 92
+C 91
+_qu 90
+... 90
+_q 90
+tr 90
+au 90
+po 90
+l_ 89
+or 88
+al 87
+est 87
+_le_ 85
+)_ 85
+en_ 85
+su 84
+ch 84
+I 84
+\xA0 84
+si 84
+em 83
+ais_ 83
+ir 82
+.._ 82
+_co 81
+to 80
+T 80
+O 80
+nd 79
+'a 79
+at 78
+io 78
+_la 77
+_u 77
+el 77
+la_ 77
+que 76
+..._ 76
+N 75
+st_ 75
+te_ 75
+ns_ 75
+ta 75
+à 75
+lle 75
+est_ 74
+mo 74
+nc 74
+ss 74
+B 74
+_en 74
+no 73
+\xA0_ 73
+so 73
+R 73
+P 73
+ion 73
+_M 73
+à_ 71
+ut 71
+_ma 71
+_! 71
+J 70
+_la_ 70
+_su 70
+les 70
+us_ 69
+et_ 69
+_un 69
+om 68
+_o 68
+( 68
+'e 67
+rs 67
+r\xC3 67
+des 66
+our_ 66
+sa 66
+F 66
+les_ 65
+ge 64
+w 64
+pe 64
+_pr 63
+_po 63
+lo 62
+_à 62
+_à_ 62
+ue_ 61
+pl 61
+_i 61
+_- 61
+vi 61
+_des 60
+vo 60
+it_ 60
+na 60
+" 60
+me_ 60
+ent_ 60
+_L 59
+z 59
+-_ 59
+tio 58
+tion 58
+ien 58
+je 57
+des_ 56
+nn 56
+_-_ 55
+sur 55
+rt 55
+'es 55
+he 54
+ic 54
+pou 54
+k 53
+\xA9_ 53
+du 53
+ux 53
+_pou 53
+_je 53
+'est 53
+'est_ 53
+é_ 53
+ce_ 53
+di 52
+_B 52
+pour 52
+ec 52
+ant 52
+que_ 52
+im 51
+_pour 51
+un_ 51
+as_ 51
+_des_ 51
+_( 51
+da 51
+_sur 51
+_je_ 50
+_et 50
+je_ 50
+mai 50
+mi 50
+x_ 50
+_en_ 50
+pas 50
+!! 49
+rs_ 49
+_mo 49
+_et_ 49
+_pas 49
+_au 49
+_C 49
+_se 49
+_les 49
+? 49
+c_ 48
+o_ 48
+_A 48
+_D 48
+ac 48
+in_ 48
+fa 48
+pour_ 48
+_to 48
+sur_ 48
+_les_ 48
+va 47
+ous 47
+ré 47
+_!_ 47
+_sur_ 47
+eur 47
+_no 47
+se_ 47
+d_ 46
+ha 46
+os 46
+ni 46
+è 45
+ans 45
+\xA8 45
+ag 44
+ee 44
+men 44
+_a_ 43
+tu 43
+?_ 43
+tre 43
+_J 43
+av 43
+_S 42
+bo 42
+l' 42
+c' 42
+mp 42
+ol 42
+ire 42
+ot 42
+_l' 42
+_fa 41
+d' 41
+_pl 41
+bi 41
+c'es 41
+c'e 41
+_P 41
+y_ 41
+c'est 41
+ca 41
+_re 41
+du_ 41
+_que 41
+_so 40
+ait 40
+_c' 40
+_h 40
+ati 40
+ui_ 40
+par 40
+nte 40
+ion_ 40
+t\xC3 40
+ux_ 40
+ous_ 39
+_c'e 39
+lu 39
+nce 39
+ment 39
+_d' 39
+ul 39
+_un_ 39
+_vo 39
+_c'es 39
+ill 38
+_g 38
+_pas_ 38
+pas_ 38
+_me 38
+e, 38
+V 38
+ts 38
+con 38
+son 37
+ont 37
+ans_ 37
+/ 37
+H 37
+e,_ 37
+d\xC3 37
+_du 37
+_. 36
+ap 36
+am 36
+té 36
+fi 36
+rai 36
+_T 36
+ée 35
+_du_ 35
+_vi 35
Property changes on:
gate/trunk/plugins/Twitter/resources/lang_id/french-tweet.lm
___________________________________________________________________
Added: svn:executable
## -0,0 +1 ##
+*
\ No newline at end of property
Added: gate/trunk/plugins/Twitter/resources/lang_id/german-tweet.lm
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/german-tweet.lm
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/german-tweet.lm
2013-09-10 13:43:55 UTC (rev 16875)
@@ -0,0 +1,400 @@
+_ 9304
+e 3248
+n 1963
+i 1717
+r 1526
+t 1477
+a 1397
+s 1272
+h 953
+u 943
+l 856
+o 810
+d 806
+c 673
+er 644
+en 625
+m 617
+n_ 617
+g 597
+. 594
+ch 561
+e_ 477
+t_ 436
+; 435
+b 431
+r_ 423
+_; 414
+in 383
+ei 356
+: 329
+en_ 327
+de 325
+f 320
+k 314
+te 304
+_d 290
+.. 287
+s_ 284
+w 284
+er_ 279
+ie 278
+:_ 272
+st 265
+ge 264
+\xC3 259
+._ 237
+nd 232
+p 229
+S 226
+an 221
+ne 217
+z 213
+un 211
+_i 198
+h_ 192
+re 188
+ic 184
+he 178
+_a 178
+it 178
+be 177
+es 174
+m_ 174
+D 173
+ch_ 172
+_s 171
+- 171
+... 167
+_S 162
+le 162
+ich 161
+_m 161
+A 156
+ein 152
+au 150
+sc 148
+v 148
+is 148
+sch 146
+, 143
+B 143
+on 141
+,_ 139
+ng 137
+se 134
+_w 133
+_g 132
+el 131
+_e 131
+al 130
+d_ 128
+M 127
+as 127
+in_ 126
+ra 124
+ht 123
+;_ 120
+ü 120
+der 120
+\xBC 120
+ar 119
+_de 118
+K 116
+ha 114
+E 113
+F 113
+! 112
+_A 111
+W 110
+_u 109
+li 109
+or 109
+ri 109
+ie_ 108
+_n 107
+_: 107
+che 107
+G 106
+et 105
+at 104
+ut 104
+.._ 104
+_;_ 104
+eu 102
+di 101
+ti 101
+mi 101
+cht 99
+_D 98
+ns 98
+N 97
+ll 97
+_h 96
+_B 96
+ss 95
+ine 95
+l_ 94
+st_ 94
+_b 94
+nd_ 94
+und 93
+..._ 93
+_un 90
+gen 89
+la 89
+us 89
+P 89
+me 88
+_F 88
+T 88
+_M 88
+_v 87
+_K 86
+der_ 86
+g_ 86
+L 84
+nt 83
+rt 83
+ich_ 82
+uf 80
+te_ 79
+we 79
+ur 79
+I 78
+ma 77
+) 77
+o_ 76
+!_ 76
+_W 76
+ta 75
+ig 75
+_- 74
+ä 74
+\xA4 74
+eine 73
+den 73
+nde 73
+R 73
+H 73
+_ge 73
+_G 72
+nn 72
+tz 71
+_k 71
+it_ 70
+_di 70
+y 69
+_mi 69
+hr 69
+_au 69
+_f 69
+ten 68
+am 68
+ir 68
+V 68
+da 68
+ung 68
+il 68
+si 68
+ste 67
+_ei 67
+ht_ 67
+-_ 67
+ni 67
+ab 66
+rs 66
+as_ 65
+em 65
+eh 65
+die 65
+ist 65
+_. 64
+om 63
+und_ 63
+.... 63
+ro 62
+_P 62
+ter 62
+u_ 62
+_ein 62
+auf 61
+tt 61
+_-_ 61
+? 61
+ne_ 60
+ac 60
+_E 60
+)_ 60
+_N 59
+wi 59
+_in 59
+_und 59
+ag 58
+on_ 58
+" 58
+_und_ 58
+vo 57
+im 57
+ts 57
+..... 57
+ke 56
+na 56
+_die 55
+_:_ 55
+_H 55
+ol 55
+sche 55
+cht_ 55
+_der 55
+uc 55
+_da 55
+ze 54
+f_ 54
+and 54
+um 54
+ue 54
+a_ 54
+ber 54
+_der_ 54
+mit 54
+_in_ 54
+icht 53
+_L 53
+_be 53
+eb 53
+to 53
+_T 53
+O 53
+eg 52
+_ha 52
+ve 52
+lt 52
+ck 51
+hen 51
+uch 51
+C 51
+zu 51
+_z 51
+oc 50
+eit 50
+ier 50
+es_ 50
+die_ 50
+j 49
+mm 49
+tr 49
+_vo 49
+ere 48
+_is 48
+_die_ 48
+kt 47
+den_ 47
+rd 47
+ed 47
+tu 46
+?_ 46
+so 46
+ah 45
+ka 45
+rg 45
+( 45
+ten_ 45
+ein_ 45
+ren 45
+mit_ 45
+ach 45
+rn 44
+sse 44
+nen 44
+U 44
+n. 43
+_mit 43
+_wi 43
+ot 43
+wa 43
+lo 43
+_ist 43
+hl 43
+ist_ 43
+_mit_ 43
+nge 43
+hi 43
+_auf 42
+du 42
+_V 42
+_I 42
+i_ 41
+och 41
+Ne 41
+ad 41
+_l 41
+_zu 41
+end 40
+Sc 40
+fe 40
+\xBCr 40
+ür 40
+em_ 40
+_an 39
+Sch 39
+_( 39
+io 39
+ine_ 39
+_si 39
+ng_ 39
+_ma 39
+ers 39
+ho 38
+uf_ 38
+_sc 38
+chen 38
+_ist_ 38
+an_ 38
+f\xC3 38
+_ic 38
+De 38
+_ich 38
+_sch 38
+eue 37
+ger 37
+gen_ 37
+im_ 37
+ls 37
+ec 37
+_Sc 37
+al_ 36
+_ich_ 36
+ru 36
+eut 36
+nu 36
+lle 36
+\xB6 36
+_Sch 36
+ö 36
+hen_ 35
+_we 35
+x 35
+pr 35
+D_ 35
+_._ 35
+um_ 34
+nen_ 34
+auf_ 34
+nk 34
+das 34
+J 34
+_eine 34
+fü 34
+os 34
+ver 34
+_R 34
+_das 34
+b_ 34
+e. 34
+St 34
+eine_ 33
+ba 33
+icht_ 33
+ben 33
+\xE2 33
Property changes on:
gate/trunk/plugins/Twitter/resources/lang_id/german-tweet.lm
___________________________________________________________________
Added: svn:executable
## -0,0 +1 ##
+*
\ No newline at end of property
Added: gate/trunk/plugins/Twitter/resources/lang_id/spanish-tweet.lm
===================================================================
--- gate/trunk/plugins/Twitter/resources/lang_id/spanish-tweet.lm
(rev 0)
+++ gate/trunk/plugins/Twitter/resources/lang_id/spanish-tweet.lm
2013-09-10 13:43:55 UTC (rev 16875)
@@ -0,0 +1,400 @@
+_ 10306
+a 2580
+e 2572
+o 1805
+s 1434
+n 1316
+i 1295
+r 1218
+l 1029
+t 908
+d 838
+u 790
+a_ 780
+c 755
+e_ 735
+o_ 619
+m 585
+s_ 569
+p 475
+. 466
+_e 418
+; 416
+_; 410
+en 389
+n_ 383
+es 365
+_d 365
+\xC3 338
+de 334
+er 318
+_l 303
+ue 284
+_a 281
+_p 281
+as 281
+_de 270
+_c 268
+v 267
+h 263
+la 258
+b 250
+ar 247
+_s 244
+g 240
+os 231
+l_ 227
+.. 224
+de_ 222
+ra 222
+_m 217
+y 216
+an 214
+q 212
+._ 212
+ta 209
+on 208
+_de_ 203
+al 196
+qu 193
+_t 187
+_q 185
+, 184
+te 184
+re 183
+co 177
+;_ 176
+,_ 175
+! 175
+do 173
+_;_ 173
+_qu 170
+el 170
+os_ 170
+r_ 169
+_la 169
+as_ 168
+que 163
+ue_ 162
+no 160
+nt 160
+ie 160
+: 157
+_que 155
+st 155
+f 153
+que_ 152
+to 151
+en_ 151
+D 149
+_que_ 146
+or 145
+lo 144
+ad 142
+_es 141
+j 141
+ca 141
+ci 139
+es_ 138
+na 136
+me 136
+la_ 136
+ro 135
+_n 134
+_en 131
+E 130
+le 130
+y_ 130
+_v 126
+_co 125
+pa 124
+_h 122
+ti 120
+da 120
+A 119
+un 119
+in 118
+ha 116
+el_ 116
+_la_ 115
+_a_ 114
+:_ 114
+... 110
+se 110
+_y 108
+si 108
+do_ 106
+ri 106
+i_ 103
+ma 103
+_en_ 103
+ic 102
+!_ 102
+ia 100
+ne 100
+ac 99
+mi 98
+? 98
+S 97
+nd 97
+.._ 97
+so 91
+sa 91
+M 90
+_: 88
+_el 87
+ja 87
+..._ 87
+is 86
+id 85
+ra_ 85
+_no 85
+est 84
+con 84
+di 83
+mo 82
+_el_ 82
+C 81
+_me 80
+tr 80
+_f 80
+ce 80
+it 79
+_pa 79
+T 79
+í 78
+\xAD 78
+po 78
+_u 77
+pe 77
+\xA1 76
+ent 76
+ien 76
+vi 76
+N 75
+om 74
+_y_ 74
+_lo 74
+_ha 74
+al_ 73
+x 73
+rt 72
+no_ 71
+_se 71
+ec 70
+to_ 69
+am 69
+io 69
+_un 69
+z 69
+P 69
+_con 69
+ve 68
+ab 67
+á 67
+em 67
+me_ 67
+pr 66
+li 66
+L 66
+aj 66
+ro_ 65
+ol 64
+_i 64
+_est 64
+O 64
+ir 63
+lo_ 62
+te_ 62
+on_ 60
+sta 60
+par 60
+?_ 59
+ta_ 59
+_r 59
+im 58
+_A 58
+ch 58
+!! 58
+w 58
+nc 58
+an_ 58
+_si 58
+_E 57
+ll 57
+ga 57
+_M 57
+k 56
+\xB3 56
+ñ 56
+va 56
+ó 56
+\xB1 56
+ni 56
+I 55
+D_ 55
+aja 55
+) 55
+_C 55
+il 55
+_te 54
+_:_ 54
+oo 54
+_ca 54
+las 54
+B 54
+ado 54
+_S 53
+ba 52
+ar_ 52
+_me_ 52
+é 51
+na_ 51
+_no_ 51
+\xA9 51
+cu 51
+er_ 51
+R 50
+nte 50
+at 49
+ndo 49
+ero 49
+_o 49
+_par 49
+)_ 49
+et 48
+mp 48
+ui 48
+tra 48
+_pe 47
+ot 47
+_po 47
+com 47
+_al 47
+gu 47
+vo 46
+pu 46
+un_ 46
+res 46
+_b 46
+las_ 46
+r\xC3 46
+s. 46
+los 45
+ho 45
+per 45
+go 45
+" 45
+i\xC3 45
+_las 44
+_x 44
+jaj 43
+_P 43
+_di 43
+_un_ 43
+se_ 43
+_las_ 43
+F 43
+_g 42
+_ma 42
+fi 42
+jaja 42
+ur 42
+cia 42
+d_ 41
+_mi 41
+ev 41
+H 41
+ara 41
+sp 41
+a\xC3 41
+DD 40
+_ve 40
+\xADa 40
+los_ 40
+a. 40
+da_ 40
+_com 40
+ía 40
+be 39
+ndo_ 39
+U 39
+Y 39
+ea 38
+era 38
+ooo 38
+ica 38
+su 38
+and 38
+xD 38
+_pr 38
+ero_ 38
+_re 38
+_. 37
+_vi 37
+_los 37
+_xD 37
+us 37
+uc 37
+or_ 37
+_T 37
+_so 36
+_es_ 36
+he 36
+pi 36
+bi 36
+añ 36
+ado_ 36
+ier 36
+_j 36
+ed 36
+nos 36
+_los_ 36
+oy 36
+oc 35
+\xB1a 35
+tu 35
+si_ 35
+ng 35
+ua 35
+ña 35
+\xB3n 35
+ón 35
+ant 35
+- 35
+rm 35
+_pu 35
+o, 34
+ene 34
+rr 34
+para 34
+rd 34
+_B 34
+G 34
+ss 34
+o,_ 34
+aci 33
+_ta 33
+_se_ 33
+_per 33
+_D 33
+ter 33
+_lo_ 33
+nta 33
+tar 33
+ver 33
+ns 33
+!!_ 32
+\xC2 32
+s, 32
+( 32
+con_ 32
+ara_ 32
+oooo 32
+ig 32
+one 32
+ió 31
+go_ 31
+pre 31
+ada 31
+_con_ 31
Property changes on:
gate/trunk/plugins/Twitter/resources/lang_id/spanish-tweet.lm
___________________________________________________________________
Added: svn:executable
## -0,0 +1 ##
+*
\ No newline at end of property
Modified: gate/trunk/plugins/Twitter/resources/twitie-en.xgapp
===================================================================
--- gate/trunk/plugins/Twitter/resources/twitie-en.xgapp 2013-09-10
11:23:07 UTC (rev 16874)
+++ gate/trunk/plugins/Twitter/resources/twitie-en.xgapp 2013-09-10
13:43:55 UTC (rev 16875)
@@ -121,7 +121,14 @@
<resourceName>Tweet Language Identification</resourceName>
<initParams class="gate.util.persistence.MapPersistence">
<mapType>gate.util.SimpleFeatureMapImpl</mapType>
- <localMap />
+ <localMap>
+ <entry>
+ <string>configURL</string>
+ <gate.util.persistence.PersistenceManager-URLHolder>
+ <urlString>$relpath$lang_id/default-names.conf</urlString>
+ </gate.util.persistence.PersistenceManager-URLHolder>
+ </entry>
+ </localMap>
</initParams>
<features class="gate.util.persistence.MapPersistence">
<mapType>gate.util.SimpleFeatureMapImpl</mapType>
This was sent by the SourceForge.net collaborative development platform, the
world's largest Open Source development site.
------------------------------------------------------------------------------
How ServiceNow helps IT people transform IT departments:
1. Consolidate legacy IT systems to a single system of record for IT
2. Standardize and globalize service processes across IT
3. Implement zero-touch automation to replace manual, redundant tasks
http://pubads.g.doubleclick.net/gampad/clk?id=51271111&iu=/4140/ostg.clktrk
_______________________________________________
GATE-cvs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gate-cvs
