Revision: 10341
http://sourceforge.net/p/languagetool/code/10341
Author: dnaber
Date: 2013-06-29 13:01:49 +0000 (Sat, 29 Jun 2013)
Log Message:
-----------
skip matches where the context is > 255 chars to avoid MySQL error on insert
Modified Paths:
--------------
trunk/languagetool/languagetool-wikipedia/src/main/java/org/languagetool/dev/wikipedia/DatabaseDumpHandler.java
Modified:
trunk/languagetool/languagetool-wikipedia/src/main/java/org/languagetool/dev/wikipedia/DatabaseDumpHandler.java
===================================================================
---
trunk/languagetool/languagetool-wikipedia/src/main/java/org/languagetool/dev/wikipedia/DatabaseDumpHandler.java
2013-06-29 12:42:09 UTC (rev 10340)
+++
trunk/languagetool/languagetool-wikipedia/src/main/java/org/languagetool/dev/wikipedia/DatabaseDumpHandler.java
2013-06-29 13:01:49 UTC (rev 10341)
@@ -112,7 +112,12 @@
}
prepSt.setString(4, rule.getDescription());
prepSt.setString(5, StringUtils.abbreviate(match.getMessage(), 255));
- prepSt.setString(6, contextTools.getContext(match.getFromPos(),
match.getToPos(), text));
+ final String context = contextTools.getContext(match.getFromPos(),
match.getToPos(), text);
+ if (context.length() > 255) {
+ // let's skip these strange cases, as shortening the text might
leave us behind with invalid markup etc
+ continue;
+ }
+ prepSt.setString(6, context);
prepSt.setDate(7, dumpSqlDate);
prepSt.setDate(8, nowDate);
prepSt.setString(9, URL_PREFIX.replaceAll(LANG_MARKER, langCode) +
title);
This was sent by the SourceForge.net collaborative development platform, the
world's largest Open Source development site.
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
Languagetool-commits mailing list
Languagetool-commits@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/languagetool-commits
