[ https://issues.apache.org/jira/browse/NUTCH-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970336#action_12970336 ]
Alexis commented on NUTCH-899: ------------------------------ I ran into the exact same issue, with MySQL. The blob column type can only store a string which length L is less than 2^16 = 65536 (not equal to) See http://dev.mysql.com/doc/refman/5.0/en/storage-requirements.html I believe you just need to decrement http.content.limit from 65536 to 65535 in conf/nutch-default.xml... > java.sql.BatchUpdateException: Data truncation: Data too long for column > 'content' at row 1 > ------------------------------------------------------------------------------------------- > > Key: NUTCH-899 > URL: https://issues.apache.org/jira/browse/NUTCH-899 > Project: Nutch > Issue Type: Bug > Components: storage > Affects Versions: 2.0 > Environment: ubuntu 10.04 > JVM : 1.6.0_20 > nutch 2.0 (trunk) > Mysql/HBase (0.20.6) / Hadoop(0.20.2) pseudo-distributed > Reporter: Faruk Berksöz > Priority: Minor > > wenn i try to fetch a web page (e.g. > http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html ) with mysql storage > definition, > I am seeing the following error in my hadoop logs. , (no error with hbase ) ; > java.io.IOException: java.sql.BatchUpdateException: Data truncation: Data too > long for column 'content' at row 1 > at org.gora.sql.store.SqlStore.flush(SqlStore.java:316) > at org.gora.sql.store.SqlStore.close(SqlStore.java:163) > at org.gora.mapreduce.GoraOutputFormat$1.close(GoraOutputFormat.java:72) > at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:567) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > The type of the column 'content' is BLOB. > It may be important for the next developments of Gora. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.