The problem is,  that mysql disallows to store Double.POSITIVE_INFINITY or
Double.NEGATIVE_INFINITY values.

But how can I fix it? I didn't do any special configuration in nutch.

Does anybody have the same problem?





2013/12/30 flo @ <[email protected]>

> When I crawl with nutch 2.2.1 (mysql backend) the exception : "Unknown
> column 'Infinity' in 'field list'" sometimes occurs. Does somebody know
> what is this about?
>
>
> java.io.IOException: java.sql.BatchUpdateException: Unknown column
> 'Infinity' in 'field list'
> at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:340)
>  at
> org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:65)
> at
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
>  at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:202)
>  at org.apache.nutch.crawl.DbUpdateReducer.reduce(DbUpdateReducer.java:39)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:177)
>  at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
>  at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398)
> Caused by: java.sql.BatchUpdateException: Unknown column 'Infinity' in
> 'field list'
>  at
> com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2028)
> at
> com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1451)
>  at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:328)
> ... 9 more
> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
> Unknown column 'Infinity' in 'field list'
>  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>  at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
> at com.mysql.jdbc.Util.getInstance(Util.java:386)
>  at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
>  at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
> at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
>  at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
> at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
>  at
> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
> at
> com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
>  at
> com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1980)
> ... 11 more
>

Reply via email to