Hello,

 

when running a MR-Job reading from HBase with a JDBC output writing to a
RDBMS, this uses JDBC batch operations. The accumulated batch is then
executed and committed in DBRecordWriter.close. Obviously, this can end
up in Heap Space problems when processing large amount of HBase rows.

 

Is there a property to configure the executeBatch and commit interval
somewhere?

 

Thanks,

Thomas

 

Reply via email to