hi Eric,
It works now, thanks for your help.
regards,
Wzz
> Hi,
>
> Do you have dbAdmin.sh running in the background? From the stack trace, it
> looks like the ddatabase schema has not been created. It is probably cause
> by not having dbAdmin.sh running in the background to create partition table
> periodically. Long time ago, it was decided that we were moving data to
> HBase, hence dbAdmin.sh does not exist in Chukwa 0.4. You might need to copy
> dbAdmin.sh from Chukwa 0.3 tarball to schedule table creation in the
> background. Hope this helps.
>
> regards,
> Eric
>
> On Oct 23, 2011, at 8:26 PM, wzz wrote:
>
> > hi,
> > I followed http://incubator.apache.org/chukwa/docs/r0.4.0/admin.html to
> > install the chukwa. But chukwa could not save data into mysql. Whats the
> > problem? Here is the postprocess.log:
> >
> > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLException: Table 'chukwa.system_metrics_2181_week' doesn't exist
> > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:00,255 INFO pool-1-thread-2 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:00,255 INFO pool-1-thread-2 MetricDataLoader - Error
> > occurred in saving (systemmetrics,chukwa) 0 sec. numOfRecords: 3
> > 2011-10-20 20:28:00,257 INFO pool-1-thread-2 MetricDataLoader -
> > StreamName: Top_20111020_20_20.R.evt
> > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLException: Table 'chukwa.system_metrics_2181_week' doesn't exist
> > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:00,296 INFO pool-1-thread-3 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:00,297 INFO pool-1-thread-3 MetricDataLoader - Error
> > occurred in saving (systemmetrics,chukwa) 0 sec. numOfRecords: 9
> > 2011-10-20 20:28:00,297 INFO pool-1-thread-3 MetricDataLoader -
> > StreamName: Top_20111020_20_25.R.evt
> > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader - Batch
> > mode inserted=0records.
> > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader - Saved
> > (top,chukwa) 1 sec. numOfRecords: 317
> > 2011-10-20 20:28:01,552 INFO pool-1-thread-3 MetricDataLoader -
> > StreamName: chukwaAgent_20111020_20_20.R.evt
> > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader - Batch
> > mode inserted=0records.
> > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader - Saved
> > (top,chukwa) 1 sec. numOfRecords: 810
> > 2011-10-20 20:28:01,757 INFO pool-1-thread-2 MetricDataLoader -
> > StreamName: chukwaAgent_20111020_20_25.R.evt
> > 2011-10-20 20:28:01,875 ERROR pool-1-thread-3 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLException: Table 'chukwa.chukwaagent_2181_week' doesn't exist
> > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:01,876 INFO pool-1-thread-3 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:01,876 INFO pool-1-thread-3 MetricDataLoader - Error
> > occurred in saving (chukwaagent,chukwa) 0 sec. numOfRecords: 9
> > 2011-10-20 20:28:01,877 INFO pool-1-thread-3 MetricDataLoader -
> > StreamName: chukwaHttpSender_20111020_20_20.R.evt
> > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLException: Table 'chukwa.chukwaagent_2181_week' doesn't exist
> > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:01,995 INFO pool-1-thread-2 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:01,995 INFO pool-1-thread-2 MetricDataLoader - Error
> > occurred in saving (chukwaagent,chukwa) 0 sec. numOfRecords: 1
> > 2011-10-20 20:28:01,996 INFO pool-1-thread-2 MetricDataLoader -
> > StreamName: chukwaHttpSender_20111020_20_25.R.evt
> > 2011-10-20 20:28:02,193 ERROR pool-1-thread-3 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLException: Table 'chukwa.chukwahttpsender_2181_week' doesn't exist
> > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:02,194 INFO pool-1-thread-3 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:02,194 INFO pool-1-thread-3 MetricDataLoader - Error
> > occurred in saving (chukwahttpsender,chukwa) 0 sec. numOfRecords: 9
> > 2011-10-20 20:28:02,206 INFO pool-1-thread-3 MetricDataLoader -
> > StreamName: chunkQueue_20111020_20_20.R.evt
> > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLException: Table 'chukwa.chukwahttpsender_2181_week' doesn't exist
> > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:02,219 INFO pool-1-thread-2 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:02,219 INFO pool-1-thread-2 MetricDataLoader - Error
> > occurred in saving (chukwahttpsender,chukwa) 0 sec. numOfRecords: 1
> > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader - Batch
> > mode inserted=0records.
> > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader - Saved
> > (dfinerror,chukwa) 2 sec. numOfRecords: 9937
> > 2011-10-20 20:28:02,220 INFO pool-1-thread-2 MetricDataLoader -
> > StreamName: chunkQueue_20111020_20_25.R.evt
> > 2011-10-20 20:28:02,328 ERROR pool-1-thread-2 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLException: Table 'chukwa.chunkqueue_2181_week' doesn't exist
> > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader -
> > VendorError: 1146
> > 2011-10-20 20:28:02,329 INFO pool-1-thread-2 MetricDataLoader -
> > batchMode commit done
> > 2011-10-20 20:28:02,329 INFO pool-1-thread-2 MetricDataLoader - Error
> > occurred in saving (chunkqueue,chukwa) 0 sec. numOfRecords: 1
> > 2011-10-20 20:28:02,397 ERROR pool-1-thread-3 MetricDataLoader -
> > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week'
> > doesn't exist
> > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week'
> > doesn't exist
> > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571)
> > at
> > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.Executors
> > $RunnableAdapter.call(Executors.java:441)
> > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > 2011-10-20 20:28:02,405 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLException: Table 'chukwa.chunkqueue_2181_week' doesn't exist
> > 2011-10-20 20:28:02,405 ERROR pool-1-thread-3 MetricDataLoader -
> > SQLState: 42S02
> > 2011-10-20 20:28:02,406 ERROR pool-1-thread-3 MetricDataLoader -
> > VendorError: 1146
> >
>
