SAfik, What is the size in terms of the number of clients/loans that you are trying to migrate ? And for long did you wait at the Create Identifier column stage ? trying to understand if the tool just "hung up" for some reason.
It will be good if you can send me the excel sheet and the mifos config which you are using to migrate. Thanks Chetan -----Original Message----- From: Safik Omara [mailto:[email protected]] Sent: Wednesday, February 29, 2012 2:31 PM To: [email protected] Cc: [email protected] Subject: Re: [Mifos-users] Download a database error of DMT system hello, I want to ask about the import data using the DMT, the download is successful, the upload is successful, but when migrasidata process runs very slowly, here I attach a description of the process when the data migration process that I did not succeed. I hope to help solve this problem. Thank you very much. NFO - Preparing a staging database for the DMTorg.mifos.dmt.workflowTasks.PrepStaging INFO - Prepearing stage1 schema to begin migration DEBUG - Stage 1 prep started with -> C:/kettle/prepStaging.bat localhost root enter stage1 C:/kettle/dest.sql 3306 INFO - Initialising DMT propertiesorg.mifos.dmt.workflowTasks.DMTParamInjection INFO - loading data from excel to DMT stagingorg.mifos.dmt.serviceFactory.GenericKettleJobService INFO - Executing CreateIdentifierColumns On Feb 23, 11:45 am, Jayalaxmi Desai <[email protected]> wrote: > *Hi Safik, > > You can use the following command to avoid permgen out of memory, > > For ubuntu:you can start jetty using java -Xms768M -Xmx768M > -XX:MaxPermSize=256m -jar start.jar instead of java -jar start.jar > > For windows you need to set environmental variable for JAVA_OPTS as -Xms768M > -Xmx768M -XX:MaxPermSize=256m > > Hope this helps you.* > > Thanks and Regards, > Jaya > > > > > > > > On Thu, Feb 23, 2012 at 9:27 AM, Safik Omara <[email protected]> wrote: > > thanks for attachment instructions, I have another question, namely: > > how to cope with out of memory on a jetty server, because we currently > > use a web server jetty-7.3.1 and 2.2.3 versions mifos. When we run > > mifos sometimes occur message: permgen out of memory .. > > what could be a solution to solve this problem. > > Many thanks. > > > On 22 Feb, 16:53, <[email protected]> wrote: > > > Safik, > > > > Looks like you have not created the log database. Kindly follow the > > instructions in the attached DMT user manual. As part of the instructions, > > we have mentioned the various databases and other configurations required > > to be done before using the DMT. Creating the log database is required to > > enable the Kettle tool to log error and status messages. > > > > Thanks > > > Chetan > > > > -----Original Message----- > > > From: Safik Omara [mailto:[email protected]] > > > Sent: Wednesday, February 22, 2012 1:17 PM > > > To: [email protected] > > > Subject: Re: [Mifos-users] Download a database error of DMT system > > > > Here are the steps we migrate data in excel to mifos through DMT: > > > after data from the excel template localhost: 8080/dmt we download an > > > excel template and then we fill it, we upload to succeed, after the > > > migration process we upload and display an error message like the > > > following : > > > > INFO - Preparing a staging database for the > > > DMTorg.mifos.dmt.workflowTasks.PrepStaging > > > INFO - Prepearing stage1 schema to begin migration > > > DEBUG - Stage 1 prep started with -> C:/kettle/prepStaging.bat > > > localhost root enter stage1 C:/kettle/dest.sql 3306 > > > INFO - Initialising DMT > > > propertiesorg.mifos.dmt.workflowTasks.DMTParamInjection > > > INFO - loading data from excel to DMT > > > stagingorg.mifos.dmt.serviceFactory.GenericKettleJobService > > > INFO - Executing CreateIdentifierColumns > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateCenters > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateGroups > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateClients > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateIndividualClients > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateMeetings > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateIndividualClientMeetings > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateClientFamily > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateLoanAccounts > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateGroupLoans > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing MigrateCustomFields > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist org.pentaho.di.job.Job.beginProcessing(Job.java:842) > > > org.pentaho.di.job.Job.execute(Job.java:335) > > > org.pentaho.di.job.Job.run(Job.java:282) > > > INFO - Executing ExcelMigrateLoanFees > > > ERROR - A serious error occurred during job execution: Unable to begin > > > processing by logging start in logtable kettle_logs Couldn't execute > > > SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' doesn't > > > exist > > > ERROR - org.pentaho.di.core.exception.KettleJobException: Unable to > > > begin processing by logging start in logtable kettle_logs Couldn't > > > execute SQL: LOCK TABLES kettle_logs WRITE Table 'log.kettle_logs' > > > doesn't exist > > ... > > read more » > > ------------------------------------------------------------------------------ > Virtualization & Cloud Management Using Capacity Planning > Cloud computing makes use of virtualization - but cloud computing > also focuses on allowing computing to be delivered as a > service.http://www.accelacomm.com/jaw/sfnl/114/51521223/ > > _______________________________________________ > Mifos-users mailing list > [email protected]https://lists.sourceforge.net/lists/listinfo/mifos-users ------------------------------------------------------------------------------ Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ _______________________________________________ Mifos-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/mifos-users ------------------------------------------------------------------------------ Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ _______________________________________________ Mifos-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/mifos-users
