Folks,
If you need to migrate data - and perform value / schema / field transformations - which you typically do need to do when migrating data across releases, then Meta-Update is your only choice. Meta-Update can also of-course can do simple one to one deltas but it's true power comes with its ability to move and transform data across different fields, records, or schemas. That allows us to automate complex migrations like ITSM 5 to 7, like ITSM 7.1 to 7.6, like customer bespoke data bases into ITSM 7.6, etc. It also allows us to automate the data cleansing needed for such migrations. >From one of our customers: "We had a mammoth task of migrating 400+ companies from ITSM 5.5 to ITSM 7.1. "Initially this task looked very complicated as the 5.5 system was highly customized to suit individual customer's requirements and the migration into mismatched schemas looked impossible. "1500 SLAs for these customers added to the complications. "But when we started evaluating Meta-Update, we saw some light. "We can now migrate SLAs, implement complicated transformation rules, stamp mapping values by looking up external configuration files, read from multiple servers, etc. " This customer wrote all their own migration scripts after an hour training and a set of sample scripts. Interestingly, this customer is now looking at another migration this time to 7.6.0x. Please check out our website for more information www.softwaretoolhouse.com or Contact Us to learn more. Cheers Ben Chernys Senior Software Architect Software Tool House Inc. Canada / Deutschland / Germany Mobile: +49 171 380 2329 GMT + 1 + [ DST ] Email: <mailto:ben.cher...@softwaretoolhouse.com> ben.cher...@softwaretoolhouse.com Web: <http://www.softwaretoolhouse.com/> www.softwaretoolhouse.com Check out Software Tool House's free Diary Editor. Meta-Update, our premium ARS Data tool, lets you automate your imports, migrations, in no time at all, without programming, without staging forms, without merge workflow. <http://www.softwaretoolhouse.com/> http://www.softwaretoolhouse.com/ From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Ali A. Musa Sent: February-01-11 07:15 To: arslist@ARSLIST.ORG Subject: Re: Delta Data Migration tool (was Long running ITSM 7.6 upgrade) ** Create-date can be index since its static value that initiated the first time. But, modified-date is a dynamic filed that changes any time there is update on the record which need huge storage to keep the index and sometimes you will end with indexed for un-identified row and/or huge process of delete and insert of index which affect the performance. You may try the Fast-Export utility (i.e. 1000-row per minute that is 60000 per hour) the utility is published at: http://communities.bmc.com/communities/docs/DOC-11866 Fast-Export is a migration utility that copy a data of a schema or a list of schemas from server to server for an identical schemas (schema-to-schema) or as a normal export utility (schema-to-file) send output to (.arx/.csv) file that can be imported by Remedy Import. Fast-Export designed based on the concept to repeatedly read the schema rows in a sequential order. The logic initiated to read the schema in forward or backward sequence of order. Users for backward or forward sequence can initiate the START-Read, to identify the starting point of the browse, and terminated with the END-Read. Ease-of-use facilitated with .NET window client which was developed to help users to access through a GUI, it was developed using the feature of .NET/C# so that to be executed as Windows (future Web-Based) and valid to access BMC-Remedy releases AR3-7. To use it: 1) Unzip the zipped file, 2) It generate a folder call FastExport 3) Run: FastDotNet.exe From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Guillaume Rheault Sent: Tuesday, February 01, 2011 12:21 AM To: arslist@ARSLIST.ORG Subject: Re: Delta Data Migration tool (was Long running ITSM 7.6 upgrade) ** 100K records per hour is not a lot, it's actually pretty low.... With database links, I can do 2 million records per hour, and this is by dumping all the records from one table to the other which involves a full table scan (so not dealing with deltas here) I would hope that in ITSM 7.6.4, the Create date and Modified Date were indexes out of the box. I am sure that indexing these fields would improve performance dramatically by avoiding all the full table scans. Guillaume _____ From: Action Request System discussion list(ARSList) [arslist@ARSLIST.ORG] on behalf of Roger Justice [rjust2...@aol.com] Sent: Monday, January 31, 2011 4:09 PM To: arslist@ARSLIST.ORG Subject: Re: Delta Data Migration tool (was Long running ITSM 7.6 upgrade) ** When I used it I did not make any new indexes and I was able to move, on a good network, over 100K records per hour. -----Original Message----- From: Guillaume Rheault <guilla...@dcshq.com> To: arslist <arslist@ARSLIST.ORG> Sent: Mon, Jan 31, 2011 3:57 pm Subject: Delta Data Migration tool (was Long running ITSM 7.6 upgrade) ** Hi David, Will the Create Date and Modified Date(field IDs 3 and 6) need to be indexed in all the forms in the source system, so the delta data migration tool can quickly fetch the entries created or updated from a specific timestamp, to migatre the delta data into the new production system? Guillaume _____ From: Action Request System discussion list(ARSList) [ <mailto:arslist@ARSLIST.ORG> arslist@ARSLIST.ORG] on behalf of Easter, David [ <mailto:david_eas...@bmc.com> david_eas...@bmc.com] Sent: Sunday, January 30, 2011 11:50 AM To: <mailto:arslist@ARSLIST.ORG> arslist@ARSLIST.ORG Subject: Re: Long running ITSM 7.6 upgrade Two recent capabilities are intended to assist with these kind of situations. 1. The ITSM Preconfigured Suite Stack Installer. The Suite Stack Installer (SSI) enables a fresh install of the entire ITSM Suite to be installed in an hour or two. All of the applications and configurations are pre-loaded in a DB image provided by BMC - so the installer need only lay down the binaries and copy the DB image into an empty DB instance provided by you. Time has been reduced from up to 60 hours down to 1-2 hours for a fresh install. While the SSI cannot be used for upgrades, it is good for creating a staging, development or POC system. 2. Delta Data Migration. The ITSM Suite 7.6.04 includes utilities that enable you to migrate data from your production environment to a staging/development server until you are ready to switch over from development to production. Basically, you'll create a parallel system in staging/development that will eventually become your production server. When your maintenance window arrives, you can bring down both systems, transfer the last bit of user data (which should be only a couple of hours or, at most days) and then bring up the staging server as your new production server. Downtime has been reduced to 4 hours or less using this methodology. -David J. Easter Manager of Product Management, Remedy Platform BMC Software, Inc. The opinions, statements, and/or suggested courses of action expressed in this E-mail do not necessarily reflect those of BMC Software, Inc. My voluntary participation in this forum is not intended to convey a role as a spokesperson, liaison or public relations representative for BMC Software, Inc. _attend WWRUG11 <http://www.wwrug.com/> www.wwrug.com ARSlist: "Where the Answers Are"_ _attend WWRUG11 www.wwrug.com ARSlist: "Where the Answers Are"_ _attend WWRUG11 www.wwrug.com ARSlist: "Where the Answers Are"_ _attend WWRUG11 www.wwrug.com ARSlist: "Where the Answers Are"_ _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug11 www.wwrug.com ARSList: "Where the Answers Are"