OK, I've got a doosie! I've tested sending an e-mail that will create a change request ticket and it has worked just fine - several times.
Last Friday, before I went out of town, I sent a test and it appeard to have stopped the e-mail service (no notifications were going out at all) and I didn't find out untill Monday afternoon. In that time, it created tickets and sent notifications for the same e-mail 2000+ times!! These notifications went to a group of about 20 people!! I do not know how it was stopped, because I was out of town and my boss did it. Now I've retested this morning and it has created and sent notifications about 20+ times and does not appear to be ending (although they seem less frequent). The only difference I can tell between the tests that worked and the ones that are spawns of Satan, is that I requested that one of our techs set up his ESP job-abend monitoring software to send the e-mail from his system to the aradmin e-mail address. His jobs failed, and afterward my tests went hay-wire! Anyone have any suggestions? I have no idea what's going on and have tried to contact Remedy support but so far havent heard from them. I cannot see anything unusual in any logs, do not see any unusual processes running, etc. Remedy 6.3 CANNOT FIGURE OUT HOW TO STOP IT! Even bounced the server and they're still coming. The timestamp in the return (confirmation) email shows the tickets created seconds appart, even though it's hours later and they're just showing up in Remedy and the confirmation/notification e-mails are timestamped the actual time (hours/days later). I am only passing required fields and summary/details --- This is the email I send: Schema: CHG:Change Server: REME-AK-FIS Login: randleslisa Password: xxxxxxxxxx Action: Submit !Summary!: Job ED372C has failed with abend CCFAIL. !Description!: Job ED372C in application ED372C gen# 627 has failed. The JES job# is 752 which started at 08.05 2006NOV15. The agent (if applicable) is . !Job Name!: ED372C !Category!: Configuration !Type!: Job Failure !Item!: Abend !Case Type!: Incident !Status!: New !Priority!: Low !240000005!: REMESP !240000001!: REMESP !Source!: Email !Business Justification!: Defect !Impact!: Low !Supervisor Group+!: AK-FIS-OPS !Emergency!: Yes This is a copy of the “return” e-mail I get after the ticket is created: Instruction: Submit Instruction Number: 1 Instruction Template: Change ID+: CHG0611150037 Submitted For: randleslisa Create-date: Nov 15, 2006 9:59:22 AM Assignee Login Name: Last-modified-by: randleslisa Modified-date: Nov 15, 2006 9:59:22 AM Status: Assigned Summary: THIS IS ONLY A TEST Job SWESP9TS has failed with abend JCLERROR. 15: New randleslisa Nov 15, 2006 9:59:22 AM Assigned randleslisa Nov 15, 2006 9:59:22 AM Business Justification: Defect zTmp_wGlobal_CostCategory: zTmp_Global_SLAExists: Migrate Data: zTmp Related Rec IDs: zTmpTuesdayStartTime1: zTmpHotlist1: Estimated Total Time: 0 zTmpWorkMinutes: zGTmpGroupMemberFlag: Service: Total Cost (Currency): zTmpHotlist2: zTmpShowMenuQual: zTmpSatEndTime: zTmpFridayEndTime: zTmpThurEndTime: zTmpWedEndTime: zTmpTuesdayEndTime: zTmpMondayEndTime: zTmpSundayEndTime: zTmpIntAutoStartTime: zTmpSatStartTime: zTmpFridayStartTime: zTmpThurStartTime: zTmpWedStartTime: zTmpFridayEndTime1: zTmpTuesdayStartTime: zTmpMondayStartTime: zTmpSundayStartTime: PDAWAPItem: Abend zTmp_wGlobal_CostType: PDAWAPType: Job Failure PDAWAPCategory: Configuration zTmpEnableRelateAssetsPrompt: Implementation Plan: Backout Plan: Test Plan: zTmpCheckCHGDPN: zTmpStatus: zTmpSignatureStatus: WIP Status: zTmpMondayEndTime1: WorkLog: zTmpAdministratorGroupMember: zTmpEscTimeToEscalate: zTmpCostRecCount: zTmpRelated_RecCount: SLA_TADOccurred_tmp: zTmpCheckingWhat?: zTmpHoliday: zTmpInt1: zTmpEnDisBtn: Application GUID: zTmpNonEmergencyApprProc: zTmpIntPlannedEndDate: zTmpEmergencyApprProc: zTmpIntPlannedStartDate: zTmpCurrentUsersByAssets: zTmpTotalUsersByAssets: zOffice: zTmpIntActualStartDate: zTmpReadUsrInfo: zTmpIntActualEndDate: zTmpParentInstanceID: zTmpAssignee listChunk: zTempIndividual: zTmpLastEntryId: zTmpRelationCreated: zTmpNumberOfMatches: zTmpMatchCounter: zYesNo: zTmpFridayStartTime1: zTmpLastCheck?: zTmpAssignee list: zSite: zTmpTaskStatus: zDelete_This_Field_Tmp_Global_StopOpenRel: zTmpMondayStartTime1: zTmpCurTime-Offset: Hotlist: No zTmpESCNotified: zTmpDefault Assignee: zTmpCheck: zTmpIgnore Workschedule?: zTmpAssign To First: zTmpIgnore Vacation?: zTmpIgnore Weekends?: zTmpIgnoreHolidays?: zTmpRule3: zTmpRule2: zTmpRule1: Target Level MgtChain: 0 zTmpAppSupportGroupMember: zTmpIntBusinessTimeOffsetHour: ShowOSParentChild: zTemp3: zTmpRtnValue: Auto-ReAssign_cb: zTmpEscalatedEnabled_sel: cboEnforceTSKDependency: Warning cboEnforceCHGDependency: Search Record Type: Create Record Type: Show: zTmpCreateFromServer: zTmpAudit: zTmpKeyword: MAINCHANGE zTmpAssetEntryID: zTmpCreateFromDescription: zTmpAssocEntryID: zTmpCreateFromLinkFld: zTmpCreateFromSchema: zTmpDescription: zRequesterLoginName: zTmpLinkField2: zTmpSchema2: zTmpItem: zTmpTaskCreated: zTmpLinkField1: zTmpType: zTmpSchema1: zTmpCategory: zTmpThurEndTime1: zTmpSchemaName: zTmpExternalQual: zDelete_This_Field_Tmp_Global_SchemaProperName-Asset: Office: Total Time Spent: 0 UsersbyAssetF: UsersbyLocF: zTmpAppManagementGroupMember: zTmpCostAlreadyAdded: zTempNoOfTasks: Class Id2: Total Cost: zTmpMgrPagingType: zTmpMgrPgFld2Flag: zTemp2: zTmpMgrPgFld1Flag: zTmpMgrPhoneFlag: zTmpPgFld2Flag: zTmpPgFld1Flag: zTmpPhoneFlag: zTmpMgrPageField2: zTmpShowRelatedKey: zTmpMgrPageField1: zTmpMgrPagerPhone: zTmpPageField2: Risks/Benefits Comments: zTmpPageField1: zTmpPagerPhone: zTCOCost: zTmpMgrParameter1: zTmpMgrParameter2: zTmpParameter2: zTmpParameter1: zTmpPagingType: zTmpMgrEmail: OSRelationshipSchemaName2: zTmpEmail: Cost Category: zTmpMgrPin: Cost Type: zTmpMgrPagerProviderConfig: zTmpThurStartTime1: zTmpMgrPagerCommand: zTmpMgrParameter: zTmpMgrPagerSoftwareVendor: SendPageMgr: zTmpParameter: Send Page: zTmpPin: zTmpPager Software Vendor: zTmpPagerCommand: Data Source: zTmpPager Provider Config: zTmpAssetTypeKeyword_glb: Health Reason: zDelete_This_Field_Tmp_Global_DisableCalc: Scope: Global Assignee Manager Full Name: William Blakely Supervisor Name+: Planned End Date: Topic: Planned Start Date: zTmpIntWeekDay: Audit: Pending: PDARegion: Closure Code: Request Urgency: Low Work Log: Nov 15, 2006 9:59:22 AM randleslisa This change will not require approval due to the fact that it is an emergency change. This installation is configured such that emergency changes are automatically approved. Description: Job SWESP9TS in application SWESP9TS gen# 86 has failed. The JES job# is 518 which started at 07.48 2006NOV15. The agent (if applicable) is . Supervisor Group+: AK-FIS-OPS PDASite: Requester Login Name+: REMESP PDADepartment: zTmpTasks?: Phone Number: Requester Name+: REMESP Requester ID+: Orig Submitter: randleslisa zTmpChangeInstalled: zTmpView: zTmpAppAdministratorGroupMember: zTmp_Global_IsAssetInstalled: zTmpSundayEndTime1: zTemp1: zTmpTaskWorkLog: zTmpShowRelated: zTmpQual: zTmpID2: zTmpID1: zPeopleEntryID: zRequesterID+: zDepartment: zPhoneNumber: zRegion: zRequesterName: zTmpTableEntryID: zSchemaProperName: Change Request zTmpWedEndTime1: zTmpUseEscBusHrs: Yes Health Status: On Target zTmpRelateAST: zTmpFieldLoc: zTmpholidayTag: Search Bar: zTmpworkdayTag: zTmpBusinessHrsTag: Confirm Resolution: zTmpField6: zTmpField5: zTmpField4: zTmpField3: OSRelationshipType: zTmpActionOnSubmit: zTmpSearchForPreDefinedKey: zTmpRappFilesPath: Groups Notification Address: zTmpGroupNotMethod: zTmpPrevGroupNotAddress: zTmpPrevGroupNotMethod: Request Manager to Reassign: No Auto-close Time: Auto-close Days: 10 zTmpMgrNotAddress: zTmpMgrNotMethod: zTmpReqNotAddress: zTmpReqNotMethod: zTmpSundayStartTime1: zTmpPrevAsgnNotAddress: zTmpPrevAsgnNotMethod: Escalated?: No zPrevGroupLogin: zPrevGroupID: zTmpField2: zTmpField1: zAssignedGroupID: 106 zAssigneeManagerID: 68104 Assignee Manager Login: blakelybarry zPrevAssigneeID: Prev Assignee Full Name: Prev Assignee Login: zAssigneeID: zTmpMgrCheck: zTmpWhereAmI: Notification Address: zTmpNotificationMethod: zApprovalProcessName: Error in Approval Process: zTmpCreate Record Type Keyword: zTmpDoesItExist: zTmpApprovalStatusDB: Dependent: zTmp_Global_cboEnforceCHGDependency: Approval Required?: Bypassed zTmpGlobalLicenseField: Additional Approver+: zTmpPickListAction: zSubmittingDependent: instanceId: AG001143DCC333SitbRQiNhdAAHwUA zTmpWedStartTime1: zOtherChangesSameOrder: Yes zDependencyNotification: WAP-Type: WAP Time Spent (min): 0 Actual Down Time: Priority: Low zTmpDependentChange: Level: zChangeRelationshipKeyChar: Region: Emergency: Yes Site: zTmpInstanceID2: Department: Item: Abend Type: Job Failure Category: Configuration Auto End Time: zCHGApprIDEntryID: zTmpCurDateTime: Auto Start Time: Sequence: 0 Impact: Low Risk: zTemp4: zTmpSchema: Time Fixed: Job Name: SWESP9TS Requester Manager: Contact Phone: Name: zTmpIntAutoEndTime2: zTmpDecBusinessTimeOffsetHour: Assignee Group: 482;481;480;3; zTmpSatEndTime1: SchemaName: CreateAssetType: zTmpUseBusinessHours: Combined Plans: BMC: zTmpUnits: zTmpTimeToEscalate: zTmpAsnProcessStatus: zTmpTuesdayEndTime1: Estimated Down Time: 0 Number of Tasks: Technical Risk: 1 (Lowest) Business Risk: 1 (Lowest) zTmp_Global_HelpDeskExist: zTmpInstanceID1: zScheduledThisTransaction: No Actual Start Date: Actual End Date: Actual Duration (in hours): Planned Duration (in hours): Plans: Approval Status: Not Required Requested Completion Date+: zTmpEscReqID: Change Type: Change Property Value: glbDefaultAssetView: zTmpCharBusinessTimeOffsetHour: zTmpDateTimeOnDisplay: zTmpSatStartTime1: -- View this message in context: http://www.nabble.com/%22Submit%22-email-creates-many%2C-many-CR-tickets-off-one-e-mail%21%21-tf2638720.html#a7365761 Sent from the ARS (Action Request System) mailing list archive at Nabble.com. _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:"Where the Answers Are"
