Because it took almost exactly 60 seconds, you can be assured that it was a connection timeout.
-----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Maglinger, Paul Sent: Tuesday, October 29, 2013 2:12 PM To: '[email protected]' Subject: [Exchange] RE: Remove DAG from environment Back to my original post and the errors therein. I tried creating a new database and added to an existing DAG (successful). Then I tried moving a mailbox over to it to see if maybe it would fix things or at least give me some more information to go on. The move errored out, and I expected it to because the replication service is going up and down, but some searches on this particular error mention NIC or network settings but without specifics. Would the replication service going up and down be caused by the socket connection error below or vice-versa. I'm trying to determine which end to start troubleshooting this from. The error when I try a local move is: Summary: 1 item(s). 0 succeeded, 1 failed. Elapsed time: 00:00:04 Quest, Jonny Failed Error: The call to 'net.tcp://telstar1.scvl.com/Microsoft.Exchange.MailboxReplicationService TELSTAR1.scvl.com (14.2.341.0 caps:07)' failed. Error details: The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:59.7650000'. --> The read operation failed, see inner exception. --> The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:59.7650000'. --> An existing connection was forcibly closed by the remote host. The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:59.7650000'. The read operation failed, see inner exception. The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:59.7650000'. An existing connection was forcibly closed by the remote host Click here for help... http://technet.microsoft.com/en-US/library/ms.exch.err.default(EXCHG.140).aspx?v=14.2.342.0&t=exchgf1&e=ms.exch.err.Ex8FE8AA Exchange Management Shell command attempted: 'scvl.com/Enterprise/Users/Quest, Jonny' | New-MoveRequest -TargetDatabase 'TEST' Elapsed Time: 00:00:04 -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Heaton, Joseph@Wildlife Sent: Tuesday, October 29, 2013 10:57 AM To: [email protected] Subject: [Exchange] RE: Remove DAG from environment Depends on what kind of replication you're doing with your VMDKs. If you're doing constant, block level replication, then the backup VMs should be pretty accurate. If not, then you'll still need to rely on backups to restore any incremental changes that had been made. I think you're still going to have missing messages, but you'll get close anyway. We're looking into the same type of DR strategy here. Joe Heaton Enterprise Server Support CA Department of Fish and Wildlife 1807 13th Street, Suite 201 Sacramento, CA 95811 Desk: (916) 323-1284 > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Maglinger, Paul > Sent: Tuesday, October 29, 2013 7:52 AM > To: '[email protected]' > Subject: [Exchange] RE: Remove DAG from environment > > Thanks guys. I appreciate the input. I've got some playing to do. > Based on this let me bounce something else off y'all... > > We're actively looking at revising our DR strategy to rely > considerably on restoration of VMs. If the environment described > below was virtualized and restored from VMDKs, then everything should > come up without problems, right? Anyone out there ever did it? Care to > share? > > -Paul > > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Michael B. Smith > Sent: Tuesday, October 29, 2013 7:51 AM > To: [email protected] > Subject: [Exchange] RE: Remove DAG from environment > > +1 > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Jump, Stewart > Sent: Monday, October 28, 2013 11:46 AM > To: '[email protected]' > Subject: [Exchange] RE: Remove DAG from environment > > Hi, > > I did this my self recently. From a setup with 4 DAGs and 4 CAS arrays > I only restored the 2 MBX servers running the DAG for one site. I did > a repair install of the 2 CAS/HUB servers that where in the same site. > For the restore I only did the system drive and then built new DB's as > I didn’t have the space for the live DB's. I had to delete one copy of > each DB from the DAG before it let me mount empty DB's and then add a > second copy to the DAG > > To clean out the rest I used adsi edit and started deleting the > databases, servers, receive connectors, cas array objects etc of the > dead servers from the configuration container. Not saying this is the > rights way but my test lab runs without lots of errors about missing > servers and is clean enough that I could install 2 new CAS/HUB/MBX > servers in a new DAG. I am left with lots of mailboxes with the > homemdb set wrong but that should be relatively easy to clean up as well. > > However this is a really dangerous way of sorting out the broken > servers unless you are happy to start from scratch if you delete the > wrong bit. Don’t try it unless you are happy playing with adsi edit in > the configuration container. The most important bit to get right is to > make sure you are on the test system. I set the background on the test > to a really bright colour so its obvious!. If you delete from live I > doubt you can get it working again if you even got the chance as you could be > marched out the door! > > Regards > Stewart > > > ********************************************************** > *********** > If you receive this e-mail in error, please contact +44 20 7280 5000. > The information contained in this e-mail and in the attachments if > any, is confidential. It must not be read, copied, disclosed, printed, > forwarded, relied upon or used by any person other than the intended > recipient. > Unauthorised use, disclosure or copying is strictly prohibited. > N M Rothschild & Sons Limited > Registered number 925279 > Registered in England at New Court, St Swithin's Lane, London EC4N 8AL > N M Rothschild & Sons Limited is authorised by the Prudential > Regulation Authority and regulated by the Financial Conduct Authority > and the Prudential Regulation Authority in the United Kingdom. > The firm reference number is 124451. > ********************************************************** > *********** > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Maglinger, Paul > Sent: 28 October 2013 15:00 > To: '[email protected]' > Subject: [Exchange] RE: Remove DAG from environment > > 10 VM servers: > 4 CAS/HUB > 4 MB > 2 CAS/HUB/MB > > 2 DAGs consisting of 2 MB and 1 CAS/HUB/MB each. > 2 CAAs consisting of 2 CAS/HUB each. > Each of the CAS/HUB/MB servers are for remote DR for the respective > DAGs. > > Both DAGs show up in the EMC. > > We want to restore just one DAG (with just 2 MB servers) and one CAA > into the development lab for testing. When we restored them we > noticed that we could access mailboxes and see the email, but when we > sent mail it would leave the outbox and disappear. I removed the > CAS/HUB/MB server from the DAG and Windows cluster we want to test > development on. All services are running on the remaining 2 MB > servers. Event viewer on the MB servers look good except for where > it's griping about getting to the MB servers that we didn't restore: > > Log Name: Application > Source: MSExchangeRepl > Date: 10/28/2013 8:32:59 AM > Event ID: 4065 > Task Category: Service > Level: Error > Keywords: Classic > User: N/A > Computer: COMSTAR1.scvl.com > Description: > The Microsoft Exchange Replication service sent a request to Hub > Transport server GENSTAR3 to resubmit messages for database HQMBDB > between time periods 10/25/2013 5:02:29 AM (UTC) and 10/25/2013 > 9:44:40 PM (UTC) failed. Error: Error 0x6ba (The RPC server is > unavailable) from SubmitDumpsterMessages > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 2 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 501 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 4 > EEInfo: prm[0]: Unicode string: ncacn_ip_tcp > EEInfo: prm[1]: Unicode string: GENSTAR3 > EEInfo: prm[2]: Long val: 1106639585 (0x41F5FAE1) > EEInfo: prm[3]: Long val: 1722 (0x000006BA) > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 1442 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 1 > EEInfo: prm[0]: Unicode string: GENSTAR3 > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 322 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 0 > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x00002AFC > EEInfo: Detection location: 320 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 1 > EEInfo: prm[0]: Unicode string: GENSTAR3 > > Event Xml: > <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event";> > <System> > <Provider Name="MSExchangeRepl" /> > <EventID Qualifiers="49156">4065</EventID> > <Level>2</Level> > <Task>1</Task> > <Keywords>0x80000000000000</Keywords> > <TimeCreated SystemTime="2013-10-28T13:32:59.000000000Z" /> > <EventRecordID>518878</EventRecordID> > <Channel>Application</Channel> > <Computer>COMSTAR1.scvl.com</Computer> > <Security /> > </System> > <EventData> > <Data>GENSTAR3</Data> > <Data>10/25/2013 5:02:29 AM</Data> > <Data>10/25/2013 9:44:40 PM</Data> > <Data>HQMBDB</Data> > <Data>Error 0x6ba (The RPC server is unavailable) from > SubmitDumpsterMessages > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 2 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 501 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 4 > EEInfo: prm[0]: Unicode string: ncacn_ip_tcp > EEInfo: prm[1]: Unicode string: GENSTAR3 > EEInfo: prm[2]: Long val: 1106639585 (0x41F5FAE1) > EEInfo: prm[3]: Long val: 1722 (0x000006BA) > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 1442 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 1 > EEInfo: prm[0]: Unicode string: GENSTAR3 > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x000006BA > EEInfo: Detection location: 322 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 0 > > EEInfo: ComputerName: n/a > EEInfo: ProcessID: 1936 > EEInfo: Generation Time: 2013-10-28 13:32:59.678 > EEInfo: Generating component: 18 > EEInfo: Status: 0x00002AFC > EEInfo: Detection location: 320 > EEInfo: Flags: 0 > EEInfo: NumberOfParameters: 1 > EEInfo: prm[0]: Unicode string: GENSTAR3 > </Data> > </EventData> > </Event> > > > > When I try to run the Queue viewer on TELSTAR1 to see where the > messages are going, I get: > > Exchange cannot connect to the Microsoft Exchange Transport service on > computer "TELSTAR1.scvl.com". Verify that the service is started. It > was running the command 'get-queue.... blah blah blah... > > And the Transport service is running on TELSTAR1. However, the Microsoft > Exchange Replication service on the CAA servers keep restarting. I > see the following in the event viewer: > > Log Name: Application > Source: MSExchange Mailbox Replication > Date: 10/28/2013 9:00:56 AM > Event ID: 1007 > Task Category: Service > Level: Warning > Keywords: Classic > User: N/A > Computer: TELSTAR1.scvl.com > Description: > The Mailbox Replication service was unable to determine the set of > active mailbox databases on a mailbox server. > Mailbox server: GENSTAR3.scvl.com > Error: MapiExceptionNetworkError: Unable to make admin interface > connection to server. (hr=0x80040115, ec=-2147221227) Diagnostic context: > ...... > Lid: 11672 dwParam: 0x6BA Msg: EEInfo: NumberOfParameters: 0 > Lid: 16280 dwParam: 0x6BA Msg: EEInfo: ComputerName: n/a > Lid: 8600 dwParam: 0x6BA Msg: EEInfo: ProcessID: 4428 > Lid: 12696 dwParam: 0x6BA Msg: EEInfo: Generation Time: 2013-10-28 > 14:00:56:695 > Lid: 10648 dwParam: 0x6BA Msg: EEInfo: Generating component: 18 > Lid: 14744 dwParam: 0x6BA Msg: EEInfo: Status: 11001 > Lid: 9624 dwParam: 0x6BA Msg: EEInfo: Detection location: 320 > Lid: 13720 dwParam: 0x6BA Msg: EEInfo: Flags: 0 > Lid: 11672 dwParam: 0x6BA Msg: EEInfo: NumberOfParameters: 1 > Lid: 8856 dwParam: 0x6BA Msg: EEInfo: prm[0]: Unicode string: > GENSTAR3.scvl.com > Lid: 24060 StoreEc: 0x80040115 > Lid: 23746 > Lid: 31938 StoreEc: 0x80040115 > Lid: 19650 > Lid: 27842 StoreEc: 0x80040115 > Lid: 20866 > Lid: 29058 StoreEc: 0x80040115 > Event Xml: > <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event";> > <System> > <Provider Name="MSExchange Mailbox Replication" /> > <EventID Qualifiers="32772">1007</EventID> > <Level>3</Level> > <Task>1</Task> > <Keywords>0x80000000000000</Keywords> > <TimeCreated SystemTime="2013-10-28T14:00:56.000000000Z" /> > <EventRecordID>897068</EventRecordID> > <Channel>Application</Channel> > <Computer>TELSTAR1.scvl.com</Computer> > <Security /> > </System> > <EventData> > <Data>GENSTAR3.scvl.com</Data> > <Data>MapiExceptionNetworkError: Unable to make admin interface > connection to server. (hr=0x80040115, ec=-2147221227) Diagnostic context: > ...... > Lid: 11672 dwParam: 0x6BA Msg: EEInfo: NumberOfParameters: 0 > Lid: 16280 dwParam: 0x6BA Msg: EEInfo: ComputerName: n/a > Lid: 8600 dwParam: 0x6BA Msg: EEInfo: ProcessID: 4428 > Lid: 12696 dwParam: 0x6BA Msg: EEInfo: Generation Time: 2013-10-28 > 14:00:56:695 > Lid: 10648 dwParam: 0x6BA Msg: EEInfo: Generating component: 18 > Lid: 14744 dwParam: 0x6BA Msg: EEInfo: Status: 11001 > Lid: 9624 dwParam: 0x6BA Msg: EEInfo: Detection location: 320 > Lid: 13720 dwParam: 0x6BA Msg: EEInfo: Flags: 0 > Lid: 11672 dwParam: 0x6BA Msg: EEInfo: NumberOfParameters: 1 > Lid: 8856 dwParam: 0x6BA Msg: EEInfo: prm[0]: Unicode string: > GENSTAR3.scvl.com > Lid: 24060 StoreEc: 0x80040115 > Lid: 23746 > Lid: 31938 StoreEc: 0x80040115 > Lid: 19650 > Lid: 27842 StoreEc: 0x80040115 > Lid: 20866 > Lid: 29058 StoreEc: 0x80040115</Data> > </EventData> > </Event> > > > Log Name: Application > Source: MSExchange Common > Date: 10/28/2013 9:00:57 AM > Event ID: 4999 > Task Category: General > Level: Error > Keywords: Classic > User: N/A > Computer: TELSTAR1.scvl.com > Description: > Watson report about to be sent for process id: 4428, with parameters: > E12, c- RTL-AMD64, 14.02.0342.002, MSExchangeMailboxReplication, > M.E.Data.Storage, > M.E.D.S.A.ActiveManagerImplementation.GetServerInformationForDatabas > eInternal, M.E.D.Storage.ObjectNotFoundException, 42f5, 14.02.0342.003. > ErrorReportingEnabled: False > Event Xml: > <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event";> > <System> > <Provider Name="MSExchange Common" /> > <EventID Qualifiers="16388">4999</EventID> > <Level>2</Level> > <Task>1</Task> > <Keywords>0x80000000000000</Keywords> > <TimeCreated SystemTime="2013-10-28T14:00:57.000000000Z" /> > <EventRecordID>897069</EventRecordID> > <Channel>Application</Channel> > <Computer>TELSTAR1.scvl.com</Computer> > <Security /> > </System> > <EventData> > <Data>4428</Data> > <Data>E12</Data> > <Data>c-RTL-AMD64</Data> > <Data>14.02.0342.002</Data> > <Data>MSExchangeMailboxReplication</Data> > <Data>M.E.Data.Storage</Data> > > <Data>M.E.D.S.A.ActiveManagerImplementation.GetServerInformationForD > atabaseInternal</Data> > <Data>M.E.D.Storage.ObjectNotFoundException</Data> > <Data>42f5</Data> > <Data>14.02.0342.003</Data> > <Data>False</Data> > <Data> > </Data> > </EventData> > </Event> > > GENSTAR3 is a CAS/HUB/MB used for remote DR and part of the other DAG > that we are not restoring in the development lab. > > So.... I'm trying to get rid of the all the stuff associated with the > servers we didn't restore in order to clean up the event logs and try > to troubleshoot where my email is going. That is, unless anyone sees > an easier way of doing this. > > Thanks everybody, > > Paul > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Michael B. Smith > Sent: Friday, October 25, 2013 8:00 PM > To: [email protected] > Subject: [Exchange] RE: Remove DAG from environment > > I think you are confusing your terms. > > Please state your topology in more details. > > Thank. > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Maglinger, Paul > Sent: Friday, October 25, 2013 4:44 PM > To: New Exchange List ([email protected]) > Subject: [Exchange] Remove DAG from environment > > Exchange 2010 SP 2 environment running on VMs consisting of 2 DAGs. > If we wanted to restore the VMs in our development environment, but > only have one of the DAGs, is there a way to remove the other DAG? > I can't see a way of doing it without having at least one member of > the other DAG up. > -Paul > > > > > >
