All, good day. Here is the issue I have. My entire application is running on ModPerl/Apache environment. I send Http::Request with data load from my App server to a dispatch server thru LWP::UserAgent, I set the timeout 600 seconds.
The dispatch server is supposed to manipulate the data and send the data to an external SFTP server. Because the SFTP can fail, it will keep trying up to 4 times with 30 seconds sleep in case that SFTP connection fails. Recently, I found that I uploaded the file twice sometimes. I figured out the root cause is that my Dispatch server returns 'failure' at 6 minutes while it keeps trying to do the SFTP. The App server received HTTP::Response with error status so it issued another call to send data. It turns out I uploaded the identified file twice. Anybody has this sort of experience? Why does the dispatch server return 'error' while it still processes the data? Thanks a lot, Joseph
