On 5/27/21 7:45 AM, Philip Semanchuk wrote:

On May 26, 2021, at 10:04 PM, Rob Sargent <robjsarg...@gmail.com> wrote:



On May 26, 2021, at 4:37 PM, Ian Harding <harding....@gmail.com> wrote:


There is an option to send the logs to cloudwatch which makes it less awful to 
look at them.
I have that but precious little of interest there. Lots of autovac, a 
smattering of hints to increase wal size!?  I have yet to spot anything which 
corresponds to the “I/O failure” which the middle ware gets.

I don’t have query logging on, but I do see reports from my psql session 
fat-fingering.

As to the logs UI, the search is pretty feeble; I don’t understand why there 
are four  channels of logs; the graphs are wearing the same rose-coloured as 
the logs.
And 24 hours without a peep from AWS support. (I don’t call mailing me what I 
sent them “contact”.)

My guess right now is that the entire tomcat connection pool is in a single 
transaction? That’s the only way the tables could disappear.  I am making 
separate calls to JDBC getConnection () for each doPost.
We used Aurora (AWS hosted Postgres) and I agree that Cloudwatch search is 
pretty limited. I wrote a Python script to download cloudwatch logs to my 
laptop where I can use proper tools like grep to search them. It’s attached to 
this email. It’s hacky but not too terrible. I hope you find it useful.

Cheers
Philip


I may have found another difference: JDBC connections are not logged?!
I just reproduce my report, and the CloudWatch view of the logs shows some psql interaction from before and after the test, but no mention of losing 7.5M records.

Reply via email to