Slightly OT; Parsing DMARC reports
Hey all, Anyone here try to tackle translating DMARC reports into something readable? I know it's easy enough to convert the XML files into a structure, which could then be walked and stored. I was just curious if anyone had tried it. I'm using dmarcian.com and though their reports are nice, there are several aspects that are lacking. I'm thinking of building an app for myself that could email me human reports on a per-domain basis... 1. Receive the email 2. Grab the attached zip file and explode 3. Open the contained XML file 4. Convert the XML file to a structure 5. Loop through and DB any fails 6. Email a fail report showing record if there are any fails ... or something like that. Mik Michael Muller (413) 320-5336 http://MontagueWebWorks.com ** Powered by ROCKETFUSION ** Information is not knowledge Knowledge is not wisdom Eschew Obfuscation ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357926 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Slightly OT; Parsing DMARC reports
Hey all, Anyone here try to tackle translating DMARC reports into something readable? I know it's easy enough to convert the XML files into a structure, which could then be walked and stored. I was just curious if anyone had tried it. I'm using dmarcian.com and though their reports are nice, there are several aspects that are lacking. I'm thinking of building an app for myself that could email me human reports on a per-domain basis... 1. Receive the email 2. Grab the attached zip file and explode 3. Open the contained XML file 4. Convert the XML file to a structure 5. Loop through and DB any fails 6. Email a fail report showing record if there are any fails ... or something like that. Mik Michael Muller Admin, MontagueMA.net Website ...a project of MontagueWebWorks.com (413) 320-5336 http://www.MontagueMA.net Eschew Obfuscation ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357927 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Site hanging randomly.
So, here's a tricky one. I have a server that hangs seemingly randomly but around once a day. Windows Server 2008, IIS, ColdFusion 9. It will either return a 503 or the browser will just keep spinning and never return anything. When I go in to restart it (with a batch file) sometimes the ColdFusion 9 Application Server service takes a really long time to stop and sometimes the W3SVC service takes a long time. Where do I start diagnosing this? How can I find out what's hanging? Which windows info should I look at? ColdFusion? Thanks! ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357928 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Site hanging randomly.
Is the server responsive when CF hangs? Or is it a bit slow/unresponsive as well? I had some serious crash issues with CF9 64 bit a few years back and switched over to railo after trying to debug it for weeks without result. Make sure to check the windows logs if there are any weird events before CF hangs. My problem was mainly with JVM GC not doing its work properly and eventually kill CF. You could try to upgrade your JVM to a newer version that is officially supported, but not sure if that will help your issue (trialerror). Good luck! 2014-03-14 0:50 GMT+01:00 .jonah jonah@creori.com: So, here's a tricky one. I have a server that hangs seemingly randomly but around once a day. Windows Server 2008, IIS, ColdFusion 9. It will either return a 503 or the browser will just keep spinning and never return anything. When I go in to restart it (with a batch file) sometimes the ColdFusion 9 Application Server service takes a really long time to stop and sometimes the W3SVC service takes a long time. Where do I start diagnosing this? How can I find out what's hanging? Which windows info should I look at? ColdFusion? Thanks! ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357929 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Site hanging randomly.
I hadn't thought to check a static resource to see if it was still
available. I'll do that next time it hangs.
I'm currently running jdk1.6.0_32 with these JVM arguments:
-server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=512m
-XX:+UseParallelGC -Xbatch -Dsun.rmi.dgc.client.gcInterval=60
-Dsun.rmi.dgc.server.gcInterval=30
-Dcoldfusion.rootDir={application.home}/../
-Dcoldfusion.libPath={application.home}/../lib
The server has 6 Gb of ram and 4 CPU cores.
On 3/13/14 4:56 PM, Michael van Leest wrote:
Is the server responsive when CF hangs? Or is it a bit slow/unresponsive as
well?
I had some serious crash issues with CF9 64 bit a few years back and
switched over to railo after trying to debug it for weeks without result.
Make sure to check the windows logs if there are any weird events before CF
hangs. My problem was mainly with JVM GC not doing its work properly and
eventually kill CF.
You could try to upgrade your JVM to a newer version that is officially
supported, but not sure if that will help your issue (trialerror).
Good luck!
2014-03-14 0:50 GMT+01:00 .jonah jonah@creori.com:
So, here's a tricky one. I have a server that hangs seemingly randomly
but around once a day.
Windows Server 2008, IIS, ColdFusion 9.
It will either return a 503 or the browser will just keep spinning and
never return anything.
When I go in to restart it (with a batch file) sometimes the ColdFusion
9 Application Server service takes a really long time to stop and
sometimes the W3SVC service takes a long time.
Where do I start diagnosing this? How can I find out what's hanging?
Which windows info should I look at? ColdFusion?
Thanks!
~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357930
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Site hanging randomly.
have you checked the coldfusion server monitor ?
I would also suggest installed FusionReactor for some addiitonal monitoring.
check the coldfusion-out logs for issues.
On Fri, Mar 14, 2014 at 12:12 AM, .jonah jonah@creori.com wrote:
I hadn't thought to check a static resource to see if it was still
available. I'll do that next time it hangs.
I'm currently running jdk1.6.0_32 with these JVM arguments:
-server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=512m
-XX:+UseParallelGC -Xbatch -Dsun.rmi.dgc.client.gcInterval=60
-Dsun.rmi.dgc.server.gcInterval=30
-Dcoldfusion.rootDir={application.home}/../
-Dcoldfusion.libPath={application.home}/../lib
The server has 6 Gb of ram and 4 CPU cores.
On 3/13/14 4:56 PM, Michael van Leest wrote:
Is the server responsive when CF hangs? Or is it a bit slow/unresponsive
as
well?
I had some serious crash issues with CF9 64 bit a few years back and
switched over to railo after trying to debug it for weeks without result.
Make sure to check the windows logs if there are any weird events before
CF
hangs. My problem was mainly with JVM GC not doing its work properly and
eventually kill CF.
You could try to upgrade your JVM to a newer version that is officially
supported, but not sure if that will help your issue (trialerror).
Good luck!
2014-03-14 0:50 GMT+01:00 .jonah jonah@creori.com:
So, here's a tricky one. I have a server that hangs seemingly randomly
but around once a day.
Windows Server 2008, IIS, ColdFusion 9.
It will either return a 503 or the browser will just keep spinning and
never return anything.
When I go in to restart it (with a batch file) sometimes the ColdFusion
9 Application Server service takes a really long time to stop and
sometimes the W3SVC service takes a long time.
Where do I start diagnosing this? How can I find out what's hanging?
Which windows info should I look at? ColdFusion?
Thanks!
~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357931
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Site hanging randomly.
coldfusion-out says a couple things like:
* A non-SQL error occurred while requesting a connection from DB Name.
* Timed out trying to establish connection
* 3/13 16:19:21 Information [jrpp-2087] - HTTP request completed {Status
Code=503 ,Time taken=84723 ms}
Before it stops responding.
Will watch server monitor again. I have in the past but didn't find the root
cause.
On 3/13/14 5:20 PM, Russ Michaels wrote:
have you checked the coldfusion server monitor ?
I would also suggest installed FusionReactor for some addiitonal monitoring.
check the coldfusion-out logs for issues.
On Fri, Mar 14, 2014 at 12:12 AM, .jonah jonah@creori.com wrote:
I hadn't thought to check a static resource to see if it was still
available. I'll do that next time it hangs.
I'm currently running jdk1.6.0_32 with these JVM arguments:
-server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=512m
-XX:+UseParallelGC -Xbatch -Dsun.rmi.dgc.client.gcInterval=60
-Dsun.rmi.dgc.server.gcInterval=30
-Dcoldfusion.rootDir={application.home}/../
-Dcoldfusion.libPath={application.home}/../lib
The server has 6 Gb of ram and 4 CPU cores.
On 3/13/14 4:56 PM, Michael van Leest wrote:
Is the server responsive when CF hangs? Or is it a bit slow/unresponsive
as
well?
I had some serious crash issues with CF9 64 bit a few years back and
switched over to railo after trying to debug it for weeks without result.
Make sure to check the windows logs if there are any weird events before
CF
hangs. My problem was mainly with JVM GC not doing its work properly and
eventually kill CF.
You could try to upgrade your JVM to a newer version that is officially
supported, but not sure if that will help your issue (trialerror).
Good luck!
2014-03-14 0:50 GMT+01:00 .jonah jonah@creori.com:
So, here's a tricky one. I have a server that hangs seemingly randomly
but around once a day.
Windows Server 2008, IIS, ColdFusion 9.
It will either return a 503 or the browser will just keep spinning and
never return anything.
When I go in to restart it (with a batch file) sometimes the ColdFusion
9 Application Server service takes a really long time to stop and
sometimes the W3SVC service takes a long time.
Where do I start diagnosing this? How can I find out what's hanging?
Which windows info should I look at? ColdFusion?
Thanks!
~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357932
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Site hanging randomly.
That does sounds like a possible cause.
Do you have long running code with multiple queries or some sort of heavy
reporting query of some sort?
Network interruptions? Latency?
Do you always have the CF monitor running? If so, try to turn off all the
monitoring as that was buggy in CF9 if I remember correctly (JVM killer).
Just naming a few options to think of. Good luck.
2014-03-14 2:19 GMT+01:00 .jonah jonah@creori.com:
coldfusion-out says a couple things like:
* A non-SQL error occurred while requesting a connection from DB Name.
* Timed out trying to establish connection
* 3/13 16:19:21 Information [jrpp-2087] - HTTP request completed {Status
Code=503 ,Time taken=84723 ms}
Before it stops responding.
Will watch server monitor again. I have in the past but didn't find the
root cause.
On 3/13/14 5:20 PM, Russ Michaels wrote:
have you checked the coldfusion server monitor ?
I would also suggest installed FusionReactor for some addiitonal
monitoring.
check the coldfusion-out logs for issues.
On Fri, Mar 14, 2014 at 12:12 AM, .jonah jonah@creori.com wrote:
I hadn't thought to check a static resource to see if it was still
available. I'll do that next time it hangs.
I'm currently running jdk1.6.0_32 with these JVM arguments:
-server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=512m
-XX:+UseParallelGC -Xbatch -Dsun.rmi.dgc.client.gcInterval=60
-Dsun.rmi.dgc.server.gcInterval=30
-Dcoldfusion.rootDir={application.home}/../
-Dcoldfusion.libPath={application.home}/../lib
The server has 6 Gb of ram and 4 CPU cores.
On 3/13/14 4:56 PM, Michael van Leest wrote:
Is the server responsive when CF hangs? Or is it a bit
slow/unresponsive
as
well?
I had some serious crash issues with CF9 64 bit a few years back and
switched over to railo after trying to debug it for weeks without
result.
Make sure to check the windows logs if there are any weird events
before
CF
hangs. My problem was mainly with JVM GC not doing its work properly
and
eventually kill CF.
You could try to upgrade your JVM to a newer version that is officially
supported, but not sure if that will help your issue (trialerror).
Good luck!
2014-03-14 0:50 GMT+01:00 .jonah jonah@creori.com:
So, here's a tricky one. I have a server that hangs seemingly randomly
but around once a day.
Windows Server 2008, IIS, ColdFusion 9.
It will either return a 503 or the browser will just keep spinning and
never return anything.
When I go in to restart it (with a batch file) sometimes the
ColdFusion
9 Application Server service takes a really long time to stop and
sometimes the W3SVC service takes a long time.
Where do I start diagnosing this? How can I find out what's hanging?
Which windows info should I look at? ColdFusion?
Thanks!
~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357933
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
