What happened on App Engine today at about 12:24pm Pacific? At that point, my dashboard and logs show an outage. After recovery, my dashboard reports that CPU megacycles went up by a factor of 30 with the same number of requests per second, which is very strange. Here are some of my dashboard charts right now (the outage happened 9 hours ago on these charts):
1). Requests/Second: http://chart.apis.google.com/chart?chxt=x%2Cy&chd=e%3AAFAQAbAmAxA9BIBTBeBpB0B.CKCVCgCsC3DCDNDYDjDuD5EEEPEbEmExE8FHFSFdFoFzF-GKGVGgGrG2HBHMHXHiHtH5IEIPIaIlIwI7JGJRJcJoJzJ-KJKUKfKqK1LALLLXLiLtL4MDMOMZMkMvM6NGNRNcNnNyN9OIOTOeOpO1PAPLPWPhPsP3QCQNQYQkQvQ6RFRQRbRmRxR8SISTSeSpS0S.TKTVTgTrT3UCUNUYUjUuU5VEVPVaVmVxV8WHWSWdWoWzW-XJXVXgXrX2YBYMYXYiYtY4ZEZPZaZlZwZ7aGaRacanaza-bJbUbfbqb1cAcLcWcictc4dDdOdZdkdvd6eFeReceneye9fIfTfefpf0gAgLgWghgsg3hChNhYhjhvh6iFiQibimixi8jHjSjejpj0j.kKkVkgkrk2lBlNlYljlul5mEmPmamlmwm8nHnSndnonzn-oJoUoforo2pBpMpXpiptp4qDqOqaqlqwq7rGrRrcrnryr9sJsUsfsqs1tAtLtWthtst4uDuOuZukuvu6vFvQvbvnvyv9wIwTwewpw0w.xKxWxhxsx3yCyNyYyjyuy5zFzQzbzmzxz80H0S0d0o000.1K1V1g1r122B2M2X2j2u253E3P3a3l3w374G4S4d4o4z4-5J5U5f5q516B6M6X6i6t647D7O7Z7k7w778G8R8c8n8y899I9T9f9q91-A-L-W%2CPxPpTYVQVIUNScPTTYUySGRKQWQOS6QsP4TCSkT2QsP4RKSVUFUFUNScLjOPR.QHUURKQ0QWTYQHTnO1NMOtWERhNbQWOeOtMnAAPaT-QsRKOAKvLVM2PiP4SGKZKRMYNFOALNL6MJOeNjOIOXLVLyKCLNOeSrQHOmSrMfPpOtNxOeOARwUcPxQdNMMBQWMJKCM9OPOAL6LGIaIwKRNMM9O8UcOIMuPiOAP4QdR3SzTgVQWMP4PxQsOASVP.SzO1RSQHPENxKZOPVuO1NqRoSzRDSzPTRoSVa3RwUyWTTgT2SVXlUyT2QHQ7R.WiUcTJZzl9tjqRyc..neqKdMaoZsZVVmaRZGX0SVVIbGetetWbYDVmbGYhWTVBXHSrVQY4c9gOsnnekqgHe8eIjRsYkcg7fxZOhDbjX0WTemir1fpOg0lmfaizemAAAAcJfpeeYSeAdUhhcYgldbAAdFcYW4ZOXAbVhZgWYDWxcYYSagV9Y.fimifajRrGntn0jRohgOeAc9cuZdVQbrUjXAScSGZzdMdxc9UFVXgdcJWERZRZTRWESVVQRwSOTvSzPTQsUjWqTCWiZkWES6VXNxQHT2ScUUXWUNSzUcSrRhSzemZzdxXAZsbGXlZsWqVfRoWiT2Q7UFSkV1WqU5UUagXtYpZsZOXea3aCX0cud5VQU5bNb6hDhSbrbraRU5Y4UcQHOARSPiUUQOZdY4fp&chxp=0%2C97.6%2C73.2%2C48.8%2C24.4%2C0.0%7C1%2C20.0%2C40.0%2C60.0%2C80.0%2C100.0&chg=0%2C20.00%2C1%2C2&chco=0077cc&chm=R%2C7f7f7f%2C0%2C0.976%2C0.977%7CR%2C7f7f7f%2C0%2C0.732%2C0.733%7CR%2C7f7f7f%2C0%2C0.488%2C0.489%7CR%2C7f7f7f%2C0%2C0.244%2C0.245%7CR%2C7f7f7f%2C0%2C0.000%2C0.001%7CB%2Ceaf0f4%2C0%2C0%2C0&chs=750x185&cht=lxy&chxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-24hr%7C1%3A%7C0.457%7C0.913%7C1.37%7C1.83%7C2.28&chls=2%2C0%2C0 (Dropped to 0 twice around the time in question). 2) Megacycles/Second: http://chart.apis.google.com/chart?chxt=x%2Cy&chd=e%3AAFAQAbAmAxA9BIBTBeBpB0B.CKCVCgCsC3DCDNDYDjDuD5EEEPEbEmExE8FHFSFdFoFzF-GKGVGgGrG2HBHMHXHiHtH5IEIPIaIlIwI7JGJRJcJoJzJ-KJKUKfKqK1LALLLXLiLtL4MDMOMZMkMvM6NGNRNcNnNyN9OIOTOeOpO1PAPLPWPhPsP3QCQNQYQkQvQ6RFRQRbRmRxR8SISTSeSpS0S.TKTVTgTrT3UCUNUYUjUuU5VEVPVaVmVxV8WHWSWdWoWzW-XJXVXgXrX2YBYMYXYiYtY4ZEZPZaZlZwZ7aGaRacanaza-bJbUbfbqb1cAcLcWcictc4dDdOdZdkdvd6eFeReceneye9fIfTfefpf0gAgLgWghgsg3hChNhYhjhvh6iFiQibimixi8jHjSjejpj0j.kKkVkgkrk2lBlNlYljlul5mEmPmamlmwm8nHnSndnonzn-oJoUoforo2pBpMpXpiptp4qDqOqaqlqwq7rGrRrcrnryr9sJsUsfsqs1tAtLtWthtst4uDuOuZukuvu6vFvQvbvnvyv9wIwTwewpw0w.xKxWxhxsx3yCyNyYyjyuy5zFzQzbzmzxz80H0S0d0o000.1K1V1g1r122B2M2X2j2u253E3P3a3l3w374G4S4d4o4z4-5J5U5f5q516B6M6X6i6t647D7O7Z7k7w778G8R8c8n8y899I9T9f9q91-A-L-W%2CBAA4BTBYBTBYBNBIBVBYBaBFBMBLBhBQBGBKBRCMBNBDBQBJBMBhBXBVAuA4BiA-BRBHA6BFBJBCBMA3A6A6BXBJBABAA2A1AvAAAABIBVBGA3AzA9A-BNA8BPAzAwA2A6BAA4A1BFBRA5BAA.A2A7AxAyBDBLBEA9BPAzBQA.A-BJA8BRBYBIBFA-A5BkAyAvA5BFBFA2A1ArAsA1A5A2BPBQBAAzBDBEA-BgBHBXBWBoBeBNBLBYBBBQBGBTBJBNBTBIBEA0A0BJA9A1BEBHBJBMA4BeBGBqBOBOBYBWBYBCBUBCBKBBBJBNBgBUBMBkCCCmCZCmDcCgCdCIB0BlBWBSCCBpBlBHBhBzB-B7BpCMBwBkB5BaBSBPBKBUByBhBtCTCACECVB-BhCVCZCUB1B8BiByBtBeBXBnByClChCMCWCOB-CBAAAAaLmjWre8oLrQpkt-nnuKeOg9jhd8bHkrkurfyTjbm6nfjeiBd1g9sR1MqZyv..8O9e1k02zwrZmZvke1dvs4kOk-hKhNmdv2t6t2dBe5tpqKo1Z5Xbbug2dThRaIZGdGVcUNXOa3hBi.oSjUf4e.fSU1V3eOdmbXZyaIele2c4b-bjtYj6l2d-jNgkhel1gsjRcDhogoZNYcZcmBjhhukCi0n1j1y7k2sjmdsTmJlZqOijgfowkStfyrrCmomtmCn-dxWQa1VnZtZZXZizmdu0&chxp=0%2C97.6%2C73.2%2C48.8%2C24.4%2C0.0%7C1%2C20.0%2C40.0%2C60.0%2C80.0%2C100.0&chg=0%2C20.00%2C1%2C2&chco=0077cc&chm=R%2C7f7f7f%2C0%2C0.976%2C0.977%7CR%2C7f7f7f%2C0%2C0.732%2C0.733%7CR%2C7f7f7f%2C0%2C0.488%2C0.489%7CR%2C7f7f7f%2C0%2C0.244%2C0.245%7CR%2C7f7f7f%2C0%2C0.000%2C0.001%7CB%2Ceaf0f4%2C0%2C0%2C0&chs=750x185&cht=lxy&chxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-24hr%7C1%3A%7C275.59%7C551.18%7C826.77%7C1102%7C1377&chls=2%2C0%2C0 (Went from about 30 per second to about 1000 per second) 3) Milliseconds/Request: http://chart.apis.google.com/chart?chxt=x%2Cy&chd=e%3AAAALAWAhAsA3BCBNBYBjBuB5CFCQCbCmCxC8DHDSDdDoDzD-EKEVEgErE2FBFMFXFiFtF4GDGPGaGlGwG7HGHRHcHnHyH9IJIUIfIqI1JAJLJWJhJsJ3KCKOKZKkKvK6LFLQLbLmLxL8MHMTMeMpM0M.NKNVNgNrN2OBOMOYOjOuO5PEPPPaPlPwP7QGQSQdQoQzQ-RJRURfRqR1SASLSXSiStS4TDTOTZTkTvT6UFUQUcUnUyU9VIVTVeVpV0V.WKWWWhWsW3XCXNXYXjXuX5YEYPYbYmYxY8ZHZSZdZoZzZ-aJaUagara2bBbMbXbibtb4cDcOcZclcwc7dGdRdcdndyd9eIeTefeqe1fAfLfWfhfsf3gCgNgYgkgvg6hFhQhbhmhxh8iHiSidipi0i.jKjVjgjrj2kBkMkXkjkuk5lElPlalllwl7mGmRmcmomzm-nJnUnfnqn1oAoLoWohoto4pDpOpZpkpvp6qFqQqbqmqyq9rIrTrerpr0r.sKsVsgsss3tCtNtYtjtut5uEuPuauluxu8vHvSvdvovzv-wJwUwfwqw2xBxMxXxixtx4yDyOyZykyvy7zGzRzcznzyz90I0T0e0p011A1L1W1h1s132C2N2Y2j2u263F3Q3b3m3x384H4S4d4o4z4.5K5V5g5r526B6M6X6i6t657E7P7a7l7w778G8R8c8n8y8-9J9U9f9q91-A-L-W%2CLPMfKMNaL.KeM5LXN.PBNBN9MPNKORQATxUKQbNgRMVVQPNeL0LzOvQkMVN3QLN.OMXbL2NnLfLHMFLZK8MJLuL5MmL0L4LpKRKrAAJBWZShSKQRbFdmdmW9S9VuZyYlR5TESJdLTVX2TtRIRsYdbnVKWtUWYnTMYITMY0ZZfGY.VgShV5YaYdPUK8NONQPjQWQ5W6bvVISya1P9PQPeNJOnQjOoQhQXP2SEQQZURIRARIQaRGSoRhQ.Q0TTNqOkQBOaPHPlObNSLvMDLdKlLDLYLrLtMhSGOPPZOYQ8RZSDOQNaLBKCL4MfPFNzN3PyNyNyLtQuNCLpMFTbMgc2RmLwLhNIZwNzPkMENMKaMSLhPKSPfkLMNVMZM0J0L3LVNvKLLRNFKtL6NCNoL2NHK8KELiRRKaJrLWLRKwI6JWNjJ5LeLHMpKvTEAAAAMGKfHoNWN1OyL4MsNDNtAAMbOsNAeM..MvMZNhMHN8NoMyMRM-LtL4M8MRMYM3M2MwNwL3NoOsM7QgM4O1SiSMT-QDPFPgPHOyPzR3OPNAOWc6QZN7NbPQP8TIOUetOiNJNfL0NIPuOFNcL.MtNOLbLhLvK8OULcK9KaL6L2MLMALWLwKYLyJrO7JvKvMwLzLhMzMELhNJLgNLOsOmMUXWNiTULCZsK-OWMpNrM1L8PnM8S6TIMDNML0L6LmMJN.NOMkSCOgPjSyKzKLMeOTOJ&chxp=0%2C97.6%2C73.2%2C48.8%2C24.5%2C0.1%7C1%2C20.0%2C40.0%2C60.0%2C80.0%2C100.0&chg=0%2C20.00%2C1%2C2&chco=0077cc&chm=R%2C7f7f7f%2C0%2C0.976%2C0.977%7CR%2C7f7f7f%2C0%2C0.732%2C0.733%7CR%2C7f7f7f%2C0%2C0.488%2C0.489%7CR%2C7f7f7f%2C0%2C0.245%2C0.246%7CR%2C7f7f7f%2C0%2C0.001%2C0.002%7CB%2Ceaf0f4%2C0%2C0%2C0&chs=750x185&cht=lxy&chxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-24hr%7C1%3A%7C58.84%7C117.69%7C176.53%7C235.38%7C294.22&chls=2%2C0%2C0 and Errors/Second http://chart.apis.google.com/chart?chxt=x%2Cy&chd=e%3AAFAQAbAmAxA9BIBTBeBpB0B.CKCVCgCsC3DCDNDYDjDuD5EEEPEbEmExE8FHFSFdFoFzF-GKGVGgGrG2HBHMHXHiHtH5IEIPIaIlIwI7JGJRJcJoJzJ-KJKUKfKqK1LALLLXLiLtL4MDMOMZMkMvM6NGNRNcNnNyN9OIOTOeOpO1PAPLPWPhPsP3QCQNQYQkQvQ6RFRQRbRmRxR8SISTSeSpS0S.TKTVTgTrT3UCUNUYUjUuU5VEVPVaVmVxV8WHWSWdWoWzW-XJXVXgXrX2YBYMYXYiYtY4ZEZPZaZlZwZ7aGaRacanaza-bJbUbfbqb1cAcLcWcictc4dDdOdZdkdvd6eFeReceneye9fIfTfefpf0gAgLgWghgsg3hChNhYhjhvh6iFiQibimixi8jHjSjejpj0j.kKkVkgkrk2lBlNlYljlul5mEmPmamlmwm8nHnSndnonzn-oJoUoforo2pBpMpXpiptp4qDqOqaqlqwq7rGrRrcrnryr9sJsUsfsqs1tAtLtWthtst4uDuOuZukuvu6vFvQvbvnvyv9wIwTwewpw0w.xKxWxhxsx3yCyNyYyjyuy5zFzQzbzmzxz80H0S0d0o000.1K1V1g1r122B2M2X2j2u253E3P3a3l3w374G4S4d4o4z4-5J5U5f5q516B6M6X6i6t647D7O7Z7k7w778G8R8c8n8y899I9T9f9q91-A-L-W%2CAAF0LoOiC6AAF0C6OiC6C6AALoLoIuC6F0RdAAC6AAIuF0F0AAC6AAC6C6AAC6AAUXC6AAIuOiC6AAOiC6OiXROiC6AAC6C6LoAARdouIuC6C6AAIuIuC6IuAAC6AAAAAAAAAAC6AAAAC6C6LoC6AAIuIuAAdFF0C6AAUXIuC6F0IuAAF0RdC6F0AAC6C6C6AAC6C6C6C6AAAAAAAAC6RdF0RdAARdIuAALoIuF0AAXRC6dFF0AAC6AAUXF0IuC6F0F0AAC6C6LoLoaLRdF0F0IuIuAAC6XRLoF0LoRdF0IuIuRdLoXRC6AAC6IuF0C6OiXRXRRdl0i6OiOiIuF0F0RddFOiLoRdC6RdXRdFIuLoIuUXLoC6C6C6LoC6C6F0RdOiroxdgAIuUXRdgAi6dFaLIuRdUXAAgAF0Oixd6LUXC6F0RdIuXRAAAAC6OiUXRdIuLoIuF0IuAAAALoOiLo..RdAARdIuOiIuIuLoouAALoRdC6XRoul0RdLoUXAAUXUXOiC6XRAAF0LoF0C6IuC6F0LoLoC6AAUXIuC6LoOiAAC6IuUXLoAAOiF0C6C6aLUXIuC6OidFRdaLC6F0F0OiIuOiAAAAOiAAF0F0F0C6gAAAIugARdF0F0C6C6LoUXC6C6RdF0IuIudFLoXRC6dFi6AAroF0C6RdaLF0C6RdF0LoC6AAIuRdOiLoIuLoAAF0C6OiRdXRF0Rd&chxp=0%2C97.6%2C73.2%2C48.8%2C24.4%2C0.0%7C1%2C20.0%2C40.0%2C60.0%2C80.0%2C100.0&chg=0%2C20.00%2C1%2C2&chco=0077cc&chm=R%2C7f7f7f%2C0%2C0.976%2C0.977%7CR%2C7f7f7f%2C0%2C0.732%2C0.733%7CR%2C7f7f7f%2C0%2C0.488%2C0.489%7CR%2C7f7f7f%2C0%2C0.244%2C0.245%7CR%2C7f7f7f%2C0%2C0.000%2C0.001%7CB%2Ceaf0f4%2C0%2C0%2C0&chs=750x185&cht=lxy&chxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-24hr%7C1%3A%7C0.018%7C0.037%7C0.055%7C0.073%7C0.092&chls=2%2C0%2C0 (both show spikes at that time) 3) Milliseconds/Second: http://chart.apis.google.com/chart?chxt=x%2Cy&chd=e%3AAFAQAbAmAxA9BIBTBeBpB0B.CKCVCgCsC3DCDNDYDjDuD5EEEPEbEmExE8FHFSFdFoFzF-GKGVGgGrG2HBHMHXHiHtH5IEIPIaIlIwI7JGJRJcJoJzJ-KJKUKfKqK1LALLLXLiLtL4MDMOMZMkMvM6NGNRNcNnNyN9OIOTOeOpO1PAPLPWPhPsP3QCQNQYQkQvQ6RFRQRbRmRxR8SISTSeSpS0S.TKTVTgTrT3UCUNUYUjUuU5VEVPVaVmVxV8WHWSWdWoWzW-XJXVXgXrX2YBYMYXYiYtY4ZEZPZaZlZwZ7aGaRacanaza-bJbUbfbqb1cAcLcWcictc4dDdOdZdkdvd6eFeReceneye9fIfTfefpf0gAgLgWghgsg3hChNhYhjhvh6iFiQibimixi8jHjSjejpj0j.kKkVkgkrk2lBlNlYljlul5mEmPmamlmwm8nHnSndnonzn-oJoUoforo2pBpMpXpiptp4qDqOqaqlqwq7rGrRrcrnryr9sJsUsfsqs1tAtLtWthtst4uDuOuZukuvu6vFvQvbvnvyv9wIwTwewpw0w.xKxWxhxsx3yCyNyYyjyuy5zFzQzbzmzxz80H0S0d0o000.1K1V1g1r122B2M2X2j2u253E3P3a3l3w374G4S4d4o4z4-5J5U5f5q516B6M6X6i6t647D7O7Z7k7w778G8R8c8n8y899I9T9f9q91-A-L-W%2CITG7LGLFJnLIJDJOMqLXK1JIJWKENAOJNgNLKxO1PRLNJtJaKLMzOYJ4G-JxK8JzUsIuJ0IKJJIdJfHDG9HgLaJlG5IVHVGkFvAAGCTONENdJqMpOkQOPYM.RGLpK.JLKjLDONKAMmMMJ6KgPBNmK2J6J6PfPTQaMLUKNyVJPeM4LqNVStVmKWHuHlG7LDIoHYMrRLMqJuM8F1FzG6HaIPKlMjKEJDKtLALOSHNINjOhO.QfM3L0MVJ.PGJgL6KUK0KlKDIpGAHKLAHYGSIeJLIiJkIQN3LWRgK8O4QmPOMTKjLIJEKBIoLGKpNcNsLRPeTUhGX8ZLhghVW6keUXNEMkMIdJO.QHJXL.MQQaPJOyTEdAMvN8MBLcJxJZKXO2MuPyY-SUS3R.SROyUGUvP2QdX2LTNmNaLjKYLkN3fBRpQPR0RJP-ZEAAAAOjOcKHOGRwS2RMPhSfRiAAPgR-M0hG..PER7SvMnNqQzNXOBL.MpQSVOQkS3XdWDVtVFUxTFTKQIUnOQNsVoQQTxM3LuRFTLS2T5PmNPSORRbcMZKiLPOeMtRrK5XYMLKjIsIdLmPVLcNLNFMMKvKnG5IGJVLWJ0KvJCJnKSJ4JIJKPdLoPNJrQrLNLBOQLgKwJ0LtJ8JrJ7KoN8OOLMUgPQTtL0csL-OpOoPWNOOyUTL0Q.WPOkS5RGOVN1N3MbOKKxMdI1LrMrJXHLNrPeS9&chxp=0%2C97.6%2C73.2%2C48.8%2C24.4%2C0.0%7C1%2C20.0%2C40.0%2C60.0%2C80.0%2C100.0&chg=0%2C20.00%2C1%2C2&chco=0077cc&chm=R%2C7f7f7f%2C0%2C0.976%2C0.977%7CR%2C7f7f7f%2C0%2C0.732%2C0.733%7CR%2C7f7f7f%2C0%2C0.488%2C0.489%7CR%2C7f7f7f%2C0%2C0.244%2C0.245%7CR%2C7f7f7f%2C0%2C0.000%2C0.001%7CB%2Ceaf0f4%2C0%2C0%2C0&chs=750x185&cht=lxy&chxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-24hr%7C1%3A%7C48.30%7C96.60%7C144.90%7C193.21%7C241.51&chls=2%2C0%2C0 (holding steady despite the huge increase in megacycles used) --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
