[FLINK-5459] [docs] Add templates for debugging classloading and debugging event time issues
Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ef185d77 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/ef185d77 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/ef185d77 Branch: refs/heads/release-1.2 Commit: ef185d777d6c5debf139833b6af88e9cbfa583bf Parents: 4b0c4d9 Author: Stephan Ewen <se...@apache.org> Authored: Tue Jan 10 22:56:16 2017 +0100 Committer: Stephan Ewen <se...@apache.org> Committed: Mon Jan 16 11:53:55 2017 +0100 ---------------------------------------------------------------------- docs/monitoring/debugging_classloading.md | 45 ++++++++++++++++++++++++++ docs/monitoring/debugging_event_time.md | 37 +++++++++++++++++++++ 2 files changed, 82 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flink/blob/ef185d77/docs/monitoring/debugging_classloading.md ---------------------------------------------------------------------- diff --git a/docs/monitoring/debugging_classloading.md b/docs/monitoring/debugging_classloading.md new file mode 100644 index 0000000..e4e908e --- /dev/null +++ b/docs/monitoring/debugging_classloading.md @@ -0,0 +1,45 @@ +--- +title: "Debugging Classloading" +nav-parent_id: monitoring +nav-pos: 8 +--- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +* ToC +{:toc} + +## Overview of Classloading in Flink + + - What is in the Application Classloader for different deployment techs + - What is in the user code classloader + + - Access to the user code classloader for applications + +## Classpath Setups + + - Finding classpaths in logs + - Moving libraries and/or user code to the Application Classpath + +## Unloading of Dynamically Loaded Classes + + - Checkpoint statistics overview + - Interpret time until checkpoints + - Synchronous vs. asynchronous checkpoint time + http://git-wip-us.apache.org/repos/asf/flink/blob/ef185d77/docs/monitoring/debugging_event_time.md ---------------------------------------------------------------------- diff --git a/docs/monitoring/debugging_event_time.md b/docs/monitoring/debugging_event_time.md new file mode 100644 index 0000000..e87db0a --- /dev/null +++ b/docs/monitoring/debugging_event_time.md @@ -0,0 +1,37 @@ +--- +title: "Debugging Windows & Event Time" +nav-parent_id: monitoring +nav-pos: 9 +--- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +* ToC +{:toc} + +## Monitoring Current Event Time + + - What metrics, how to access in the UI + - Event time dominated by furthest-behind source + +## Handling Event Time Stragglers + + - Approach 1: Watermark stays late (indicated completeness), windows fire early + - Approach 2: Watermark heuristic with maximum lateness, windows accept late data +