[ 
https://issues.apache.org/jira/browse/FLINK-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320743#comment-16320743
 ] 

ASF GitHub Bot commented on FLINK-5823:
---------------------------------------

Github user StephanEwen commented on a diff in the pull request:

    https://github.com/apache/flink/pull/5248#discussion_r160754932
  
    --- Diff: 
flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/Checkpoints.java
 ---
    @@ -0,0 +1,327 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *     http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.flink.runtime.checkpoint;
    +
    +import org.apache.flink.api.common.JobID;
    +import org.apache.flink.configuration.Configuration;
    +import org.apache.flink.core.fs.FSDataInputStream;
    +import org.apache.flink.core.fs.Path;
    +import org.apache.flink.runtime.checkpoint.savepoint.Savepoint;
    +import org.apache.flink.runtime.checkpoint.savepoint.SavepointSerializer;
    +import org.apache.flink.runtime.checkpoint.savepoint.SavepointSerializers;
    +import org.apache.flink.runtime.checkpoint.savepoint.SavepointV2;
    +import org.apache.flink.runtime.executiongraph.ExecutionJobVertex;
    +import org.apache.flink.runtime.jobgraph.JobVertexID;
    +import org.apache.flink.runtime.jobgraph.OperatorID;
    +import org.apache.flink.runtime.state.StateBackend;
    +import org.apache.flink.runtime.state.StateBackendLoader;
    +import org.apache.flink.runtime.state.StreamStateHandle;
    +import org.apache.flink.runtime.state.filesystem.AbstractFileStateBackend;
    +import org.apache.flink.runtime.state.filesystem.FileStateHandle;
    +import org.apache.flink.runtime.state.memory.MemoryStateBackend;
    +import org.apache.flink.util.ExceptionUtils;
    +import org.apache.flink.util.FileUtils;
    +import org.apache.flink.util.FlinkException;
    +
    +import org.slf4j.Logger;
    +import org.slf4j.LoggerFactory;
    +
    +import javax.annotation.Nullable;
    +import java.io.DataInputStream;
    +import java.io.DataOutputStream;
    +import java.io.IOException;
    +import java.io.OutputStream;
    +import java.util.HashMap;
    +import java.util.Map;
    +
    +import static org.apache.flink.util.Preconditions.checkNotNull;
    +
    +/**
    + * A utility class with the methods to write/load/dispose the checkpoint 
and savepoint metadata.
    + *
    + * <p>Stored checkpoint metadata files have the following format:
    + * <pre>[MagicNumber (int) | Format Version (int) | Checkpoint Metadata 
(variable)]</pre>
    + *
    + * <p>The actual savepoint serialization is version-specific via the 
{@link SavepointSerializer}.
    + */
    +public class Checkpoints {
    --- End diff --
    
    This class mimics somewhat the way this was done previously, scattered over 
the `SavepointLoader` and `SavepointStore` class. I changed it to `Checkpoints` 
because the code was relevant not only to savepoints, but to checkpoints in 
general. It was mainly a bit of name-fixing work as part of the adjustment .
    
    Making this pluggable is another orthogonal effort in my opinion, and also 
a probably more involved one.


> Store Checkpoint Root Metadata in StateBackend (not in HA custom store)
> -----------------------------------------------------------------------
>
>                 Key: FLINK-5823
>                 URL: https://issues.apache.org/jira/browse/FLINK-5823
>             Project: Flink
>          Issue Type: Sub-task
>          Components: State Backends, Checkpointing
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>            Priority: Blocker
>             Fix For: 1.5.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to