[ https://issues.apache.org/jira/browse/HUDI-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
张超明 updated HUDI-1584: ---------------------- Description: The maker file path now start with "*./hoodie/*", which should start with the target base path set by user. The original code: {code:java} public static final String METAFOLDER_NAME = ".hoodie"; public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator + ".temp"; public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME + File.separator + ".aux"; ... @Override public void prepareSnapshotPreBarrier(long checkpointId) throws Exception { super.prepareSnapshotPreBarrier(checkpointId); String instantMarkerFileName = String.format("%d%s%d%s%d", indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get()); Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME, INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName); // create marker file ... } {code} was: The maker file path now start with "*./hoodie/*", which should start with the target base path set by user. {code:java} public static final String METAFOLDER_NAME = ".hoodie"; public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator + ".temp"; public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME + File.separator + ".aux"; ... @Override public void prepareSnapshotPreBarrier(long checkpointId) throws Exception { super.prepareSnapshotPreBarrier(checkpointId); String instantMarkerFileName = String.format("%d%s%d%s%d", indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get()); Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME, INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName); // create marker file ... } {code} > The maker file path error > ------------------------- > > Key: HUDI-1584 > URL: https://issues.apache.org/jira/browse/HUDI-1584 > Project: Apache Hudi > Issue Type: Bug > Components: Flink Integration > Reporter: 张超明 > Priority: Major > Labels: pull-request-available > > The maker file path now start with "*./hoodie/*", which should start with the > target base path set by user. > The original code: > {code:java} > public static final String METAFOLDER_NAME = ".hoodie"; > public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator > + ".temp"; > public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME + > File.separator + ".aux"; > ... > @Override > public void prepareSnapshotPreBarrier(long checkpointId) throws Exception { > super.prepareSnapshotPreBarrier(checkpointId); > String instantMarkerFileName = String.format("%d%s%d%s%d", > indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get()); > Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME, > INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName); > // create marker file > ... > } > {code} > -- This message was sent by Atlassian Jira (v8.3.4#803005)