[
https://issues.apache.org/jira/browse/HUDI-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张超明 updated HUDI-1584:
----------------------
Description:
The maker file path now is start with "*.hoodie/*", which should be start with
the target base path set by user.
The original code:
{code:java}
public static final String METAFOLDER_NAME = ".hoodie";
public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator +
".temp";
public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME +
File.separator + ".aux";
...
@Override
public void prepareSnapshotPreBarrier(long checkpointId) throws Exception {
super.prepareSnapshotPreBarrier(checkpointId);
String instantMarkerFileName = String.format("%d%s%d%s%d",
indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get());
Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME,
INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName);
// create marker file
...
}
{code}
was:
The maker file path now start with "*.hoodie/*", which should start with the
target base path set by user.
The original code:
{code:java}
public static final String METAFOLDER_NAME = ".hoodie";
public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator +
".temp";
public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME +
File.separator + ".aux";
...
@Override
public void prepareSnapshotPreBarrier(long checkpointId) throws Exception {
super.prepareSnapshotPreBarrier(checkpointId);
String instantMarkerFileName = String.format("%d%s%d%s%d",
indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get());
Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME,
INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName);
// create marker file
...
}
{code}
> The maker file path error
> -------------------------
>
> Key: HUDI-1584
> URL: https://issues.apache.org/jira/browse/HUDI-1584
> Project: Apache Hudi
> Issue Type: Bug
> Components: Flink Integration
> Reporter: 张超明
> Priority: Major
> Labels: pull-request-available
>
> The maker file path now is start with "*.hoodie/*", which should be start
> with the target base path set by user.
> The original code:
> {code:java}
> public static final String METAFOLDER_NAME = ".hoodie";
> public static final String TEMPFOLDER_NAME = METAFOLDER_NAME + File.separator
> + ".temp";
> public static final String AUXILIARYFOLDER_NAME = METAFOLDER_NAME +
> File.separator + ".aux";
> ...
> @Override
> public void prepareSnapshotPreBarrier(long checkpointId) throws Exception {
> super.prepareSnapshotPreBarrier(checkpointId);
> String instantMarkerFileName = String.format("%d%s%d%s%d",
> indexOfThisSubtask, DELIMITER, checkpointId, DELIMITER, recordCounter.get());
> Path path = new Path(new Path(HoodieTableMetaClient.AUXILIARYFOLDER_NAME,
> INSTANT_MARKER_FOLDER_NAME), instantMarkerFileName);
> // create marker file
> ...
> }
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
