[
https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379049#comment-17379049
]
ASF GitHub Bot commented on HUDI-2164:
--------------------------------------
zhangyue19921010 opened a new pull request #3259:
URL: https://github.com/apache/hudi/pull/3259
Please read https://issues.apache.org/jira/projects/HUDI/issues/HUDI-2164
## What is the purpose of the pull request
<p style="margin: 0px; padding: 0px; color: rgb(23, 43, 77); font-family:
-apple-system, system-ui, "Segoe UI", Roboto, Oxygen, Ubuntu,
"Fira Sans", "Droid Sans", "Helvetica Neue",
sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures:
normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal;
orphans: 2; text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width:
0px; background-color: rgb(255, 255, 255); text-decoration-thickness: initial;
text-decoration-style: initial; text-decoration-color: initial;">For now, Hudi
can let users submit a HoodieClusteringJob to build a clustering plan or
execute a clustering plan through --schedule or --instant-time config.</p><p
style="margin: 10px 0px 0px; padding: 0px; color: rgb(23, 43, 77); font-family:
-apple-system, system-ui, "Segoe UI", Roboto, Oxygen, Ubuntu,
"Fira Sans", "Droid Sans", "Helvetica Neue",
sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures:
normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal;
orphans: 2; text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width:
0px; background-color: rgb(255, 255, 255); text-decoration-thickness: initial;
text-decoration-style: initial; text-decoration-color: initial;">If users want
to trigger a clustering job, he has to </p><ol style="margin: 10px 0px 0px;
color: rgb(23, 43, 77); font-family: -apple-system, system-ui, "Segoe
UI", Roboto, Oxygen, Ubuntu, "Fira Sans", "Droid
Sans", "Helvetica Neue", sans-serif; font-size: 14px;
font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal;
font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255,
255, 255); text-decoration-thickness: initial; text-decoration-style: initial;
text-decoration-color: initial;"><li>Submit a HoodieClusteringJob to build a
clustering job through --schedule config</li><li>Copy the created clustering
Instant time form Log info.</li><li>Submit the HoodieClusteringJob again to
execute this created clustering plan through --instant-time config.</li></ol><p
style="margin: 10px 0px 0px; padding: 0px; color: rgb(23, 43, 77); font-family:
-apple-system, system-ui, "Segoe UI", Roboto, Oxygen, Ubuntu,
"Fira Sans", "Droid Sans", "Helvetica Neue",
sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures:
normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal;
orphans: 2; text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width:
0px; background-color: rgb(255, 255, 255); text-decoration-thickness: initial;
text-decoration-style: initial; text-decoration-color: initial;">The pain point
is that there are too many steps when trigger a clustering and need to copy and
paste the instant time from log file manually so that we can't make it
automatically.</p><p style="margin: 10px 0px 0px; padding: 0px; color: rgb(23,
43, 77); font-family: -apple-system, system-ui, "Segoe UI", Roboto,
Oxygen, Ubuntu, "Fira Sans", "Droid Sans", "Helvetica
Neue", sans-serif; font-size: 14px; font-style: normal;
font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400;
letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);
text-decoration-thickness: initial; text-decoration-style: initial;
text-decoration-color: initial;"> </p><p style="margin: 10px 0px 0px; padding:
0px; color: rgb(23, 43, 77); font-family: -apple-system, system-ui, "Segoe
UI", Roboto, Oxygen, Ubuntu, "Fira Sans", "Droid
Sans", "Helvetica Neue", sans-serif; font-size: 14px;
font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal;
font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start;
text-indent: 0px; text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255,
255, 255); text-decoration-thickness: initial; text-decoration-style: initial;
text-decoration-color: initial;">This PR offers a new config named --mode or -m
in short </p><div class="table-wrap" style="margin: 0px; padding: 0px; color:
rgb(23, 43, 77); font-family: -apple-system, system-ui, "Segoe UI",
Roboto, Oxygen, Ubuntu, "Fira Sans", "Droid Sans",
"Helvetica Neue", sans-serif; font-size: 14px; font-style: normal;
font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400;
letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);
text-decoration-thickness: initial; text-decoration-style: initial;
text-decoration-color: initial;">
--mode | remarks
-- | --
execute | Execute a cluster plan at given instant which means --instant-time
is needed here. default value.
schedule | Make a clustering plan.
scheduleAndExecute | Make a cluster plan first and execute that plan
immediately
</div><p style="margin: 10px 0px 0px; padding: 0px; color: rgb(23, 43, 77);
font-family: -apple-system, system-ui, "Segoe UI", Roboto, Oxygen,
Ubuntu, "Fira Sans", "Droid Sans", "Helvetica
Neue", sans-serif; font-size: 14px; font-style: normal;
font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400;
letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);
text-decoration-thickness: initial; text-decoration-style: initial;
text-decoration-color: initial;">Now users can use --mode scheduleAndExecute to
Build cluster plan and execute this plan at once using
HoodieClusteringJob.</p><br class="Apple-interchange-newline">
## Brief change log
- *Modify HoodieClusteringJob*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test
coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please
describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Build cluster plan and execute this plan at once for HoodieClusteringJob
> ------------------------------------------------------------------------
>
> Key: HUDI-2164
> URL: https://issues.apache.org/jira/browse/HUDI-2164
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Yue Zhang
> Priority: Major
>
> For now, Hudi can let users submit a HoodieClusteringJob to build a
> clustering plan or execute a clustering plan through --schedule or
> --instant-time config.
> If users want to trigger a clustering job, he has to
> # Submit a HoodieClusteringJob to build a clustering job through --schedule
> config
> # Copy the created clustering Instant time form Log info.
> # Submit the HoodieClusteringJob again to execute this created clustering
> plan through --instant-time config.
> The pain point is that there are too many steps when trigger a clustering and
> need to copy and paste the instant time from log file manually so that we
> can't make it automatically.
>
> I just raise a PR to offer a new config named --mode or -m in short
> ||--mode||remarks||
> |execute|Execute a cluster plan at given instant which means --instant-time
> is needed here. default value. |
> |schedule|Make a clustering plan.|
> |*scheduleAndExecute*|Make a cluster plan first and execute that plan
> immediately|
> Now users can use --mode scheduleAndExecute to Build cluster plan and execute
> this plan at once using HoodieClusteringJob.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
