[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-16 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 5: Code-Review+1

(4 comments)

Thank you for working on this!

Looks good overall!  Just a few nits in the commit message and in the test 
scenario.

http://gerrit.cloudera.org:8080/#/c/18496/5//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/18496/5//COMMIT_MSG@7
PS5, Line 7: rebuild
nit: rebuilding


http://gerrit.cloudera.org:8080/#/c/18496/5//COMMIT_MSG@9
PS5, Line 9: When use 'kudu master unsafe_rebuild' tool to rebuild
   : master, if the cluster is not health, for example,
   : some tservers holds outdated schemas (with lower schema
   : version), we may build tables with outdated schemas.
nit: how about


Before this patch, if tservers had outdated schemas with lower
version for some tables (e.g. when the cluster wasn't healthy), the
'kudu master unsafe_rebuild' tool might rebuild the system catalog
with outdated schemas for the unhealthy tables.


http://gerrit.cloudera.org:8080/#/c/18496/5//COMMIT_MSG@14
PS5, Line 14: This patch optmizes the rebuild logic, will use newer
: schema (with higher version) to replace schema with
: lower version.
nit: how about

This patch optimizes the rebuild logic, so the tool now picks up
schema of the highest version for an unhealthy table when rebuilding
the system catalog.


http://gerrit.cloudera.org:8080/#/c/18496/5/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/5/src/kudu/tools/kudu-admin-test.cc@3244
PS5, Line 3244:
nit: does it make sense to check that the client sees the right number of 
columns in the KuduSchema object before writing/reading into the table?  That 
something about calling KuduClient::GetTableSchema() and then 
KuduSchema::num_columns(), correspondingly.



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 5
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Mon, 16 May 2022 18:07:12 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-09 Thread Yingchun Lai (Code Review)
Yingchun Lai has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 5:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/18496/4/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/4/src/kudu/tools/kudu-admin-test.cc@3219
PS4, Line 3219: to become he
> nit: 'to become healthy' or 'to be in a good health'
Done


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@230
PS3, Line 230:
> I guess Andrew meant that it's enough to have this auto-commit guard just r
CommitMutation will reset 'metadata' which is obtained by 'SysTablesEntryPB* 
metadata = &table->mutable_metadata()->mutable_dirty()->pb', but we will use 
'metadata' to compare schemas after L246.
Anyway, I adjusted the code to make it more readability.


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@253
PS3, Line 253:
> +1
Done



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 5
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Tue, 10 May 2022 02:16:51 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-09 Thread Yingchun Lai (Code Review)
Hello Alexey Serbin, Kudu Jenkins, Abhishek Chennaka, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18496

to look at the new patch set (#5).

Change subject: [tools] update schema if needed when rebuild master
..

[tools] update schema if needed when rebuild master

When use 'kudu master unsafe_rebuild' tool to rebuild
master, if the cluster is not health, for example,
some tservers holds outdated schemas (with lower schema
version), we may build tables with outdated schemas.

This patch optmizes the rebuild logic, will use newer
schema (with higher version) to replace schema with
lower version.

Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
---
M src/kudu/tools/kudu-admin-test.cc
M src/kudu/tools/master_rebuilder.cc
2 files changed, 115 insertions(+), 44 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/18496/5
--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 5
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-09 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 4: Code-Review+1


--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 4
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Mon, 09 May 2022 14:48:35 +
Gerrit-HasComments: No


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-09 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 4:

(2 comments)

http://gerrit.cloudera.org:8080/#/c/18496/4/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/4/src/kudu/tools/kudu-admin-test.cc@3219
PS4, Line 3219: to be health
nit: 'to become healthy' or 'to be in a good health'


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@230
PS3, Line 230: // Return with non-OK status is not fatal, s
> Since 'mutable_dirty' is obtained in L232, it is referenced and will be use
I guess Andrew meant that it's enough to have this auto-commit guard just right 
before first return from this function -- having it anywhere before that 
doesn't change anything, right?



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 4
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Mon, 09 May 2022 14:48:13 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-09 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 3:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@253
PS3, Line 253:
> nit: maybe log a message saying something like "ignoring mismatched schema
+1

That would also help to clarify why the current metadata mutation is to be 
committed anyways.



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 3
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Mon, 09 May 2022 14:40:37 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-08 Thread Yingchun Lai (Code Review)
Yingchun Lai has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 4:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/kudu-admin-test.cc@3245
PS3, Line 3245:   // Check the altered table is writable and readable.
> nit: could we explicitly also check that the table has the right number of
Done


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@230
PS3, Line 230: // Return with non-OK status is not fatal, s
> nit: maybe just put this after L246?
Since 'mutable_dirty' is obtained in L232, it is referenced and will be used 
after L246, and CommitMutation will reset 'mutable_dirty', so I intend to 
CommitMutation in the last.


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@253
PS3, Line 253:
> nit: maybe log a message saying something like "ignoring mismatched schema
Done



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 4
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Sun, 08 May 2022 16:45:22 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-08 Thread Yingchun Lai (Code Review)
Hello Alexey Serbin, Kudu Jenkins, Abhishek Chennaka, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18496

to look at the new patch set (#4).

Change subject: [tools] update schema if needed when rebuild master
..

[tools] update schema if needed when rebuild master

When use 'kudu master unsafe_rebuild' tool to rebuild
master, if the cluster is not health, for example,
some tservers holds outdated schemas (with lower schema
version), we may build tables with outdated schemas.

This patch optmizes the rebuild logic, will use newer
schema (with higher version) to replace schema with
lower version.

Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
---
M src/kudu/tools/kudu-admin-test.cc
M src/kudu/tools/master_rebuilder.cc
2 files changed, 112 insertions(+), 42 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/18496/4
--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 4
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-07 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 3:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/kudu-admin-test.cc@3245
PS3, Line 3245: ScanTableToStrings(table.get(), &rows);
nit: could we explicitly also check that the table has the right number of 
columns?


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@230
PS3, Line 230: table->mutable_metadata()->CommitMutation();
nit: maybe just put this after L246?


http://gerrit.cloudera.org:8080/#/c/18496/3/src/kudu/tools/master_rebuilder.cc@253
PS3, Line 253:
nit: maybe log a message saying something like "ignoring mismatched schema 
since it has a lower version" or somesuch?



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 3
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Sat, 07 May 2022 07:07:00 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-06 Thread Yingchun Lai (Code Review)
Yingchun Lai has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 3:

(5 comments)

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc@3040
PS2, Line 3040: int tserver_num,
> What if passing just the number of tablet servers here to be used for the u
Done


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc@3205
PS2, Line 3205: ut;
> newer
Done


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@228
PS2, Line 228:   auto cleanup = MakeScopedCleanup([&]() {
 : // Return with non-OK status is not fatal, so still 
CommitMutation.
 : t
> So, we want to commit the mutation even if returning with an error from thi
Yes, since return with non-OK status is not fatal, so still CommitMutation.


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@248
PS2, Line 248:
> Check for the consistency.
Done


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@250
PS2, Line 250:   // Only matched when they have the same version.
 :   if (replica.has_schema_version() &&
> For better readability, add early return here if the condition isn't true.
Done



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 3
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yingchun Lai 
Gerrit-Comment-Date: Sat, 07 May 2022 04:15:14 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-06 Thread Yingchun Lai (Code Review)
Hello Alexey Serbin, Kudu Jenkins, Abhishek Chennaka,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18496

to look at the new patch set (#3).

Change subject: [tools] update schema if needed when rebuild master
..

[tools] update schema if needed when rebuild master

When use 'kudu master unsafe_rebuild' tool to rebuild
master, if the cluster is not health, for example,
some tservers holds outdated schemas (with lower schema
version), we may build tables with outdated schemas.

This patch optmizes the rebuild logic, will use newer
schema (with higher version) to replace schema with
lower version.

Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
---
M src/kudu/tools/kudu-admin-test.cc
M src/kudu/tools/master_rebuilder.cc
2 files changed, 77 insertions(+), 31 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/18496/3
--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 3
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-06 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 2:

(5 comments)

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc
File src/kudu/tools/kudu-admin-test.cc:

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc@3040
PS2, Line 3040: const vector& tserver_idxs,
What if passing just the number of tablet servers here to be used for the 
unsafe_rebuild command, not indices?  So far all the use cases for this method 
use indices from 0 to N, so passing just one number would satisfy the 
requirements.


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/kudu-admin-test.cc@3205
PS2, Line 3205: normal
newer


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc
File src/kudu/tools/master_rebuilder.cc:

http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@228
PS2, Line 228:   auto cleanup = MakeScopedCleanup([&]() {
 : table->mutable_metadata()->CommitMutation();
 :   });
So, we want to commit the mutation even if returning with an error from this 
method?  Is it intended?


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@248
PS2, Line 248: Check consistency
Check for the consistency.


http://gerrit.cloudera.org:8080/#/c/18496/2/src/kudu/tools/master_rebuilder.cc@250
PS2, Line 250:   if (!replica.has_schema_version() ||
 :   replica.schema_version() == metadata->version())
For better readability, add early return here if the condition isn't true.



--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 2
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Fri, 06 May 2022 19:09:27 +
Gerrit-HasComments: Yes


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-06 Thread Abhishek Chennaka (Code Review)
Abhishek Chennaka has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18496 )

Change subject: [tools] update schema if needed when rebuild master
..


Patch Set 2:

Do you think it makes sense to add a test to cover partition schema change too?


--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 2
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Abhishek Chennaka 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Fri, 06 May 2022 17:42:23 +
Gerrit-HasComments: No


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-06 Thread Yingchun Lai (Code Review)
Hello Kudu Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18496

to look at the new patch set (#2).

Change subject: [tools] update schema if needed when rebuild master
..

[tools] update schema if needed when rebuild master

When use 'kudu master unsafe_rebuild' tool to rebuild
master, if the cluster is not health, for example,
some tservers holds outdated schemas (with lower schema
version), we may build tables with outdated schemas.

This patch optmizes the rebuild logic, will use newer
schema (with higher version) to replace schema with
lower version.

Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
---
M src/kudu/tools/kudu-admin-test.cc
M src/kudu/tools/master_rebuilder.cc
2 files changed, 89 insertions(+), 47 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/18496/2
--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 2
Gerrit-Owner: Yingchun Lai 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] [tools] update schema if needed when rebuild master

2022-05-05 Thread Yingchun Lai (Code Review)
Yingchun Lai has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/18496


Change subject: [tools] update schema if needed when rebuild master
..

[tools] update schema if needed when rebuild master

Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
---
M src/kudu/tools/master_rebuilder.cc
1 file changed, 37 insertions(+), 31 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/18496/1
--
To view, visit http://gerrit.cloudera.org:8080/18496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Iec99d57115228b521ba645b8e19c7057a4bb5d3d
Gerrit-Change-Number: 18496
Gerrit-PatchSet: 1
Gerrit-Owner: Yingchun Lai