Bharath Vissapragada has posted comments on this change. ( http://gerrit.cloudera.org:8080/14307 )
Change subject: IMPALA-7506: support global INVALIDATE METADATA in local catalog mode ...................................................................... Patch Set 5: (2 comments) http://gerrit.cloudera.org:8080/#/c/14307/5/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java File fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java: http://gerrit.cloudera.org:8080/#/c/14307/5/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java@1104 PS5, Line 1104: if (ctx.collectFullUpdates || tbl.getCatalogVersion() <= ctx.toVersion) { > I've tried tracking the min catalog versions in local-catalog mode coordina I see what you are saying, nice find. Agree that we shouldn't take any locks while operating inside Guava's cache context, might lead to performance problems. I can't think of a race-free approach without synchronizing both the operations. http://gerrit.cloudera.org:8080/#/c/14307/5/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java@1104 PS5, Line 1104: if (ctx.collectFullUpdates || tbl.getCatalogVersion() <= ctx.toVersion) { > For your concerns, I think it's ok since we already have the logic to force I guess its ok since invalidate metadata is special operation on the entire catalog state. We should probably document this if we end up taking this approach. I don't know what the other reviewers think of this approach. Todd, Vihang? -- To view, visit http://gerrit.cloudera.org:8080/14307 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ib61a7ab1ffa062620ffbc2dadc34bd7a8ca9e549 Gerrit-Change-Number: 14307 Gerrit-PatchSet: 5 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Bharath Vissapragada <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Todd Lipcon <[email protected]> Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]> Gerrit-Comment-Date: Thu, 17 Oct 2019 16:28:54 +0000 Gerrit-HasComments: Yes
