The *hbase classpath* and *hbase mapredcp* command outputs do include the respective *hbase-shaded-client-byo-hadoop* and *hbase-shaded-mapreduce* jars.
At least the 'hbase mapredcp' jars are used by both Spark and Hive integration, and expected to be available on the node filesystem. We also plan to switch the Phoenix connectors to that. Having those two jars in a separate assembly would require further configuration when installing HBase to tell it where to find them, so that the classpath commands can include them. If something needs to be removed, I propose the full fat ( *hbase-shaded-client*) shaded client JAR. That is never returned by the hbase command AFAIK, and is also the largest in size. (I plan to remove that one from the upcoming Hadoop-less assembly as well) Istvan On Fri, Mar 22, 2024 at 4:55 AM 张铎(Duo Zhang) <palomino...@gmail.com> wrote: > Tested locally, after removing hbase-example from tarball, the hadoop3 > tarball is about 351MB. > > So you could try to include this commit to publish again, to see if this > helps. > > Thanks. > > 张铎(Duo Zhang) <palomino...@gmail.com> 于2024年3月22日周五 09:18写道： > > > > If we exclude hbase-example from the binaries, will it be smaller enough > to fit? > > > > We already commit the changes to master I believe. Let me see if we > > can cherry-pick them and commit to branch-2.6 as well. > > > > Thanks. > > > > Bryan Beaudreault <bbeaudrea...@apache.org> 于2024年3月22日周五 07:35写道： > > > > > > Thanks, I filed > > > https://issues.apache.org/jira/browse/INFRA-25634 > > > > > > On Thu, Mar 21, 2024 at 5:46 PM Andrew Purtell <apurt...@apache.org> > wrote: > > > > > > > The hadoop3 bin tarball for 2.5.8 is 352.8MB. Perhaps we have just > barely > > > > and recently crossed a threshold. File an INFRA JIRA and ask about > it. > > > > Perhaps some limit can be increased, or maybe they will ask us to > live > > > > within it. > > > > > > > > Related, looking at the 2.5.8 hadoop3 bin tarball, the majority of > the bulk > > > > is ./lib/shaded-clients/ . The shaded clients are certainly useful > but > > > > probably are not the most popular options when taking a dependency on > > > > HBase. Perhaps we can package these separately. We could exclude > them from > > > > the convenience tarballs as they will still be available from the > Apache > > > > Maven repository. > > > > > > > > On Thu, Mar 21, 2024 at 2:33 PM Bryan Beaudreault < > bbeaudrea...@apache.org > > > > > > > > > wrote: > > > > > > > > > I got most of the way through, but failed during publish-dist: > > > > > > > > > > Transmitting file data ..svn: E175002: Commit failed (details > follow): > > > > > svn: E175002: PUT request on > > > > > > > > > > > > > > > '/repos/dist/!svn/txr/68050-1le9/dev/hbase/2.6.0RC0/hbase-2.6.0-hadoop3-bin.tar.gz' > > > > > failed > > > > > > > > > > Running manually, it looks to be a Request Entity Too Large. The > file in > > > > > question is 356MB. Anyone have any experience with this? > > > > > > > > > > On Thu, Mar 21, 2024 at 2:19 AM 张铎(Duo Zhang) < > palomino...@gmail.com> > > > > > wrote: > > > > > > > > > > > HBASE-28444 has been resolved. > > > > > > > > > > > > Please go ahead to cut 2.6.0RC0, really a long journey :) > > > > > > > > > > > > 张铎(Duo Zhang) <palomino...@gmail.com> 于2024年3月20日周三 14:29写道： > > > > > > > > > > > > > > There is a security issue for zookeeper, but simply upgrading > > > > > > > zookeeper will break a test. > > > > > > > > > > > > > > Pelase see HBASE-28444 for more details. > > > > > > > > > > > > > > I think we should get this in before cutting the RC. > > > > > > > > > > > > > > Thanks. > > > > > > > > > > > > > > Bryan Beaudreault <bbeaudrea...@apache.org> 于2024年3月19日周二 > 23:51写道： > > > > > > > > > > > > > > > > I've finished auditing fixVersions and run ITBLL for an > extended > > > > > > period of > > > > > > > > time in a real cluster. I'm not aware of any open blockers. > So > > > > > > tomorrow I'm > > > > > > > > going to start generating the RC0. > > > > > > > > > > > > > > > > Please let me know if you have any concerns or reason for > delay. > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Best regards, > > > > Andrew > > > > > > > > Unrest, ignorance distilled, nihilistic imbeciles - > > > > It's what we’ve earned > > > > Welcome, apocalypse, what’s taken you so long? > > > > Bring us the fitting end that we’ve been counting on > > > > - A23, Welcome, Apocalypse > > > > > -- *István Tóth* | Sr. Staff Software Engineer *Email*: st...@cloudera.com cloudera.com <https://www.cloudera.com> [image: Cloudera] <https://www.cloudera.com/> [image: Cloudera on Twitter] <https://twitter.com/cloudera> [image: Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera on LinkedIn] <https://www.linkedin.com/company/cloudera> ------------------------------ ------------------------------
