[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462059#comment-17462059
]
Hudson commented on HBASE-26541:
Results for branch branch-2.4
[build #260 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/260/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/260/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/260/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/260/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/260/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2, 2.4.9, 2.6.0
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456668#comment-17456668
]
Hudson commented on HBASE-26541:
Results for branch branch-2
[build #413 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
-- Something went wrong with this stage, [check relevant console
output|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/413//console].
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2, 2.6.0
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456444#comment-17456444
]
Hudson commented on HBASE-26541:
Results for branch master
[build #464 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/464/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/464/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/464/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/464/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2, 2.6.0
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454760#comment-17454760
]
Andrew Kyle Purtell commented on HBASE-26541:
-
For branch-2, we also have this problem.
{noformat}
[ERROR] Failed to execute goal
org.xolstice.maven.plugins:protobuf-maven-plugin:0.6.1:compile (compile-protoc)
on project hbase-protocol: Unable to resolve artifact: Missing:
[ERROR] --
[ERROR] 1) com.google.protobuf:protoc:exe:osx-aarch_64:2.5.0
[ERROR]
[ERROR] Try downloading the file manually from the project website.
[ERROR]
[ERROR] Then, install it using the command:
[ERROR] mvn install:install-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=2.5.0 -Dclassifier=osx-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file
[ERROR]
[ERROR] Alternatively, if you host your own repository you can deploy the
file there:
[ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=2.5.0 -Dclassifier=osx-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR] Path to dependency:
[ERROR] 1) org.apache.hbase:hbase-protocol:jar:2.5.0-SNAPSHOT
[ERROR] 2) com.google.protobuf:protoc:exe:osx-aarch_64:2.5.0
[ERROR]
[ERROR] --
[ERROR] 1 required artifact is missing.
[ERROR]
[ERROR] for artifact:
[ERROR] org.apache.hbase:hbase-protocol:jar:2.5.0-SNAPSHOT
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR] apache.snapshots (https://repository.apache.org/snapshots,
releases=false, snapshots=true),
[ERROR] central (https://repo.maven.apache.org/maven2, releases=true,
snapshots=false)
{noformat}
The solution is
https://gist.github.com/liusheng/64aee1b27de037f8b9ccf1873b82c413
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
> - Upgrade internal.protobuf.version to 3.17.3.
> - any.proto include not found. Get it from github.com/google/protobuf and add
> it.
> - Warbucks rule fails because of any.proto. Disable warbucks just in
> hbase-protobuf-shaded.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454755#comment-17454755
]
Andrew Kyle Purtell commented on HBASE-26541:
-
bq. I did a manual install and encountered the any.proto problem.
My guess is the binary 'protoc' in Maven central is a special version that
handles any.proto differently. If you do something like this instead
{noformat}
$ git clone https://github.com/google/protobuf
$ cd protobuf
$ git checkout v3.11.4
(Apply the ARM64 atomics patch from a later version)
$ sh autogen.sh
$ ./configure ...
$ make
$ sudo make install
$ mvn install:install-file -DgroupId=com.google.protobuf -DartifactId=protoc
-Dversion=3.11.4 -Dclassifier=osx-aarch_64 -Dpackaging=exe
-Dfile=/path/to/protoc
{noformat}
it does not work and the error message is "_[ERROR] PROTOC FAILED:
google/protobuf/any.proto: File not found._"
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
> - Upgrade internal.protobuf.version to 3.17.3.
> - any.proto include not found. Get it from github.com/google/protobuf and add
> it.
> - Warbucks rule fails because of any.proto. Disable warbucks just in
> hbase-protobuf-shaded.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[
https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454738#comment-17454738
]
Andrew Kyle Purtell commented on HBASE-26541:
-
The first issue is this:
{noformat}
[ERROR] Failed to execute goal
org.xolstice.maven.plugins:protobuf-maven-plugin:0.6.1:compile (compile-protoc)
on project hbase-protocol-shaded: Unable to resolve artifact: Missing:
[ERROR] --
[ERROR] 1) com.google.protobuf:protoc:exe:osx-aarch_64:3.11.4
[ERROR]
[ERROR] Try downloading the file manually from the project website.
[ERROR]
[ERROR] Then, install it using the command:
[ERROR] mvn install:install-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=3.11.4 -Dclassifier=osx-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file
[ERROR]
[ERROR] Alternatively, if you host your own repository you can deploy the
file there:
[ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=3.11.4 -Dclassifier=osx-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR] Path to dependency:
[ERROR] 1)
org.apache.hbase:hbase-protocol-shaded:jar:3.0.0-alpha-2-SNAPSHOT
[ERROR] 2) com.google.protobuf:protoc:exe:osx-aarch_64:3.11.4
[ERROR]
[ERROR] --
[ERROR] 1 required artifact is missing.
[ERROR]
[ERROR] for artifact:
[ERROR] org.apache.hbase:hbase-protocol-shaded:jar:3.0.0-alpha-2-SNAPSHOT
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR] apache.snapshots (https://repository.apache.org/snapshots,
releases=false, snapshots=true),
[ERROR] central (https://repo.maven.apache.org/maven2, releases=true,
snapshots=false)
{noformat}
To cure this, you can either manually install protobuf (although 3.11.4 is
missing ARM64 atomics and will not compile without a backport in protobuf of
some patch from a later version) per the instructions or upgrade the version.
Version 3.17.3 was mentioned elsewhere as a version which has an ARM64 EXE
available in Maven central.
I did a manual install and encountered the any.proto problem.
Going through this again (first I rm -rf ~/.m2/repository/com/google), it seems
just the version change is enough. I have updated the PRs.
> hbase-protocol-shaded not buildable on M1 MacOSX
>
>
> Key: HBASE-26541
> URL: https://issues.apache.org/jira/browse/HBASE-26541
> Project: HBase
> Issue Type: Bug
>Affects Versions: 2.5.0, 2.4.8
> Environment: Apache Maven 3.8.3
> (ff8e977a158738155dc465c6a97ffaf31982d739)
> Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime:
> /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
> OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac"
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> I needed to make some changes to get branch-2's hbase-protocol-shaded
> building on an M1 mac.
> - Upgrade internal.protobuf.version to 3.17.3.
> - any.proto include not found. Get it from github.com/google/protobuf and add
> it.
> - Warbucks rule fails because of any.proto. Disable warbucks just in
> hbase-protobuf-shaded.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[ https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454651#comment-17454651 ] Duo Zhang commented on HBASE-26541: --- And what is the problem for using protobuf 3.11.4? The version number is just for protoc I think, the java files which are generated by the protoc are not compatible with the protobuf version in hbase-protobuf-shaded? Strange... > hbase-protocol-shaded not buildable on M1 MacOSX > > > Key: HBASE-26541 > URL: https://issues.apache.org/jira/browse/HBASE-26541 > Project: HBase > Issue Type: Bug >Affects Versions: 2.5.0, 2.4.8 > Environment: Apache Maven 3.8.3 > (ff8e977a158738155dc465c6a97ffaf31982d739) > Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime: > /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre > OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac" >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Major > Fix For: 2.5.0, 3.0.0-alpha-2 > > > I needed to make some changes to get branch-2's hbase-protocol-shaded > building on an M1 mac. > - Upgrade internal.protobuf.version to 3.17.3. > - any.proto include not found. Get it from github.com/google/protobuf and add > it. > - Warbucks rule fails because of any.proto. Disable warbucks just in > hbase-protobuf-shaded. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (HBASE-26541) hbase-protocol-shaded not buildable on M1 MacOSX
[ https://issues.apache.org/jira/browse/HBASE-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454649#comment-17454649 ] Duo Zhang commented on HBASE-26541: --- We do have any.proto in our hbase-shaded-protobuf, you can unzip the hbase-shaded-protobuf.jar and check the content, it is under the google/protobuf directory. Could you please provide more information about the failure on M1 mac? Paste the maven output? > hbase-protocol-shaded not buildable on M1 MacOSX > > > Key: HBASE-26541 > URL: https://issues.apache.org/jira/browse/HBASE-26541 > Project: HBase > Issue Type: Bug >Affects Versions: 2.5.0, 2.4.8 > Environment: Apache Maven 3.8.3 > (ff8e977a158738155dc465c6a97ffaf31982d739) > Java version: 1.8.0_312, vendor: Azul Systems, Inc., runtime: > /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre > OS name: "mac os x", version: "12.0.1", arch: "aarch64", family: "mac" >Reporter: Andrew Kyle Purtell >Assignee: Andrew Kyle Purtell >Priority: Major > Fix For: 2.5.0, 3.0.0-alpha-2 > > > I needed to make some changes to get branch-2's hbase-protocol-shaded > building on an M1 mac. > - Upgrade internal.protobuf.version to 3.17.3. > - any.proto include not found. Get it from github.com/google/protobuf and add > it. > - Warbucks rule fails because of any.proto. Disable warbucks just in > hbase-protobuf-shaded. -- This message was sent by Atlassian Jira (v8.20.1#820001)
