[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127097#comment-17127097 ] Mustafa Iman commented on HIVE-20359: - [~dlavati] I think we can we leave hbase-handler at old version and upgrade the rest of the system. Protobuf2 Generated classes are not guaranteed to be compatible with protobuf3 runtime ([https://groups.google.com/forum/#!topic/protobuf/AwJlDT8ZWjQ)|https://groups.google.com/forum/#!topic/protobuf/AwJlDT8ZWjQ).] So we need to re-compile the proto files with protobuf3. Luckily wire format of protobuf 2 and 3 are compatible. Only thing is we need to relocate protobuf3 dependency in hive to prevent classpath issues. > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-20359.01.branch-3.1.patch, > HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch, HIVE-20359.01.patch, > HIVE-20359.01.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043566#comment-17043566 ] David Lavati commented on HIVE-20359: - hbase.TestPutResultWritable.testPut is failing due to the protobuf version mismatch: hbase uses protobuf 2.x externally (see [here|https://github.com/apache/hbase/blob/2.0.0-alpha4RC0/pom.xml#L1385]). This is being addressed right now in HBASE-19146, but only for hbase 3 which is ~1 year away from GA. I didn't find any sign of this being addressed for hbase 2.x. HBASE-22394 is also a blocker for upgrading hbase in HIVE-22447 (even if this was fixed in hbase 2.x) > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: David Lavati >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-20359.01.branch-3.1.patch, > HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch, HIVE-20359.01.patch, > HIVE-20359.01.patch > > Time Spent: 10m > Remaining Estimate: 0h > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[
https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043379#comment-17043379
]
Hive QA commented on HIVE-20359:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12994281/HIVE-20359.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 18056 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_handler_snapshot]
(batchId=112)
org.apache.hadoop.hive.hbase.TestPutResultWritable.testPut (batchId=206)
org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits2.testGenericUDTFOrderBySplitCount1
(batchId=290)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/20797/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/20797/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-20797/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12994281 - PreCommit-HIVE-Build
> Update protobuf version in pom.xml
> --
>
> Key: HIVE-20359
> URL: https://issues.apache.org/jira/browse/HIVE-20359
> Project: Hive
> Issue Type: Improvement
> Components: Hive
>Affects Versions: 3.1.0
> Environment: ARM64 Server machines with CentOS/Debian OS.
>Reporter: Naresh Bhat
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-20359.01.branch-3.1.patch,
> HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch, HIVE-20359.01.patch,
> HIVE-20359.01.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The following protoc version's used in hive is very old i.e. 2.5.0
> [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The
> v2.5.0 does not have aarch64 support. But the AArch64 support started from
> v3.5.0 on-words in google's protobuf project release. The hive release
> version branch v3/3.0/3.1/master branch build fails on AArch64 because of old
> protoc version 2.5.0, in which there is no AArch64 support/exe available.
> After I replaced to latest available protoc version 3.6.1 the hive master
> branch pom.xml files, The hive compiled without any issues on ARM64 machine.
> This Jira ticket is used to propose a patch on Hive mailing list
> [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update
> pom.xml files protobuf version. I will also cherry-pick patches for other
> branches v3/3.0/3.1, and create a pull request.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[
https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043355#comment-17043355
]
Hive QA commented on HIVE-20359:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
28s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
34s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 9m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 9m
45s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 9m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 9m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 9m
21s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 1 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 60m 26s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-20797/dev-support/hive-personality.sh
|
| git revision | master / 55275c1 |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-20797/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore . itests/hive-blobstore itests/hive-minikdc
U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-20797/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Update protobuf version in pom.xml
> --
>
> Key: HIVE-20359
> URL: https://issues.apache.org/jira/browse/HIVE-20359
> Project: Hive
> Issue Type: Improvement
> Components: Hive
>Affects Versions: 3.1.0
> Environment: ARM64 Server machines with CentOS/Debian OS.
>Reporter: Naresh Bhat
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-20359.01.branch-3.1.patch,
> HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch, HIVE-20359.01.patch,
> HIVE-20359.01.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The following protoc version's used in hive is very old i.e. 2.5.0
> [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The
> v2.5.0 does not have aarch64 support. But the AArch64 support started from
> v3.5.0 on-words in google's protobuf project release. The hive release
> version branch v3/3.0/3.1/master branch build fails on AArch64 because of old
> protoc version 2.5.0, in which there is no AArch64 support/exe available.
> After I replaced to latest available protoc version 3.6.1 the hive master
> branch pom.xml files, The hive compiled without any issues on ARM64 machine.
> This Jira ticket is used to propose a patch on Hive mailing list
> [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update
> pom.xml files protobuf version. I will also cherry-pick patches for other
> branches v3/3.0/3.1, and create a pull request.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[
https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043013#comment-17043013
]
Hive QA commented on HIVE-20359:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12994249/HIVE-20359.01.branch-3.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 144 failed/errored test(s), 14405 tests
executed
*Failed tests:*
{noformat}
TestAddPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestAddPartitionsFromPartSpec - did not produce a TEST-*.xml file (likely timed
out) (batchId=228)
TestAdminUser - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestAggregateStatsCache - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestAlterPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestAppendPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestBeeLineDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestCachedStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogCaching - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogNonDefaultClient - did not produce a TEST-*.xml file (likely timed
out) (batchId=226)
TestCatalogNonDefaultSvr - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogOldClient - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestCatalogs - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestChainFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestCheckConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestCloseableThreadLocal - did not produce a TEST-*.xml file (likely timed out)
(batchId=333)
TestCustomQueryFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestDatabaseName - did not produce a TEST-*.xml file (likely timed out)
(batchId=195)
TestDatabases - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestDateColumnVector - did not produce a TEST-*.xml file (likely timed out)
(batchId=195)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestDefaultConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestDropPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=274)
TestEmbeddedHiveMetaStore - did not produce a TEST-*.xml file (likely timed
out) (batchId=229)
TestExchangePartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestFMSketchSerialization - did not produce a TEST-*.xml file (likely timed
out) (batchId=238)
TestFilterHooks - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestForeignKey - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestFunctions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestGetPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestGetPartitionsUsingProjectionAndFilterSpecs - did not produce a TEST-*.xml
file (likely timed out) (batchId=230)
TestGetTableMeta - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestGroupFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestHLLNoBias - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHLLSerialization - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHdfsUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestHiveAlterHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestHiveMetaStorePartitionSpecs - did not produce a TEST-*.xml file (likely
timed out) (batchId=228)
TestHiveMetaStoreSchemaMethods - did not produce a TEST-*.xml file (likely
timed out) (batchId=235)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHiveMetaStoreWithEnvironmentContext - did not produce a TEST-*.xml file
(likely timed out) (batchId=232)
TestHiveMetaToolCommandLine - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestHiveMetastoreCli - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestHmsServerAuthorization - did not produce a TEST-*.xml file (likely timed
out) (batchId=235)
TestHyperLogLog - did not produce a
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[
https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042996#comment-17042996
]
Hive QA commented on HIVE-20359:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 20s{color}
| {color:red}
/data/hiveptest/logs/PreCommit-HIVE-Build-20792/patches/PreCommit-HIVE-Build-20792.patch
does not apply to master. Rebase required? Wrong Branch? See
http://cwiki.apache.org/confluence/display/Hive/HowToContribute for help.
{color} |
\\
\\
|| Subsystem || Report/Notes ||
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-20792/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Update protobuf version in pom.xml
> --
>
> Key: HIVE-20359
> URL: https://issues.apache.org/jira/browse/HIVE-20359
> Project: Hive
> Issue Type: Improvement
> Components: Hive
>Affects Versions: 3.1.0
> Environment: ARM64 Server machines with CentOS/Debian OS.
>Reporter: Naresh Bhat
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-20359.01.branch-3.1.patch,
> HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch, HIVE-20359.01.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The following protoc version's used in hive is very old i.e. 2.5.0
> [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The
> v2.5.0 does not have aarch64 support. But the AArch64 support started from
> v3.5.0 on-words in google's protobuf project release. The hive release
> version branch v3/3.0/3.1/master branch build fails on AArch64 because of old
> protoc version 2.5.0, in which there is no AArch64 support/exe available.
> After I replaced to latest available protoc version 3.6.1 the hive master
> branch pom.xml files, The hive compiled without any issues on ARM64 machine.
> This Jira ticket is used to propose a patch on Hive mailing list
> [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update
> pom.xml files protobuf version. I will also cherry-pick patches for other
> branches v3/3.0/3.1, and create a pull request.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042933#comment-17042933 ] Naresh Bhat commented on HIVE-20359: [~dlavati] Thank you very much. I will check the fix on ARM64. > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: David Lavati >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-20359.01.branch-3.1.patch, HIVE-20359.01.patch > > Time Spent: 10m > Remaining Estimate: 0h > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041740#comment-17041740 ] David Lavati commented on HIVE-20359: - I see this hasn't been touched for a while and [3.11.4|https://github.com/protocolbuffers/protobuf/releases/tag/v3.11.4] is the latest release since then, [~nbhat] I'm taking a shot at this, if you don't mind. > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006625#comment-17006625 ] liusheng commented on HIVE-20359: - Hi, Thanks for [~nbhat] brought this up, can this issue be taken care again. we have same requirement about running Hive on ARM platform. In Hadoop, we have pushed forward similar things which have almost been done. > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598451#comment-16598451 ] Naresh Bhat commented on HIVE-20359: Can someone from community comment on the patch ? > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575941#comment-16575941 ] Naresh Bhat commented on HIVE-20359: The pull is created here for master branch [https://github.com/apache/hive/pull/413] Let me know your review/feedback on the patch. > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575939#comment-16575939 ] ASF GitHub Bot commented on HIVE-20359: --- GitHub user nareshgbhat opened a pull request: https://github.com/apache/hive/pull/413 HIVE-20359: Update protobuf to v3.6.1 The AArch64 support is released from v3.5.0 onwords. Hence update all the pom.xml files to use the latest available prtobuf version. v3.6.1: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/ Signed-off-by: Naresh Bhat You can merge this pull request into a Git repository by running: $ git pull https://github.com/nareshgbhat/hive HIVE-20359_branch-master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/413.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #413 commit 3c078321e9509b23a0f21b7d168815a3554a7e87 Author: Naresh Bhat Date: 2018-08-08T11:16:08Z HIVE-20359: Update protobuf to v3.6.1 The AArch64 support is released from v3.5.0 onwords. Hence update all the pom.xml files to use the latest available prtobuf version. v3.6.1: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/ Signed-off-by: Naresh Bhat > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575915#comment-16575915 ] Naresh Bhat commented on HIVE-20359: The pull is created here for branch-3.1 [https://github.com/apache/hive/pull/412] > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20359) Update protobuf version in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575912#comment-16575912 ] ASF GitHub Bot commented on HIVE-20359: --- GitHub user nareshgbhat opened a pull request: https://github.com/apache/hive/pull/412 HIVE-20359: Update protobuf to v3.6.1 The AArch64 support is released from v3.5.0 onwords. Hence update all the pom.xml files to use the latest available prtobuf version. v3.6.1: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/ Signed-off-by: Naresh Bhat You can merge this pull request into a Git repository by running: $ git pull https://github.com/nareshgbhat/hive HIVE-20359_branch-3.1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/412.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #412 commit c91cd6902006aefa058c6fbd495faf055d5c9215 Author: Naresh Bhat Date: 2018-08-10T07:23:07Z HIVE-20359: Update protobuf to v3.6.1 The AArch64 support is released from v3.5.0 onwords. Hence update all the pom.xml files to use the latest available prtobuf version. v3.6.1: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/ Signed-off-by: Naresh Bhat > Update protobuf version in pom.xml > -- > > Key: HIVE-20359 > URL: https://issues.apache.org/jira/browse/HIVE-20359 > Project: Hive > Issue Type: Improvement > Components: Hive >Affects Versions: 3.1.0 > Environment: ARM64 Server machines with CentOS/Debian OS. >Reporter: Naresh Bhat >Assignee: Naresh Bhat >Priority: Major > Labels: pull-request-available > Fix For: 3.1.0 > > > The following protoc version's used in hive is very old i.e. 2.5.0 > [https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/] . The > v2.5.0 does not have aarch64 support. But the AArch64 support started from > v3.5.0 on-words in google's protobuf project release. The hive release > version branch v3/3.0/3.1/master branch build fails on AArch64 because of old > protoc version 2.5.0, in which there is no AArch64 support/exe available. > After I replaced to latest available protoc version 3.6.1 the hive master > branch pom.xml files, The hive compiled without any issues on ARM64 machine. > This Jira ticket is used to propose a patch on Hive mailing list > [https://git.linaro.org/people/naresh.bhat/apache/hive.git/] to update > pom.xml files protobuf version. I will also cherry-pick patches for other > branches v3/3.0/3.1, and create a pull request. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
