[
https://issues.apache.org/jira/browse/HIVE-26954?focusedWorklogId=843383&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-843383
]
ASF GitHub Bot logged work on HIVE-26954:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Feb/23 06:23
Start Date: 03/Feb/23 06:23
Worklog Time Spent: 10m
Work Description: akshat0395 commented on PR #4012:
URL: https://github.com/apache/hive/pull/4012#issuecomment-1415105579
> @akshat0395, **_one question_**: Shouldn't we need to be in-sync with
Hadoop (3.3.1 used in hive) on avro version even though we are already ahead.
Because difference in file format version might cause problem. Because I think
the hadoop jars will be loaded first in classpath which will already contain
hadoop avro version (1.7.7)?
>
> There is some discussion on same for this on PR 3878
([HIVE-26829](https://issues.apache.org/jira/browse/HIVE-26829)).
Thanks @Aggarwal-Raghav for sharing these details, I wasn't aware that there
is a similar discussion going on.
You made some valid points, I think the solution to which could be extensive
testing.
Right now I've run some similar tests that you have done in your upgrade,
which seems to work fine to me, and after going to the discussion I feel
writing some qtest and some unit test around avro APIs that are used in Hive
might help confirming if the upgrade is safe or not, Till then this can be
marked in progress.
Regarding compatibility with Hadoop, as we are already ahead of Hadoop and
the changes seems to be backward compatible I dont think upgrade should be a
problem there.
Also I do agree with @cnauroth regrading the upgrade to 1.11.1 rather than
1.11.0.
@Aggarwal-Raghav @cnauroth Please let me know what do you think about the
proposed testing solution.
Issue Time Tracking
-------------------
Worklog Id: (was: 843383)
Time Spent: 40m (was: 0.5h)
> Upgrade Avro to 1.11.1
> ----------------------
>
> Key: HIVE-26954
> URL: https://issues.apache.org/jira/browse/HIVE-26954
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 4.0.0
> Reporter: Akshat Mathur
> Assignee: Akshat Mathur
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Upgrade Avro dependencies to 1.11.1
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
