[
https://issues.apache.org/jira/browse/HIVE-26367?focusedWorklogId=787728&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-787728
]
ASF GitHub Bot logged work on HIVE-26367:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Jul/22 05:35
Start Date: 05/Jul/22 05:35
Worklog Time Spent: 10m
Work Description: abstractdog commented on PR #3413:
URL: https://github.com/apache/hive/pull/3413#issuecomment-1174633880
thanks @ayushtkn , I fixed TestLlapTaskCommunicator
in the precommit I can see mass failures, e.g. in TestMmCompactorOnMr, where
hive.log contains:
```
Caused by: java.lang.NoSuchMethodError:
org.apache.hadoop.fs.Path.compareTo(Lorg/apache/hadoop/fs/Path;)I
at org.apache.hadoop.io.FileChunk.compareTo(FileChunk.java:82)
~[tez-runtime-library-0.10.2.jar:?]
at org.apache.hadoop.io.FileChunk.compareTo(FileChunk.java:27)
~[tez-runtime-library-0.10.2.jar:?]
at java.util.TreeMap.compare(TreeMap.java:1294) ~[?:1.8.0_292]
at java.util.TreeMap.put(TreeMap.java:538) ~[?:1.8.0_292]
at java.util.TreeSet.add(TreeSet.java:255) ~[?:1.8.0_292]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.closeOnDiskFile(MergeManager.java:598)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MapOutput$DiskDirectMapOutput.commit(MapOutput.java:188)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.copySucceeded(ShuffleScheduler.java:605)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.setupLocalDiskFetch(FetcherOrderedGrouped.java:739)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.fetchNext(FetcherOrderedGrouped.java:183)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:198)
~[tez-runtime-library-0.10.2.jar:0.10.2]
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:61)
~[tez-runtime-library-0.10.2.jar:0.10.2]
... 7 more
```
is it something related to the fact that tez 0.10.2 was compiled against the
newer hadoop? if it's only the case, we'll simply merge tez and hadoop upgrade
together
Issue Time Tracking
-------------------
Worklog Id: (was: 787728)
Time Spent: 0.5h (was: 20m)
> Upgrade to tez 0.10.2
> ----------------------
>
> Key: HIVE-26367
> URL: https://issues.apache.org/jira/browse/HIVE-26367
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0-alpha-2
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
