[
https://issues.apache.org/jira/browse/TEZ-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18118056#comment-18118056
]
Sercan Tekin commented on TEZ-4653:
-----------------------------------
[~abstractdog], I have created a PR for this task ->
https://github.com/apache/tez/pull/541
*SOLUTION*
Upgraded commons-io from {{2.16.0}} to {{2.22.0}}, the latest version available
at the moment. We might consider updating the title if this solution is
accepted.
*CHECKS*
Dependency tree before the upgrade:
{code:java}
> mvn dependency:tree -Dincludes=commons-io:* | grep 'commons-io:commons-io'
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
{code}
Dependency tree after the upgrade:
{code:java}
> mvn dependency:tree -Dincludes=commons-io:* | grep 'commons-io:commons-io'
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
{code}
Verified that both Tez distributions contain the upgraded dependency:
{code:java}
> ll tez-dist/target/tez-1.0.0-SNAPSHOT/lib/ | grep commons-io
-rw-r--r-- 1 609182 Jan 9 2026 commons-io-2.22.0.jar
> ll tez-dist/target/tez-1.0.0-SNAPSHOT-minimal/lib/ | grep commons-io
-rw-r--r-- 1 609182 Jan 9 2026 commons-io-2.22.0.jar
{code}
Basic functionality test with Hive 4.2.1:
{code:java}
hive> CREATE TABLE test (id INT);
Time taken: 1.276 seconds
hive> INSERT INTO test VALUES (1);
Total jobs = 1
Launching Job 1 out of 1
Status: Running (Executing on YARN cluster with App id
application_1790085661540_0001)
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
Reducer 2 ...... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 5.49 s
----------------------------------------------------------------------------------------------
Loading data to table default.test
Time taken to move files: 0 ms
StatsTask took 206
Time taken: 7.473 seconds
hive>
{code}
> Upgrade commons-io to the latest 2.20.0
> ---------------------------------------
>
> Key: TEZ-4653
> URL: https://issues.apache.org/jira/browse/TEZ-4653
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: László Bodor
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
