[
https://issues.apache.org/jira/browse/HDFS-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17787525#comment-17787525
]
ASF GitHub Bot commented on HDFS-16791:
---------------------------------------
mccormickt12 commented on PR #6262:
URL: https://github.com/apache/hadoop/pull/6262#issuecomment-1817608978
@steveloughran This kind of seems like yetus issues to me now.
https://github.com/apache/hadoop/pull/6262#issuecomment-1806549653 This
check was good after I fixed the path import (you can tell from the revision)
I also locally saw one other failure locally which was the protobuf static
import thats not in 3.3.
From a local build i get this (i get this vectorized failure locally even on
trunk and 3.3 branch, as do others at LinkedIn)
```
[INFO] Reactor Summary for Apache Hadoop Main 3.3.9-SNAPSHOT:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 2.175
s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [ 1.702
s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 1.783
s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 4.200
s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.440
s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 2.311
s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 4.932
s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 1.763
s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 14.290
s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 3.420
s]
[INFO] Apache Hadoop Common ............................... SUCCESS [ 52.162
s]
[INFO] Apache Hadoop NFS .................................. SUCCESS [ 5.820
s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [ 4.902
s]
[INFO] Apache Hadoop Registry ............................. SUCCESS [ 4.801
s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [ 0.221
s]
[INFO] Apache Hadoop HDFS Client .......................... SUCCESS [ 27.815
s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [01:03
min]
[INFO] Apache Hadoop HDFS Native Client ................... SUCCESS [ 6.074
s]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [ 7.388
s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [ 8.744
s]
[INFO] Apache Hadoop HDFS-RBF ............................. SUCCESS [ 16.316
s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [ 0.110
s]
[INFO] Apache Hadoop YARN ................................. SUCCESS [ 0.115
s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [ 16.592
s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [ 19.048
s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [ 0.151
s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [ 18.680
s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [ 16.008
s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [ 5.339
s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [ 6.741
s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [ 5.562
s]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [ 28.425
s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [ 12.229
s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [ 11.407
s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [ 6.134
s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [ 6.123
s]
[INFO] Apache Hadoop YARN TimelineService HBase Backend ... SUCCESS [ 0.100
s]
[INFO] Apache Hadoop YARN TimelineService HBase Common .... SUCCESS [ 6.191
s]
[INFO] Apache Hadoop YARN TimelineService HBase Client .... SUCCESS [ 8.402
s]
[INFO] Apache Hadoop YARN TimelineService HBase Servers ... SUCCESS [ 0.223
s]
[INFO] Apache Hadoop YARN TimelineService HBase Server 1.2 SUCCESS [ 8.135
s]
[INFO] Apache Hadoop YARN TimelineService HBase tests ..... SUCCESS [ 6.883
s]
[INFO] Apache Hadoop YARN Router .......................... SUCCESS [ 6.092
s]
[INFO] Apache Hadoop YARN TimelineService DocumentStore ... SUCCESS [ 6.275
s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [ 0.202
s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [ 6.363
s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [ 4.921
s]
[INFO] Apache Hadoop MapReduce Client ..................... SUCCESS [ 3.996
s]
[INFO] Apache Hadoop MapReduce Core ....................... SUCCESS [ 12.177
s]
[INFO] Apache Hadoop MapReduce Common ..................... SUCCESS [ 8.662
s]
[INFO] Apache Hadoop MapReduce Shuffle .................... SUCCESS [ 16.345
s]
[INFO] Apache Hadoop MapReduce App ........................ SUCCESS [ 35.711
s]
[INFO] Apache Hadoop MapReduce HistoryServer .............. SUCCESS [ 7.221
s]
[INFO] Apache Hadoop MapReduce JobClient .................. SUCCESS [ 16.106
s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [ 6.607
s]
[INFO] Apache Hadoop YARN Services ........................ SUCCESS [ 0.121
s]
[INFO] Apache Hadoop YARN Services Core ................... SUCCESS [ 9.997
s]
[INFO] Apache Hadoop YARN Services API .................... SUCCESS [ 11.396
s]
[INFO] Apache Hadoop YARN Application Catalog ............. SUCCESS [ 0.164
s]
[INFO] Apache Hadoop YARN Application Catalog Webapp ...... SUCCESS [ 30.373
s]
[INFO] Apache Hadoop YARN Application Catalog Docker Image SUCCESS [ 1.290
s]
[INFO] Apache Hadoop YARN Application MaWo ................ SUCCESS [ 0.109
s]
[INFO] Apache Hadoop YARN Application MaWo Core ........... SUCCESS [ 4.645
s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [ 0.161
s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [ 3.270
s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [ 0.213
s]
[INFO] Apache Hadoop YARN CSI ............................. SUCCESS [ 18.946
s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [ 40.277
s]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins ...... SUCCESS [ 4.629
s]
[INFO] Apache Hadoop MapReduce NativeTask ................. SUCCESS [ 6.116
s]
[INFO] Apache Hadoop MapReduce Uploader ................... SUCCESS [ 4.928
s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [ 7.062
s]
[INFO] Apache Hadoop MapReduce ............................ SUCCESS [ 9.783
s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [ 7.484
s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [ 7.579
s]
[INFO] Apache Hadoop Client Aggregator .................... SUCCESS [ 6.449
s]
[INFO] Apache Hadoop Dynamometer Workload Simulator ....... SUCCESS [ 5.438
s]
[INFO] Apache Hadoop Dynamometer Cluster Simulator ........ SUCCESS [ 7.000
s]
[INFO] Apache Hadoop Dynamometer Block Listing Generator .. SUCCESS [ 5.220
s]
[INFO] Apache Hadoop Dynamometer Dist ..................... SUCCESS [ 14.487
s]
[INFO] Apache Hadoop Dynamometer .......................... SUCCESS [ 0.112
s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [ 5.620
s]
[INFO] Apache Hadoop Archive Logs ......................... SUCCESS [ 5.841
s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [ 6.825
s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [ 24.614
s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [ 15.760
s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [ 6.101
s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [ 0.132
s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [ 17.450
s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [ 3.482
s]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [ 11.015
s]
[INFO] Apache Hadoop Aliyun OSS support ................... SUCCESS [ 4.691
s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 6.107
s]
[INFO] Apache Hadoop Resource Estimator Service ........... SUCCESS [ 4.900
s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [ 4.188
s]
[INFO] Apache Hadoop Image Generation Tool ................ SUCCESS [ 6.270
s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 34.632
s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [ 3.371
s]
[INFO] Apache Hadoop Common Benchmark ..................... FAILURE [ 19.398
s]
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Client API ........................... SKIPPED
[INFO] Apache Hadoop Client Runtime ....................... SKIPPED
[INFO] Apache Hadoop Client Packaging Invariants .......... SKIPPED
[INFO] Apache Hadoop Client Test Minicluster .............. SKIPPED
[INFO] Apache Hadoop Client Packaging Invariants for Test . SKIPPED
[INFO] Apache Hadoop Client Packaging Integration Tests ... SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] Apache Hadoop Client Modules ....................... SKIPPED
[INFO] Apache Hadoop Tencent COS Support .................. SKIPPED
[INFO] Apache Hadoop Cloud Storage ........................ SKIPPED
[INFO] Apache Hadoop Cloud Storage Project ................ SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 15:36 min
[INFO] Finished at: 2023-11-18T11:43:02-08:00
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.4:single (make-assembly) on
project hadoop-benchmark: Failed to create assembly: Error creating assembly
archive uber: Problem creating jar:
jar:file:/Users/tmccormi/projects/hadoop/hadoop-tools/hadoop-benchmark/target/hadoop-benchmark-3.3.9-SNAPSHOT.jar!/org/apache/hadoop/benchmark/generated/VectoredReadBenchmark_jmhType_B1.class
-> [Help 1]
[ERROR]
```
Im gonna try reverting the last commit (although it seems needed) to see if
yetus likes it more
> Add getEnclosingRoot() API to filesystem interface and implementations
> ----------------------------------------------------------------------
>
> Key: HDFS-16791
> URL: https://issues.apache.org/jira/browse/HDFS-16791
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: fs
> Affects Versions: 3.3.6
> Reporter: Tom McCormick
> Assignee: Tom McCormick
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
>
> At LinkedIn we run many HDFS volumes that are federated by either
> ViewFilesystem or Router Based Federation. As our number of hdfs volumes
> grows, we have a growing need to migrate data seemlessly across volumes.
> Many frameworks have a notion of staging or temp directories, but those
> directories often live in random locations. We want an API getEnclosingRoot,
> which provides the root path a file or dataset.
> In ViewFilesystem / Router Based Federation, the enclosingRoot will be the
> mount point.
> We will also take into account other restrictions for renames like
> encryptions zones.
> If there are several paths (a mount point and an encryption zone), we will
> return the longer path
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
