[ https://issues.apache.org/jira/browse/HBASE-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17725544#comment-17725544 ]
Pratyush Bhatt commented on HBASE-27877: ---------------------------------------- Yes, works after that: {noformat} hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dhbase.fs.tmp.dir=ofs://ozone1/vol1/bucket1/hbase/bulkload -Dimporttsv.columns=HBASE_ROW_KEY,d:c1,d:c2 -Dimporttsv.bulk.output=ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/hfiles -Dfs.defaultFS=ofs://ozone1 table_rcb9lbo3ao ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/data.tsv{noformat} Works fine: {noformat} 2023-05-23 14:31:05,739|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:05 INFO impl.YarnClientImpl: Submitted application application_1684781789150_0051 2023-05-23 14:31:05,794|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:05 INFO mapreduce.Job: The url to track the job: https://ozn-lease16-2.ozn-lease16.root.hwx.site:8090/proxy/application_1684781789150_0051/ 2023-05-23 14:31:05,795|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:05 INFO mapreduce.Job: Running job: job_1684781789150_0051 2023-05-23 14:31:20,018|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:20 INFO mapreduce.Job: Job job_1684781789150_0051 running in uber mode : false 2023-05-23 14:31:20,019|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:20 INFO mapreduce.Job: map 0% reduce 0% 2023-05-23 14:31:32,179|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:32 INFO mapreduce.Job: map 100% reduce 0% 2023-05-23 14:31:46,301|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:46 INFO mapreduce.Job: map 100% reduce 100% 2023-05-23 14:31:47,327|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:47 INFO mapreduce.Job: Job job_1684781789150_0051 completed successfully 2023-05-23 14:31:47,457|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|23/05/23 14:31:47 INFO mapreduce.Job: Counters: 54 2023-05-23 14:31:47,457|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|File System Counters 2023-05-23 14:31:47,457|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|FILE: Number of bytes read=171 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|FILE: Number of bytes written=616435 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|FILE: Number of read operations=0 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|FILE: Number of large read operations=0 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|FILE: Number of write operations=0 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|OFS: Number of bytes read=257 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|OFS: Number of bytes written=5617 2023-05-23 14:31:47,458|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|OFS: Number of read operations=12 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|OFS: Number of large read operations=0 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|OFS: Number of write operations=2 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Job Counters 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Launched map tasks=1 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Launched reduce tasks=1 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Rack-local map tasks=1 2023-05-23 14:31:47,459|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total time spent by all maps in occupied slots (ms)=10227 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total time spent by all reduces in occupied slots (ms)=11587 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total time spent by all map tasks (ms)=10227 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total time spent by all reduce tasks (ms)=11587 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total vcore-milliseconds taken by all map tasks=10227 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total vcore-milliseconds taken by all reduce tasks=11587 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total megabyte-milliseconds taken by all map tasks=10472448 2023-05-23 14:31:47,460|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total megabyte-milliseconds taken by all reduce tasks=11865088 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Map-Reduce Framework 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Map input records=10 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Map output records=10 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Map output bytes=682 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Map output materialized bytes=167 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Input split bytes=146 2023-05-23 14:31:47,461|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Combine input records=10 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Combine output records=10 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Reduce input groups=10 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Reduce shuffle bytes=167 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Reduce input records=10 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Reduce output records=20 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Spilled Records=20 2023-05-23 14:31:47,462|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Shuffled Maps =1 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Failed Shuffles=0 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Merged Map outputs=1 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|GC time elapsed (ms)=622 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|CPU time spent (ms)=10590 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Physical memory (bytes) snapshot=1212309504 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Virtual memory (bytes) snapshot=5442088960 2023-05-23 14:31:47,463|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Total committed heap usage (bytes)=1026031616 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Peak Map Physical memory (bytes)=704102400 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Peak Map Virtual memory (bytes)=2711535616 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Peak Reduce Physical memory (bytes)=508207104 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Peak Reduce Virtual memory (bytes)=2730553344 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|ImportTsv 2023-05-23 14:31:47,464|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Bad Lines=0 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Shuffle Errors 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|BAD_ID=0 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|CONNECTION=0 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|IO_ERROR=0 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|WRONG_LENGTH=0 2023-05-23 14:31:47,465|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|WRONG_MAP=0 2023-05-23 14:31:47,466|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|WRONG_REDUCE=0 2023-05-23 14:31:47,466|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|File Input Format Counters 2023-05-23 14:31:47,466|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Bytes Read=111 2023-05-23 14:31:47,466|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|File Output Format Counters 2023-05-23 14:31:47,466|INFO|MainThread|machine.py:203 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Bytes Written=5617 2023-05-23 14:31:47,934|INFO|MainThread|machine.py:230 - run()||GUID=f2b9a0c7-f1aa-4923-ab51-f7c9d8a92d09|Exit Code: 0 2023-05-23 14:31:47,941|INFO|MainThread|machine.py:188 - run()||GUID=47a1aecd-f694-42f4-8537-f5fcf1945087|RUNNING: sudo{noformat} > Hbase ImportTsv doesn't take ofs:// as a FS > ------------------------------------------- > > Key: HBASE-27877 > URL: https://issues.apache.org/jira/browse/HBASE-27877 > Project: HBase > Issue Type: Bug > Reporter: Pratyush Bhatt > Priority: Major > Labels: ozone > > While running the bulkLoad command: > {noformat} > hbase org.apache.hadoop.hbase.mapreduce.ImportTsv > -Dhbase.fs.tmp.dir=ofs://ozone1/vol1/bucket1/hbase/bulkload > -Dimporttsv.columns=HBASE_ROW_KEY,d:c1,d:c2 > -Dimporttsv.bulk.output=ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/hfiles > table_dau3f3374e > ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/data.tsv{noformat} > Getting: > {noformat} > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|Exception in thread "main" > java.lang.IllegalArgumentException: Wrong FS: > ofs://ozone1/vol1/bucket1/hbase/bulkload/partitions_72cbb1f1-d9b6-46a4-be39-e27a427c5842, > expected: hdfs://ns1{noformat} > Complete trace: > {noformat} > server-resourcemanager-3.1.1.7.1.8.3-339.jar:/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p3.40935426/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-registry-3.1.1.7.1.8.3-339.jar > 2023-05-22 17:01:19,925|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client > environment:java.library.path=/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p3.40935426/bin/../lib/hadoop/lib/native > 2023-05-22 17:01:19,925|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp > 2023-05-22 17:01:19,925|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:java.compiler=<NA> > 2023-05-22 17:01:19,925|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.name=Linux > 2023-05-22 17:01:19,925|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.arch=amd64 > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.version=5.4.0-135-generic > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:user.name=hrt_qa > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:user.home=/home/hrt_qa > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:user.dir=/hwqe/hadoopqe > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.memory.free=108MB > 2023-05-22 17:01:19,926|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.memory.max=228MB > 2023-05-22 17:01:19,927|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Client environment:os.memory.total=145MB > 2023-05-22 17:01:19,930|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ZooKeeper: Initiating client connection, > connectString=ozn-lease16-1.ozn-lease16.root.hwx.site:2181,ozn-lease16-2.ozn-lease16.root.hwx.site:2181,ozn-lease16-3.ozn-lease16.root.hwx.site:2181 > sessionTimeout=30000 > watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$16/169226355@454e763 > 2023-05-22 17:01:19,942|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > common.X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true > to disable client-initiated TLS renegotiation > 2023-05-22 17:01:19,952|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes > 2023-05-22 17:01:19,963|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled= > 2023-05-22 17:01:19,983|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:19 INFO > zookeeper.Login: Client successfully logged in. > 2023-05-22 17:01:20,003|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.Login: TGT refresh thread started. > 2023-05-22 17:01:20,009|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.Login: TGT valid starting at: Mon May 22 13:07:24 UTC 2023 > 2023-05-22 17:01:20,010|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.Login: TGT expires: Tue May 23 13:07:24 UTC 2023 > 2023-05-22 17:01:20,010|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.Login: TGT refresh sleeping until: Tue May 23 08:54:46 UTC 2023 > 2023-05-22 17:01:20,010|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. > 2023-05-22 17:01:20,033|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.ClientCnxn: Opening socket connection to server > ozn-lease16-1.ozn-lease16.root.hwx.site/172.27.16.139:2181. Will attempt to > SASL-authenticate using Login Context section 'Client' > 2023-05-22 17:01:20,039|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.ClientCnxn: Socket connection established, initiating session, > client: /10.104.25.105:47830, server: > ozn-lease16-1.ozn-lease16.root.hwx.site/172.27.16.139:2181 > 2023-05-22 17:01:20,045|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:20 INFO > zookeeper.ClientCnxn: Session establishment complete on server > ozn-lease16-1.ozn-lease16.root.hwx.site/172.27.16.139:2181, sessionid = > 0x10b4fe100361851, negotiated timeout = 30000 > 2023-05-22 17:01:22,655|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:22 INFO > mapreduce.HFileOutputFormat2: bulkload locality sensitive enabled > 2023-05-22 17:01:22,655|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:22 INFO > mapreduce.HFileOutputFormat2: Looking up current regions for table > table_dau3f3374e > 2023-05-22 17:01:22,733|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:22 INFO > mapreduce.HFileOutputFormat2: Configuring 1 reduce partitions to match > current region count for all tables > 2023-05-22 17:01:23,261|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|23/05/22 17:01:23 INFO > client.ConnectionImplementation: Closing master protocol: MasterService > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|Exception in thread "main" > java.lang.IllegalArgumentException: Wrong FS: > ofs://ozone1/vol1/bucket1/hbase/bulkload/partitions_72cbb1f1-d9b6-46a4-be39-e27a427c5842, > expected: hdfs://ns1 > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:788) > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:647) > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configurePartitioner(HFileOutputFormat2.java:864) > 2023-05-22 17:01:23,263|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:661) > 2023-05-22 17:01:23,264|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:598) > 2023-05-22 17:01:23,264|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:546) > 2023-05-22 17:01:23,264|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:754) > 2023-05-22 17:01:23,264|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:81) > 2023-05-22 17:01:23,264|INFO|MainThread|machine.py:203 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|at > org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:767) > 2023-05-22 17:01:23,635|INFO|MainThread|machine.py:232 - > run()||GUID=427ca366-5f0f-426c-a2e5-0c4e12bdae2d|Exit Code: 1 > 2023-05-22 17:01:23,635|INFO|MainThread|machine.py:238 - run()|Command > /opt/cloudera/parcels/CDH/bin/hbase > org.apache.hadoop.hbase.mapreduce.ImportTsv > -Dhbase.fs.tmp.dir=ofs://ozone1/vol1/bucket1/hbase/bulkload > -Dimporttsv.columns=HBASE_ROW_KEY,d:c1,d:c2 > -Dimporttsv.bulk.output=ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/hfiles > table_dau3f3374e > ofs://ozone1/vol1/bucket1/hbase/test_VerifyHBaseNoWriteBulkloadHDFSQuota/data.tsv > failed after 0 retries {noformat} -- This message was sent by Atlassian Jira (v8.20.10#820010)