[
https://issues.apache.org/jira/browse/HBASE-27887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735401#comment-17735401
]
Tak-Lon (Stephen) Wu edited comment on HBASE-27887 at 6/20/23 5:59 PM:
-----------------------------------------------------------------------
I'm wondered other than the parameters `-Dfs.defaultFS=ofs://ozone1`, what is
the `fs.defaultFS` in the core-site.xml or hbase-site ?
-that's mainly said that the input parameters does not override the value of
xml configuration file, maybe this way isn't working for a while ?-
nvm, the title said the same, but yeah I'm wondered how and where we introduce
user to use -Dfs.defaultFS, if you have a tutorial or a webpage for the
existing suggestion, that could be great.
was (Author: taklwu):
I'm wondered other than the parameters `-Dfs.defaultFS=ofs://ozone1`, what is
the `fs.defaultFS` in the core-site.xml or hbase-site ?
-that's mainly said that the input parameters does not override the value of
xml configuration file, maybe this way isn't working for a while ?-
nvm, the title said the same, but yeah I'm wondered how and where we introduce
user to use -Dfs.defaultFS, if you have a tutorial or a webpage, that could be
great.
> IntegrationTestImportTsv doesn't respect -Dfs.defaultFS to override FS
> ----------------------------------------------------------------------
>
> Key: HBASE-27887
> URL: https://issues.apache.org/jira/browse/HBASE-27887
> Project: HBase
> Issue Type: Bug
> Reporter: Pratyush Bhatt
> Priority: Major
> Labels: ozone
>
> Tried modifying the command using -Dfs.defaultFS to run the integration tests
> on top of Ozone:
> {noformat}
> hbase org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv
> -Dfs.defaultFS=ofs://ozone1
> -Dhbase.fs.tmp.dir=ofs://ozone1/vol1/bucket1/hbase/bulkload{noformat}
> Still getting:
> {noformat}
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|Exception in thread "main"
> java.lang.IllegalArgumentException: Wrong FS:
> ofs://ozone1/vol1/bucket1/hbase/bulkload/partitions_b5cae401-0fb6-4322-b2bd-892eed7786ef,
> expected: hdfs://ns1{noformat}
> Full trace:
> {noformat}
> 1.cdh7.1.8.p3.40935426/bin/../lib/hadoop/lib/native
> 2023-05-24 19:16:07,662|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
> 2023-05-24 19:16:07,662|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
> 2023-05-24 19:16:07,662|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.name=Linux
> 2023-05-24 19:16:07,662|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.arch=amd64
> 2023-05-24 19:16:07,662|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.version=5.4.0-135-generic
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:user.name=hrt_qa
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:user.home=/home/hrt_qa
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:user.dir=/hwqe/hadoopqe
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.memory.free=96MB
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.memory.max=228MB
> 2023-05-24 19:16:07,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Client environment:os.memory.total=145MB
> 2023-05-24 19:16:07,666|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ZooKeeper: Initiating client connection,
> connectString=ozn-lease19-4.ozn-lease19.root.hwx.site:2181,ozn-lease19-1.ozn-lease19.root.hwx.site:2181,ozn-lease19-2.ozn-lease19.root.hwx.site:2181
> sessionTimeout=30000
> watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$16/1316897284@50feaef5
> 2023-05-24 19:16:07,673|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> common.X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true
> to disable client-initiated TLS renegotiation
> 2023-05-24 19:16:07,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes
> 2023-05-24 19:16:07,692|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled=
> 2023-05-24 19:16:07,712|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.Login: Client successfully logged in.
> 2023-05-24 19:16:07,714|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.Login: TGT refresh thread started.
> 2023-05-24 19:16:07,742|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.Login: TGT valid starting at: Wed May 24 18:49:50 UTC 2023
> 2023-05-24 19:16:07,743|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.Login: TGT expires: Thu May 25 18:49:50 UTC 2023
> 2023-05-24 19:16:07,743|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism.
> 2023-05-24 19:16:07,743|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.Login: TGT refresh sleeping until: Thu May 25 14:19:58 UTC 2023
> 2023-05-24 19:16:07,768|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ClientCnxn: Opening socket connection to server
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181. Will attempt to
> SASL-authenticate using Login Context section 'Client'
> 2023-05-24 19:16:07,773|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ClientCnxn: Socket connection established, initiating session,
> client: /10.104.34.66:35400, server:
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181
> 2023-05-24 19:16:07,780|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:07 INFO
> zookeeper.ClientCnxn: Session establishment complete on server
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181, sessionid =
> 0x30587a0caee02c2, negotiated timeout = 30000
> 2023-05-24 19:16:08,663|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ZooKeeper: Initiating client connection,
> connectString=ozn-lease19-4.ozn-lease19.root.hwx.site:2181,ozn-lease19-1.ozn-lease19.root.hwx.site:2181,ozn-lease19-2.ozn-lease19.root.hwx.site:2181
> sessionTimeout=30000
> watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$16/1316897284@50feaef5
> 2023-05-24 19:16:08,664|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes
> 2023-05-24 19:16:08,664|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled=
> 2023-05-24 19:16:08,667|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.Login: Client successfully logged in.
> 2023-05-24 19:16:08,668|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.Login: TGT refresh thread started.
> 2023-05-24 19:16:08,668|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism.
> 2023-05-24 19:16:08,668|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.Login: TGT valid starting at: Wed May 24 18:49:50 UTC 2023
> 2023-05-24 19:16:08,669|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.Login: TGT expires: Thu May 25 18:49:50 UTC 2023
> 2023-05-24 19:16:08,669|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.Login: TGT refresh sleeping until: Thu May 25 15:08:08 UTC 2023
> 2023-05-24 19:16:08,670|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ClientCnxn: Opening socket connection to server
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181. Will attempt to
> SASL-authenticate using Login Context section 'Client'
> 2023-05-24 19:16:08,670|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ClientCnxn: Socket connection established, initiating session,
> client: /10.104.34.66:35414, server:
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181
> 2023-05-24 19:16:08,674|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> zookeeper.ClientCnxn: Session establishment complete on server
> ozn-lease19-2.ozn-lease19.root.hwx.site/172.27.192.66:2181, sessionid =
> 0x30587a0caee02c3, negotiated timeout = 30000
> 2023-05-24 19:16:08,825|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:08 INFO
> mapreduce.IntegrationTestImportTsv: Running test testGenerateAndLoad.
> 2023-05-24 19:16:09,614|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can
> do block reordering using class
> org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
> 2023-05-24 19:16:09,620|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can
> do block reordering using class
> org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
> 2023-05-24 19:16:09,838|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> mapreduce.IntegrationTestImportTsv: The folder where the HFiles will be
> generated:
> hdfs://ns1/user/hbase/test-data/7764b218-8933-c8a8-c6b5-f7fe1899edb8/IntegrationTestImportTsv/hfiles
> 2023-05-24 19:16:09,857|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> hbase.HBaseClassTestRule: Test class
> org.apache.hadoop.hbase.mapreduce.TestImportTsv timeout: 13 mins
> 2023-05-24 19:16:09,882|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> hbase.HBaseCommonTestingUtility: System.getProperty("hadoop.log.dir") already
> set to:
> /hwqe/hadoopqe/target/test-data/9507b95e-9518-c4c4-916e-8e10663a37ca/hadoop-log-dir
> so I do NOT create it in
> target/test-data/d07cb065-ab88-af82-515c-2a86041b88fa
> 2023-05-24 19:16:09,882|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 INFO
> hbase.HBaseCommonTestingUtility: System.getProperty("hadoop.tmp.dir") already
> set to:
> /hwqe/hadoopqe/target/test-data/9507b95e-9518-c4c4-916e-8e10663a37ca/hadoop-tmp-dir
> so I do NOT create it in
> target/test-data/d07cb065-ab88-af82-515c-2a86041b88fa
> 2023-05-24 19:16:09,882|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:09 WARN
> hbase.HBaseCommonTestingUtility: hadoop.tmp.dir property value differs in
> configuration and system: Configuration=/tmp/hadoop-hrt_qa while
> System=/hwqe/hadoopqe/target/test-data/9507b95e-9518-c4c4-916e-8e10663a37ca/hadoop-tmp-dir
> Erasing configuration value by system value.
> 2023-05-24 19:16:11,948|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:11 INFO
> client.HBaseAdmin: Operation: CREATE, Table Name:
> default:IntegrationTestImportTsv, procId: 336 completed
> 2023-05-24 19:16:11,953|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:11 INFO
> hbase.Waiter: Waiting up to [60,000] milli-secs(wait.for.ratio=[1])
> 2023-05-24 19:16:12,023|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> hbase.HBaseCommonTestingUtility: All regions for table
> IntegrationTestImportTsv assigned to meta. Checking AM states.
> 2023-05-24 19:16:12,023|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> hbase.HBaseCommonTestingUtility: All regions for table
> IntegrationTestImportTsv assigned.
> 2023-05-24 19:16:12,448|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ZooKeeper: Initiating client connection,
> connectString=ozn-lease19-4.ozn-lease19.root.hwx.site:2181,ozn-lease19-1.ozn-lease19.root.hwx.site:2181,ozn-lease19-2.ozn-lease19.root.hwx.site:2181
> sessionTimeout=30000
> watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$16/1316897284@50feaef5
> 2023-05-24 19:16:12,448|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes
> 2023-05-24 19:16:12,449|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled=
> 2023-05-24 19:16:12,451|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.Login: Client successfully logged in.
> 2023-05-24 19:16:12,451|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism.
> 2023-05-24 19:16:12,452|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.Login: TGT refresh thread started.
> 2023-05-24 19:16:12,452|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.Login: TGT valid starting at: Wed May 24 18:49:50 UTC 2023
> 2023-05-24 19:16:12,453|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.Login: TGT expires: Thu May 25 18:49:50 UTC 2023
> 2023-05-24 19:16:12,453|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxn: Opening socket connection to server
> ozn-lease19-4.ozn-lease19.root.hwx.site/172.27.19.204:2181. Will attempt to
> SASL-authenticate using Login Context section 'Client'
> 2023-05-24 19:16:12,453|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.Login: TGT refresh sleeping until: Thu May 25 15:07:41 UTC 2023
> 2023-05-24 19:16:12,454|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxn: Socket connection established, initiating session,
> client: /10.104.34.66:38096, server:
> ozn-lease19-4.ozn-lease19.root.hwx.site/172.27.19.204:2181
> 2023-05-24 19:16:12,457|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxn: Session establishment complete on server
> ozn-lease19-4.ozn-lease19.root.hwx.site/172.27.19.204:2181, sessionid =
> 0x10bdd60ec040302, negotiated timeout = 30000
> 2023-05-24 19:16:12,613|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> mapreduce.HFileOutputFormat2: bulkload locality sensitive enabled
> 2023-05-24 19:16:12,614|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> mapreduce.HFileOutputFormat2: Looking up current regions for table
> IntegrationTestImportTsv
> 2023-05-24 19:16:12,680|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> mapreduce.HFileOutputFormat2: Configuring 1 reduce partitions to match
> current region count for all tables
> 2023-05-24 19:16:12,681|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> client.ConnectionImplementation: Closing master protocol: MasterService
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|Exception in thread "main"
> java.lang.IllegalArgumentException: Wrong FS:
> ofs://ozone1/vol1/bucket1/hbase/bulkload/partitions_b5cae401-0fb6-4322-b2bd-892eed7786ef,
> expected: hdfs://ns1
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:788)
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:647)
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configurePartitioner(HFileOutputFormat2.java:864)
> 2023-05-24 19:16:12,683|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:661)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configureIncrementalLoad(HFileOutputFormat2.java:598)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:546)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:754)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:81)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:425)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:378)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.generateAndLoad(IntegrationTestImportTsv.java:198)
> 2023-05-24 19:16:12,684|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.run(IntegrationTestImportTsv.java:232)
> 2023-05-24 19:16:12,685|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:81)
> 2023-05-24 19:16:12,685|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.main(IntegrationTestImportTsv.java:263)
> 2023-05-24 19:16:12,785|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 WARN
> zookeeper.Login: TGT renewal thread has been interrupted and will exit.
> 2023-05-24 19:16:12,787|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ZooKeeper: Session: 0x10bdd60ec040302 closed
> 2023-05-24 19:16:12,787|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:16:12 INFO
> zookeeper.ClientCnxn: EventThread shut down for session: 0x10bdd60ec040302
> 2023-05-24 19:17:08,175|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:08 WARN
> zookeeper.Login: TGT renewal thread has been interrupted and will exit.
> 2023-05-24 19:17:08,176|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:08 INFO
> zookeeper.ZooKeeper: Session: 0x30587a0caee02c2 closed
> 2023-05-24 19:17:08,176|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:08 INFO
> zookeeper.ClientCnxn: EventThread shut down for session: 0x30587a0caee02c2
> 2023-05-24 19:17:10,024|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:10 WARN
> zookeeper.Login: TGT renewal thread has been interrupted and will exit.
> 2023-05-24 19:17:10,024|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:10 INFO
> zookeeper.ZooKeeper: Session: 0x30587a0caee02c3 closed
> 2023-05-24 19:17:10,024|INFO|MainThread|machine.py:203 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|23/05/24 19:17:10 INFO
> zookeeper.ClientCnxn: EventThread shut down for session: 0x30587a0caee02c3
> 2023-05-24 19:17:12,382|INFO|MainThread|machine.py:232 -
> run()||GUID=b47165ac-c898-410f-bbf9-eaaca57cb34f|Exit Code: 1{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
