[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=322053&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322053 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 02/Oct/19 16:58 Start Date: 02/Oct/19 16:58 Worklog Time Spent: 10m Work Description: fapifta commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-537585464 I am closing this PR, and will open a new one once I have implemented what we discussed in the JIRA. Closing the JIRA itself as well, and opening a new one that better describes what I am up to. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322053) Time Spent: 1.5h (was: 1h 20m) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Time Spent: 1.5h > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:52
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=322054&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322054 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 02/Oct/19 16:58 Start Date: 02/Oct/19 16:58 Worklog Time Spent: 10m Work Description: fapifta commented on pull request #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322054) Time Spent: 1h 40m (was: 1.5h) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Time Spent: 1h 40m > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:524) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:781) > at > org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:243) > at
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=321842&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-321842 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 02/Oct/19 12:12 Start Date: 02/Oct/19 12:12 Worklog Time Spent: 10m Work Description: elek commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-537463935 @fapifta You create the PR from your `fapifta:trunk`, but you pushed a merged trunk. Now 88 files are changed by this PR. Can you please push only the required changes to your trunk or update the base branch of this PR? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 321842) Time Spent: 1h 20m (was: 1h 10m) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-request-available, pull-requests-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002)
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=321818&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-321818 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 02/Oct/19 11:04 Start Date: 02/Oct/19 11:04 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-537443736 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 0 | Docker mode activated. | | -1 | patch | 11 | https://github.com/apache/hadoop/pull/1544 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. | | Subsystem | Report/Notes | |--:|:-| | GITHUB PR | https://github.com/apache/hadoop/pull/1544 | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/3/console | | versions | git=2.17.1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 321818) Time Spent: 1h 10m (was: 1h) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-request-available, pull-requests-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apac
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320502&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320502 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 30/Sep/19 13:42 Start Date: 30/Sep/19 13:42 Worklog Time Spent: 10m Work Description: bshashikant commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-536566435 The changes look god to me . I am +1 on this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 320502) Time Spent: 1h (was: 50m) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-request-available, pull-requests-available > Time Spent: 1h > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:524) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputForm
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320279&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320279 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 29/Sep/19 19:21 Start Date: 29/Sep/19 19:21 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-536332649 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 1740 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | -1 | test4tests | 0 | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | -1 | mvninstall | 31 | hadoop-hdds in trunk failed. | | -1 | mvninstall | 39 | hadoop-ozone in trunk failed. | | -1 | compile | 21 | hadoop-hdds in trunk failed. | | -1 | compile | 16 | hadoop-ozone in trunk failed. | | -0 | checkstyle | 37 | The patch fails to run checkstyle in hadoop-ozone | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 918 | branch has no errors when building and testing our client artifacts. | | -1 | javadoc | 21 | hadoop-hdds in trunk failed. | | -1 | javadoc | 18 | hadoop-ozone in trunk failed. | | 0 | spotbugs | 1016 | Used deprecated FindBugs config; considering switching to SpotBugs. | | -1 | findbugs | 34 | hadoop-hdds in trunk failed. | | -1 | findbugs | 20 | hadoop-ozone in trunk failed. | ||| _ Patch Compile Tests _ | | -1 | mvninstall | 35 | hadoop-hdds in the patch failed. | | -1 | mvninstall | 35 | hadoop-ozone in the patch failed. | | -1 | compile | 23 | hadoop-hdds in the patch failed. | | -1 | compile | 17 | hadoop-ozone in the patch failed. | | -1 | javac | 23 | hadoop-hdds in the patch failed. | | -1 | javac | 17 | hadoop-ozone in the patch failed. | | -0 | checkstyle | 29 | The patch fails to run checkstyle in hadoop-ozone | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 721 | patch has no errors when building and testing our client artifacts. | | -1 | javadoc | 21 | hadoop-hdds in the patch failed. | | -1 | javadoc | 19 | hadoop-ozone in the patch failed. | | -1 | findbugs | 31 | hadoop-hdds in the patch failed. | | -1 | findbugs | 21 | hadoop-ozone in the patch failed. | ||| _ Other Tests _ | | -1 | unit | 28 | hadoop-hdds in the patch failed. | | -1 | unit | 25 | hadoop-ozone in the patch failed. | | +1 | asflicense | 32 | The patch does not generate ASF License warnings. | | | | 4090 | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.2 Server=19.03.2 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1544 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux dbe4703bc166 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / c0edc84 | | Default Java | 1.8.0_222 | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-mvninstall-hadoop-hdds.txt | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-mvninstall-hadoop-ozone.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-compile-hadoop-hdds.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-compile-hadoop-ozone.txt | | checkstyle | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out//home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-1544/out/maven-branch-checkstyle-hadoop-ozone.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-javadoc-hadoop-hdds.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-javadoc-hadoop-ozone.txt | | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/2/artifact/out/branch-findbugs-hadoop-hdds.txt | | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320245&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320245 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 29/Sep/19 17:39 Start Date: 29/Sep/19 17:39 Worklog Time Spent: 10m Work Description: fapifta commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-536323684 I have fixed the checkstyle issues, and removed volatile from the config holder boolean as that is not necessary after init is synchronized. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 320245) Time Spent: 40m (was: 0.5h) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-request-available, pull-requests-available > Time Spent: 40m > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFo
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320040&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320040 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 28/Sep/19 18:08 Start Date: 28/Sep/19 18:08 Worklog Time Spent: 10m Work Description: anuengineer commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-536212092 Code changes look good to me. I have set the Ozone label, Let the Jenkins run once more and I will commit this. Thank you for the fix. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 320040) Time Spent: 0.5h (was: 20m) > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Client, SCM >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-request-available, pull-requests-available > Time Spent: 0.5h > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:2002) > at > org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFor
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320026&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320026 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 28/Sep/19 15:56 Start Date: 28/Sep/19 15:56 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544#issuecomment-536201609 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 78 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | -1 | test4tests | 0 | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | -1 | mvninstall | 29 | hadoop-hdds in trunk failed. | | -1 | mvninstall | 42 | hadoop-ozone in trunk failed. | | -1 | compile | 21 | hadoop-hdds in trunk failed. | | -1 | compile | 16 | hadoop-ozone in trunk failed. | | -0 | checkstyle | 39 | The patch fails to run checkstyle in hadoop-ozone | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 854 | branch has no errors when building and testing our client artifacts. | | -1 | javadoc | 25 | hadoop-hdds in trunk failed. | | -1 | javadoc | 20 | hadoop-ozone in trunk failed. | | 0 | spotbugs | 979 | Used deprecated FindBugs config; considering switching to SpotBugs. | | -1 | findbugs | 53 | hadoop-hdds in trunk failed. | | -1 | findbugs | 21 | hadoop-ozone in trunk failed. | ||| _ Patch Compile Tests _ | | -1 | mvninstall | 35 | hadoop-hdds in the patch failed. | | -1 | mvninstall | 38 | hadoop-ozone in the patch failed. | | -1 | compile | 24 | hadoop-hdds in the patch failed. | | -1 | compile | 20 | hadoop-ozone in the patch failed. | | -1 | javac | 24 | hadoop-hdds in the patch failed. | | -1 | javac | 20 | hadoop-ozone in the patch failed. | | -0 | checkstyle | 27 | hadoop-hdds: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) | | -0 | checkstyle | 29 | The patch fails to run checkstyle in hadoop-ozone | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 729 | patch has no errors when building and testing our client artifacts. | | -1 | javadoc | 23 | hadoop-hdds in the patch failed. | | -1 | javadoc | 20 | hadoop-ozone in the patch failed. | | -1 | findbugs | 31 | hadoop-hdds in the patch failed. | | -1 | findbugs | 21 | hadoop-ozone in the patch failed. | ||| _ Other Tests _ | | -1 | unit | 27 | hadoop-hdds in the patch failed. | | -1 | unit | 26 | hadoop-ozone in the patch failed. | | +1 | asflicense | 33 | The patch does not generate ASF License warnings. | | | | 2431 | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.2 Server=19.03.2 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1544 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux 609b5b23109c 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 14b4fbc | | Default Java | 1.8.0_222 | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-mvninstall-hadoop-hdds.txt | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-mvninstall-hadoop-ozone.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-compile-hadoop-hdds.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-compile-hadoop-ozone.txt | | checkstyle | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out//home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-1544/out/maven-branch-checkstyle-hadoop-ozone.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-javadoc-hadoop-hdds.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/branch-javadoc-hadoop-ozone.txt | | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1544/1/artifact/out/bra
[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320013&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320013 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot Created on: 28/Sep/19 14:47 Start Date: 28/Sep/19 14:47 Worklog Time Spent: 10m Work Description: fapifta commented on pull request #1544: HDDS-2203 Race condition in ByteStringHelper.init() URL: https://github.com/apache/hadoop/pull/1544 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g. HADOOP-X. Fix a typo in YYY.) For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 320013) Remaining Estimate: 0h Time Spent: 10m > Race condition in ByteStringHelper.init() > - > > Key: HDDS-2203 > URL: https://issues.apache.org/jira/browse/HDDS-2203 > Project: Hadoop Distributed Data Store > Issue Type: Bug >Reporter: Istvan Fajth >Assignee: Istvan Fajth >Priority: Critical > Labels: pull-requests-available > Time Spent: 10m > Remaining Estimate: 0h > > The current init method: > {code} > public static void init(boolean isUnsafeByteOperation) { > final boolean set = INITIALIZED.compareAndSet(false, true); > if (set) { > ByteStringHelper.isUnsafeByteOperationsEnabled = >isUnsafeByteOperation; >} else { > // already initialized, check values > Preconditions.checkState(isUnsafeByteOperationsEnabled >== isUnsafeByteOperation); >} > } > {code} > In a scenario when two thread accesses this method, and the execution order > is the following, then the second thread runs into an exception from > PreCondition.checkState() in the else branch. > In an unitialized state: > - T1 thread arrives to the method with true as the parameter, the class > initialises the isUnsafeByteOperationsEnabled to false > - T1 sets INITIALIZED true > - T2 arrives to the method with true as the parameter > - T2 reads the INITALIZED value and as it is not false goes to else branch > - T2 tries to check if the internal boolean property is the same true as it > wanted to set, and as T1 still to set the value, the checkState throws an > IllegalArgumentException. > This happens in certain Hive query cases, as it came from that testing, the > exception we see there is the following: > {code} > Error: Error while processing statement: FAILED: Execution Error, return code > 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, > vertexName=Map 2, vertexId=vertex_1569486223160_0334_1_02, > diagnostics=[Vertex vertex_1569486223160_0334_1_02 [Map 2] killed/failed > due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: item initializer failed, > vertex=vertex_1569486223160_0334_1_02 [Map 2], java.io.IOException: Couldn't > create RpcClient protocol > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:263) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getClientProtocol(OzoneClientFactory.java:239) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:203) > at > org.apache.hadoop.ozone.client.OzoneClientFactory.getRpcClient(OzoneClientFactory.java:165) > at > org.apache.hadoop.fs.ozone.BasicOzoneClientAdapterImpl.(BasicOzoneClientAdapterImpl.java:158) > at > org.apache.hadoop.fs.ozone.OzoneClientAdapterImpl.(OzoneClientAdapterImpl.java:50) > at > org.apache.hadoop.fs.ozone.OzoneFileSystem.createAdapter(OzoneFileSystem.java:102) > at > org.apache.hadoop.fs.ozone.BasicOzoneFileSystem.initialize(BasicOzoneFileSystem.java:155) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3315) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136) > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3364) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3332) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361) > at > org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1821) > at > org.apache.hadoop.hive.