[jira] [Commented] (STORM-3765) NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has no values

2021-05-03 Thread Ethan Li (Jira) 


[ 
https://issues.apache.org/jira/browse/STORM-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17338554#comment-17338554
 ] 

Ethan Li commented on STORM-3765:
-

Merged into master : d5244b8cb06a0f840ad1bf5d3faf74948702fdb9

> NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has 
> no values
> ---
>
> Key: STORM-3765
> URL: https://issues.apache.org/jira/browse/STORM-3765
> Project: Apache Storm
>  Issue Type: Bug
>Affects Versions: 2.0.0, 2.1.0, 2.2.0
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Major
> Fix For: 2.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When drpc.authorizer.acl has no values, for example:
> {code:java}
> -bash-4.2$ cat  drpc-auth-acl.yaml
> drpc.authorizer.acl:
> {code}
> DRPCSimpleACLAuthorizer will have NPE
> {code:java}
> 2021-04-22 15:22:48.795 o.a.s.t.ProcessFunction pool-9-thread-1 [ERROR] 
> Internal error processing fetchRequest
> java.lang.NullPointerException: null
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.readAclFromConfig(DRPCSimpleACLAuthorizer.java:59)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitClientOrInvocationRequest(DRPCSimpleACLAuthorizer.java:108)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitInvocationRequest(DRPCSimpleACLAuthorizer.java:150)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCAuthorizerBase.permit(DRPCAuthorizerBase.java:51)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorization(DRPC.java:130) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorizationNoLog(DRPC.java:143) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.daemon.drpc.DRPC.fetchRequest(DRPC.java:192) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPCThrift.fetchRequest(DRPCThrift.java:42) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:393)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:372)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.ProcessFunction.process(ProcessFunction.java:38) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.sasl.SaslTransportPlugin$TUGIWrapProcessor.process(SaslTransportPlugin.java:152)
>  [storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:291)
>  [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  [?:1.8.0_262]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Th
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (STORM-3769) Failed adding references to blobs: FileNotFoundException

2021-05-03 Thread Aaron Gresch (Jira) 


 [ 
https://issues.apache.org/jira/browse/STORM-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron Gresch resolved STORM-3769.
-
Fix Version/s: 2.3.0
   Resolution: Fixed

> Failed adding references to blobs: FileNotFoundException
> 
>
> Key: STORM-3769
> URL: https://issues.apache.org/jira/browse/STORM-3769
> Project: Apache Storm
>  Issue Type: Bug
>Reporter: Aaron Gresch
>Assignee: Aaron Gresch
>Priority: Major
> Fix For: 2.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> We hit a file not found exception with AsyncLocalizer:
> {code:java}
> 2021-04-23 17:39:13.380 o.a.s.l.AsyncLocalizer 
> ForkJoinPool.commonPool-worker-23 [ERROR] Failed adding references to blobs 
> for TimePortAndAssignment{xxx-1-15-1616201755 on 6708}
> java.io.FileNotFoundException: File 
> '/home/y/var/storm/supervisor/stormdist/xxx-1-15-1616201755/stormconf.ser' 
> does not exist
>         at 
> org.apache.storm.shade.org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:297)
>  ~[storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.shade.org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1851)
>  ~[storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.utils.ConfigUtils.readSupervisorStormConfGivenPath(ConfigUtils.java:311)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.utils.ConfigUtils.readSupervisorStormConfImpl(ConfigUtils.java:472)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.utils.ConfigUtils.readSupervisorStormConf(ConfigUtils.java:306)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.localizer.AsyncLocalizer.getLocalResources(AsyncLocalizer.java:368)
>  ~[storm-server-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.localizer.AsyncLocalizer.addReferencesToBlobs(AsyncLocalizer.java:398)
>  ~[storm-server-2.3.0.y.jar:2.3.0.y]
>         at 
> org.apache.storm.localizer.AsyncLocalizer.lambda$null$7(AsyncLocalizer.java:235)
>  ~[storm-server-2.3.0.y.jar:2.3.0.y]
>         at 
> java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1877) 
> ~[?:1.8.0_262]
>         at 
> org.apache.storm.localizer.AsyncLocalizer.lambda$requestDownloadTopologyBlobs$8(AsyncLocalizer.java:229)
>  ~[storm-server-2.3.0.y.jar:2.3.0.y]
>         at 
> java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:966) 
> [?:1.8.0_262]
>         at 
> java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)
>  [?:1.8.0_262]
>         at 
> java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:457)
>  [?:1.8.0_262]
>         at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) 
> [?:1.8.0_262]
>         at 
> java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) 
> [?:1.8.0_262]
>         at 
> java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) 
> [?:1.8.0_262]
>         at 
> java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:163) 
> [?:1.8.0_262]
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (STORM-3765) NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has no values

2021-05-03 Thread Ethan Li (Jira) 


 [ 
https://issues.apache.org/jira/browse/STORM-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Li resolved STORM-3765.
-
Resolution: Fixed

> NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has 
> no values
> ---
>
> Key: STORM-3765
> URL: https://issues.apache.org/jira/browse/STORM-3765
> Project: Apache Storm
>  Issue Type: Bug
>Affects Versions: 2.0.0, 2.1.0, 2.2.0
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Major
> Fix For: 2.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When drpc.authorizer.acl has no values, for example:
> {code:java}
> -bash-4.2$ cat  drpc-auth-acl.yaml
> drpc.authorizer.acl:
> {code}
> DRPCSimpleACLAuthorizer will have NPE
> {code:java}
> 2021-04-22 15:22:48.795 o.a.s.t.ProcessFunction pool-9-thread-1 [ERROR] 
> Internal error processing fetchRequest
> java.lang.NullPointerException: null
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.readAclFromConfig(DRPCSimpleACLAuthorizer.java:59)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitClientOrInvocationRequest(DRPCSimpleACLAuthorizer.java:108)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitInvocationRequest(DRPCSimpleACLAuthorizer.java:150)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCAuthorizerBase.permit(DRPCAuthorizerBase.java:51)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorization(DRPC.java:130) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorizationNoLog(DRPC.java:143) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.daemon.drpc.DRPC.fetchRequest(DRPC.java:192) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPCThrift.fetchRequest(DRPCThrift.java:42) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:393)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:372)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.ProcessFunction.process(ProcessFunction.java:38) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.sasl.SaslTransportPlugin$TUGIWrapProcessor.process(SaslTransportPlugin.java:152)
>  [storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:291)
>  [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  [?:1.8.0_262]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Th
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (STORM-3765) NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has no values

2021-05-03 Thread Ethan Li (Jira) 


 [ 
https://issues.apache.org/jira/browse/STORM-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Li updated STORM-3765:

Affects Version/s: 2.2.0
   2.0.0
   2.1.0

> NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has 
> no values
> ---
>
> Key: STORM-3765
> URL: https://issues.apache.org/jira/browse/STORM-3765
> Project: Apache Storm
>  Issue Type: Bug
>Affects Versions: 2.0.0, 2.1.0, 2.2.0
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Major
> Fix For: 2.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When drpc.authorizer.acl has no values, for example:
> {code:java}
> -bash-4.2$ cat  drpc-auth-acl.yaml
> drpc.authorizer.acl:
> {code}
> DRPCSimpleACLAuthorizer will have NPE
> {code:java}
> 2021-04-22 15:22:48.795 o.a.s.t.ProcessFunction pool-9-thread-1 [ERROR] 
> Internal error processing fetchRequest
> java.lang.NullPointerException: null
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.readAclFromConfig(DRPCSimpleACLAuthorizer.java:59)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitClientOrInvocationRequest(DRPCSimpleACLAuthorizer.java:108)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitInvocationRequest(DRPCSimpleACLAuthorizer.java:150)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCAuthorizerBase.permit(DRPCAuthorizerBase.java:51)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorization(DRPC.java:130) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorizationNoLog(DRPC.java:143) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.daemon.drpc.DRPC.fetchRequest(DRPC.java:192) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPCThrift.fetchRequest(DRPCThrift.java:42) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:393)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:372)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.ProcessFunction.process(ProcessFunction.java:38) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.sasl.SaslTransportPlugin$TUGIWrapProcessor.process(SaslTransportPlugin.java:152)
>  [storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:291)
>  [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  [?:1.8.0_262]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Th
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (STORM-3765) NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has no values

2021-05-03 Thread Ethan Li (Jira) 


 [ 
https://issues.apache.org/jira/browse/STORM-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Li updated STORM-3765:

Fix Version/s: 2.3.0

> NPE in DRPCSimpleACLAuthorizer.readAclFromConfig when drpc.authorizer.acl has 
> no values
> ---
>
> Key: STORM-3765
> URL: https://issues.apache.org/jira/browse/STORM-3765
> Project: Apache Storm
>  Issue Type: Bug
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Major
> Fix For: 2.3.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When drpc.authorizer.acl has no values, for example:
> {code:java}
> -bash-4.2$ cat  drpc-auth-acl.yaml
> drpc.authorizer.acl:
> {code}
> DRPCSimpleACLAuthorizer will have NPE
> {code:java}
> 2021-04-22 15:22:48.795 o.a.s.t.ProcessFunction pool-9-thread-1 [ERROR] 
> Internal error processing fetchRequest
> java.lang.NullPointerException: null
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.readAclFromConfig(DRPCSimpleACLAuthorizer.java:59)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitClientOrInvocationRequest(DRPCSimpleACLAuthorizer.java:108)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer.permitInvocationRequest(DRPCSimpleACLAuthorizer.java:150)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.authorizer.DRPCAuthorizerBase.permit(DRPCAuthorizerBase.java:51)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorization(DRPC.java:130) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPC.checkAuthorizationNoLog(DRPC.java:143) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.daemon.drpc.DRPC.fetchRequest(DRPC.java:192) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.daemon.drpc.DRPCThrift.fetchRequest(DRPCThrift.java:42) 
> ~[storm-server-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:393)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.generated.DistributedRPCInvocations$Processor$fetchRequest.getResult(DistributedRPCInvocations.java:372)
>  ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.ProcessFunction.process(ProcessFunction.java:38) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
> [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.security.auth.sasl.SaslTransportPlugin$TUGIWrapProcessor.process(SaslTransportPlugin.java:152)
>  [storm-client-2.3.0.y.jar:2.3.0.y]
> at 
> org.apache.storm.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:291)
>  [storm-shaded-deps-2.3.0.y.jar:2.3.0.y]
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  [?:1.8.0_262]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Th
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)