I've just found this exception in the output, I'm not quite sure if this is
related to the reported problem, but the users are complaining of not being
able to connect:
ERROR 03-30 08:49:19.686 o.a.o.w.a.WebSession:208 [.0-5451-exec-50] -
Unexpected exception while checking hashes
java.lang.NullPointerException: null
at
org.apache.openmeetings.db.entity.basic.Client.getUserId(Client.java:124)
at
org.apache.openmeetings.web.app.ClientManager.getByKeys(ClientManager.java:296)
at
org.apache.openmeetings.web.app.ClientManager.invalidate(ClientManager.java:305)
at
org.apache.openmeetings.web.app.WebSession.invalidate(WebSession.java:122)
at org.apache.wicket.Session.invalidateNow(Session.java:513)
at
org.apache.openmeetings.web.app.WebSession.checkHashes(WebSession.java:183)
at
org.apache.openmeetings.web.pages.HashPage.onInitialize(HashPage.java:102)
at org.apache.wicket.Component.fireInitialize(Component.java:871)
at
org.apache.wicket.MarkupContainer.internalInitialize(MarkupContainer.java:1037)
at org.apache.wicket.Page.isPageStateless(Page.java:461)
at
org.apache.wicket.core.request.mapper.AbstractBookmarkableMapper.getPageInfo(AbstractBookmarkableMapper.java:473)
at
org.apache.wicket.core.request.mapper.AbstractBookmarkableMapper.mapHandler(AbstractBookmarkableMapper.java:420)
at
org.apache.wicket.core.request.mapper.MountedMapper.mapHandler(MountedMapper.java:155)
at
org.apache.openmeetings.web.app.Application$NoVersionMapper.mapHandler(Application.java:282)
at
org.apache.wicket.request.mapper.CompoundRequestMapper.mapHandler(CompoundRequestMapper.java:210)
at
org.apache.wicket.request.cycle.RequestCycle.mapUrlFor(RequestCycle.java:449)
at
org.apache.wicket.request.handler.render.WebPageRenderer.respond(WebPageRenderer.java:233)
at
org.apache.wicket.core.request.handler.RenderPageRequestHandler.respond(RenderPageRequestHandler.java:202)
at
org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:912)
at
org.apache.wicket.request.RequestHandlerExecutor.execute(RequestHandlerExecutor.java:65)
at
org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:283)
at
org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:253)
at
org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:221)
at
org.apache.wicket.protocol.ws.AbstractUpgradeFilter.processRequestCycle(AbstractUpgradeFilter.java:70)
at
org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:204)
at
org.apache.wicket.protocol.http.WicketFilter.doFilter(WicketFilter.java:286)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at
org.red5.logging.LoggerContextFilter.doFilter(LoggerContextFilter.java:84)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:608)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:764)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1388)
at
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
El lun., 30 mar. 2020 a las 8:42, Maxim Solodovnik (<[email protected]>)
escribió:
> Would appreciate if you could share your steps
> And/or write short video of what is happening
> Unfortunately I can't help until I'll be able to reproduce the issue :(
>
> On Mon, 30 Mar 2020 at 21:39, Rodolfo Gonzalez <[email protected]>
> wrote:
>
>> Hi Maxim,
>>
>> no, it happens in one tab AFAIK, randomly. It's a bit hard to know more
>> details from the user's side, since they're at home (they us OM during
>> #StayAtHome). But it has happened to me too, with one tab/one window.
>>
>> I'll ask support to inquire more details from my users.
>>
>> El vie., 27 mar. 2020 a las 23:56, Maxim Solodovnik (<
>> [email protected]>) escribió:
>>
>>> Hello Rodolfo,
>>>
>>> In the other thread it turn out to be "multi-tab" issue
>>> Is this your case?
>>>
>>> If not could you share your steps?
>>>
>>> On Thu, 26 Mar 2020 at 14:21, Maxim Solodovnik <[email protected]>
>>> wrote:
>>>
>>>> most probably not :)
>>>>
>>>> On Thu, 26 Mar 2020 at 12:13, Rodolfo Gonzalez <
>>>> [email protected]> wrote:
>>>>
>>>>> The version of java is not the cause, right? :)
>>>>>
>>>>> Thanks, have a good day.
>>>>>
>>>>> El mié., 25 mar. 2020 a las 20:55, Maxim Solodovnik (<
>>>>> [email protected]>) escribió:
>>>>>
>>>>>> Well
>>>>>> In the ticket "Users log-in to OM from Moodle"
>>>>>> Moodle is CMS with OM plugin working via REST
>>>>>>
>>>>>> So it seems to be same report
>>>>>> Will try to to some tests later
>>>>>>
>>>>>> It is now day-time-job-time
>>>>>>
>>>>>>
>>>>>> On Thu, 26 Mar 2020 at 09:13, Rodolfo Gonzalez <
>>>>>> [email protected]> wrote:
>>>>>>
>>>>>>> Hi Maxim,
>>>>>>>
>>>>>>> I read the ticket. It's not exactly the same problem. In my case,
>>>>>>> users do not login from the OM's login window, but the API is used with
>>>>>>> a
>>>>>>> generic user with SOAP rights. Also, the problem is not a constant,
>>>>>>> which
>>>>>>> makes harder to reproduce. I have goten the error randomly. I'll try to
>>>>>>> do
>>>>>>> a test program to list rooms hashes in loop and concurently, to see if I
>>>>>>> can find something.
>>>>>>>
>>>>>>> El mié., 25 mar. 2020 a las 20:00, Maxim Solodovnik (<
>>>>>>> [email protected]>) escribió:
>>>>>>>
>>>>>>>> The problem is not reproducible in the clean environment :(
>>>>>>>> I have re-opened
>>>>>>>> https://issues.apache.org/jira/browse/OPENMEETINGS-2192
>>>>>>>> But we need to figure out reproducible steps for this :(
>>>>>>>>
>>>>>>>> On Thu, 26 Mar 2020 at 07:43, Rodolfo Gonzalez <
>>>>>>>> [email protected]> wrote:
>>>>>>>>
>>>>>>>>> Hi Maxim, the problem is, in the server output I can not find
>>>>>>>>> exceptions other than those refused logins. In the client (PHP) side,
>>>>>>>>> I
>>>>>>>>> only get that the object which is returned by the login API call is
>>>>>>>>> null
>>>>>>>>> (so the call to get the room hash crashes, as the method is called
>>>>>>>>> from a
>>>>>>>>> null).
>>>>>>>>>
>>>>>>>>> I mean, I find other kind of exceptions, concerning to video
>>>>>>>>> stream and other things. But the problem seems to be that the login is
>>>>>>>>> being rejected. Another user posted a similar (maybe the same)
>>>>>>>>> problem just
>>>>>>>>> a moment ago.
>>>>>>>>>
>>>>>>>>> Regards.
>>>>>>>>>
>>>>>>>>> El mié., 25 mar. 2020 a las 18:21, Maxim Solodovnik (<
>>>>>>>>> [email protected]>) escribió:
>>>>>>>>>
>>>>>>>>>> Hello Rodolfo,
>>>>>>>>>>
>>>>>>>>>> Debug logging you quoted provide zero info :(
>>>>>>>>>> There are no limits for logins in the system
>>>>>>>>>>
>>>>>>>>>> Could you share error stack trace?
>>>>>>>>>>
>>>>>>>>>> I might write test foe this
>>>>>>>>>> Am I right thinking the use case is: 100 users are trying to
>>>>>>>>>> get room hash in parallel?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Thu, 26 Mar 2020 at 00:58, Rodolfo Gonzalez <
>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> currently I run an OM 4.0.10 server with a pretty default
>>>>>>>>>>> configuration, using
>>>>>>>>>>>
>>>>>>>>>>> # java -version
>>>>>>>>>>> openjdk version "1.8.0_242"
>>>>>>>>>>> OpenJDK Runtime Environment (build
>>>>>>>>>>> 1.8.0_242-8u242-b08-0ubuntu3~16.04-b08)
>>>>>>>>>>> OpenJDK 64-Bit Server VM (build 25.242-b08, mixed mode)
>>>>>>>>>>>
>>>>>>>>>>> on Ubuntu 16.04 (default values for file handles limits).
>>>>>>>>>>>
>>>>>>>>>>> I integrated OM with a web app made in PHP with the Yii
>>>>>>>>>>> framework, using the SOAP API. I use this library:
>>>>>>>>>>>
>>>>>>>>>>> https://github.com/hakeem23/open-meetings-soap
>>>>>>>>>>>
>>>>>>>>>>> The server is on AWS, being a c4d.4xlarge instance, with htop
>>>>>>>>>>> reporting 16 cores. CPU usage is reported by AWS to be around 50%,
>>>>>>>>>>> with a
>>>>>>>>>>> system load maxing up at the 5-7 range reported by htop. The thing
>>>>>>>>>>> is that
>>>>>>>>>>> as many as 100 users try to list rooms or connect to the server at
>>>>>>>>>>> a given
>>>>>>>>>>> time.
>>>>>>>>>>>
>>>>>>>>>>> I'm having several problems with the service, the main one being
>>>>>>>>>>> that the users sometimes can not get the room hashes or enter a
>>>>>>>>>>> room. Given
>>>>>>>>>>> the flow of the process, my best guess is that the library can not
>>>>>>>>>>> login to
>>>>>>>>>>> the OM server. The errors in the output are like these, I think
>>>>>>>>>>> (I'm not
>>>>>>>>>>> sure if these are the cause of the problem):
>>>>>>>>>>>
>>>>>>>>>>> DEBUG 03-25 11:44:24.577 o.a.o.d.u.AuthLevelUtil:42
>>>>>>>>>>> [0.0-5453-exec-7] - Level Admin :: [DENIED]
>>>>>>>>>>> DEBUG 03-25 11:44:24.632 o.a.o.d.u.AuthLevelUtil:42
>>>>>>>>>>> [0.0-5453-exec-7] - Level Admin :: [DENIED]
>>>>>>>>>>> DEBUG 03-25 11:44:24.633 o.a.o.d.u.AuthLevelUtil:42
>>>>>>>>>>> [0.0-5453-exec-7] - Level GroupAdmin :: [DENIED]
>>>>>>>>>>> DEBUG 03-25 11:44:24.642 o.a.o.d.u.AuthLevelUtil:42
>>>>>>>>>>> [0.0-5453-exec-7] - Level Admin :: [DENIED]
>>>>>>>>>>> DEBUG 03-25 11:44:24.642 o.a.o.d.u.AuthLevelUtil:42
>>>>>>>>>>> [0.0-5453-exec-7] - Level Admin :: [DENIED]
>>>>>>>>>>>
>>>>>>>>>>> and so on. But I'm unsure if this is the error which causes a
>>>>>>>>>>> cascade exceptions which render the web app unable to get the room
>>>>>>>>>>> hashes
>>>>>>>>>>> and so (those process relay on being loged in, anyway). The thing
>>>>>>>>>>> is, the
>>>>>>>>>>> SOAP library currently does the login process from the app, using
>>>>>>>>>>> and user
>>>>>>>>>>> "admin" with SOAP and ADMIN level credentials. And the problem is
>>>>>>>>>>> intermitent.
>>>>>>>>>>>
>>>>>>>>>>> Do you consider that my guess is right? Is there a limit on
>>>>>>>>>>> "logins" at any given time? If so, can it be increased? Does the
>>>>>>>>>>> version of
>>>>>>>>>>> java affect?
>>>>>>>>>>>
>>>>>>>>>>> Any other ideas are welcome.
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Rodolfo.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> WBR
>>>>>>>>>> Maxim aka solomax
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> WBR
>>>>>>>> Maxim aka solomax
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> WBR
>>>>>> Maxim aka solomax
>>>>>>
>>>>>
>>>>
>>>> --
>>>> WBR
>>>> Maxim aka solomax
>>>>
>>>
>>>
>>> --
>>> WBR
>>> Maxim aka solomax
>>>
>>
>
> --
> WBR
> Maxim aka solomax
>