Thanks a lot!
You probably guessed well, these kind of robots are not so polite and will
ignore robots.txt.
The good ones will visit once a day and respect robots.txt...
So I'll have a look at Gnoga.Gui.Navigator.
Perhaps I can figure out where the request come from and at least limit the
number of requests from the same IP address during a certain amount of time T2
(say 1 day) if there were too many in a row within a time frame of length T1
(say 1 minute). It is what search engines do.
G.
________________________________
From: Pascal via Gnoga-list <gnoga-list@lists.sourceforge.net>
Sent: Wednesday, June 7, 2017 10:30:01 AM
To: Gnoga support list
Cc: Pascal
Subject: Re: [Gnoga-list] Limiting new connections per second (or better
anti-robot tactic...)
Hello Gautier,
Bad case, you may log the browser agent to confirm it's robots.
See Gnoga.Gui.Navigator.
What about robot.txt:
https://en.wikipedia.org/wiki/Robots_exclusion_standard
Maybe only useful for non malware robots )-:
HTH, Pascal.
http://blady.pagesperso-orange.fr
> Le 7 juin 2017 à 07:12, Gautier de Montmollin <gdem...@hotmail.com> a écrit :
>
> Hello,
>
> What can be done when a robot is opening permanently new connections but
> not using the Gnoga app?
>
> Perhaps limiting the number of new connections per second ? Other idea ?
>
> On the console you have a permanent flow of messages like below.
>
> TIA
>
> Gautier
>
> ----
>
> 2017-06-07 07:03:35.05 : New connection - ID 24131
> 2017-06-07 07:03:35.43 : New connection - ID 24132
> 2017-06-07 07:03:35.81 : New connection - ID 24133
> 2017-06-07 07:03:36.18 : New connection - ID 24134
> 2017-06-07 07:03:36.45 : Ping on websocket - 24130
> 2017-06-07 07:03:36.45 : Ping on websocket - 24131
> 2017-06-07 07:03:36.45 : Ping on websocket - 24132
> 2017-06-07 07:03:36.45 : Ping on websocket - 24133
> 2017-06-07 07:03:36.45 : Ping on websocket - 24134
> 2017-06-07 07:03:36.53 : New connection - ID 24135
> 2017-06-07 07:03:36.90 : New connection - ID 24136
> 2017-06-07 07:03:37.28 : New connection - ID 24137
> 2017-06-07 07:03:37.66 : New connection - ID 24138
> 2017-06-07 07:03:37.97 : Error Try_Execute - 24130
> 2017-06-07 07:03:37.97 : raised GNOGA.SERVER.CONNECTION.SCRIPT_ERROR :
> Timeout error, no browser response for: ws.send ("S 102379|"+eval
> ("$(window).height();"));
> Call stack traceback locations:
> 0x50c39a 0x50d135 0x5ac57c 0x5ac626 0x5a476b 0x5165e0 0x51c0e6 0x5a43f7
> 0x55af9e 0x51d7c5 0x401bc1 0x5bc362 0x4f6563 0x6f321c 0x748c62c2
> 0x77570fd7 0x77570fa2
>
> 2017-06-07 07:03:37.97 : Error Execute_Script - 24130
> 2017-06-07 07:03:37.97 : raised GNOGA.SERVER.CONNECTION.CONNECTION_ERROR
> : Socket Error during execute of : $(window).height();
> Call stack traceback locations:
> 0x50cf1b 0x50d135 0x5ac57c 0x5ac626 0x5a476b 0x5165e0 0x51c0e6 0x5a43f7
> 0x55af9e 0x51d7c5 0x401bc1 0x5bc362 0x4f6563 0x6f321c 0x748c62c2
> 0x77570fd7 0x77570fa2
>
> 2017-06-07 07:03:38.03 : New connection - ID 24139
> 2017-06-07 07:03:38.36 : Error Try_Execute - 24131
> 2017-06-07 07:03:38.36 : raised GNOGA.SERVER.CONNECTION.SCRIPT_ERROR :
> Timeout error, no browser response for: ws.send ("S 102380|"+eval
> ("window.location.pathname"));
> Call stack traceback locations:
>
> ...
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Gnoga-list mailing list
> Gnoga-list@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/gnoga-list
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gnoga-list mailing list
Gnoga-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gnoga-list
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gnoga-list mailing list
Gnoga-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gnoga-list
