Yes the culprit were the git fetch operations. When a new review request form is created, reviewboard internally fetches all git repos and that taking over a minute to complete. With Apache 2.4 the default timeout value is 60s as opposed to apache 2.2 (300s) which is why it started failing recently for me.
Thanks for all the help here. On Monday, May 16, 2016 at 7:37:13 PM UTC+5:30, Abhishek Choudhary wrote: > > Hi > My reviewboard version 1.5.1 > > scmtools/git.py contains the git fetch lines i am seeing (debug=True is > enabled in settings): > > class GitClient: > def __init__(self, path): > self.path = path > > # Adding a skinit before git fetch so that kerberos credentials > # are acquired before doing a git fetch > print "Before executing the git fetch statement:" > print "The path is: " + str(path) > cmd = 'cd ' + str(path) + '; /usr/local/bin/skinit -q; git fetch > --all' > print commands.getstatusoutput(cmd) > print "Done" > > Thanks, > Abhishek > > > On Monday, May 16, 2016 at 4:35:12 PM UTC+5:30, Abhishek Choudhary wrote: >> >> Thanks for you quick reply. >> >> What about the "Timeout when reading response headers from daemon >> process" error. If I want to increase the timeout value as workaround for >> quick fix will it help? If so which timeout value should be configured here? >> >> On Monday, May 16, 2016 at 4:29:21 PM UTC+5:30, Christian Hammond wrote: >>> >>> Hi, >>> >>> We don't do any git fetches, and we don't output that log statement (or >>> output to the Apache log file). Are there any modifications to your Review >>> Board source code that might be doing this? >>> >>> You'll need to figure out what's doing that git fetch, as that >>> definitely sounds like it's the culprit. >>> >>> Christian >>> >>> -- >>> Christian Hammond >>> President/CEO of Beanbag <https://www.beanbaginc.com/> >>> Makers of Review Board <https://www.reviewboard.org/> >>> >>> On Mon, May 16, 2016 at 3:32 AM, Abhishek Choudhary <xab...@gmail.com> >>> wrote: >>> >>>> I get this error in reviewboard logs: >>>> >>>> [Mon May 16 06:29:59.527802 2016] [wsgi:error] [pid 4995] [client >>>> 10.79.176.142:32246] Timeout when reading response headers from daemon >>>> process 'sdlctool': /local/apps/reviewboard-prod/conf/apache_wsgi.conf, >>>> referer: http://reviewboard.nyc.deshaw.com/dashboard/ >>>> >>>> I little new to this setup and am at total loss on this issue. Which >>>> timeout is causing this issue? I have around 100 repositories in the >>>> reviewboard setup. What timeout value should i configure and where? >>>> >>>> Thanks for help. >>>> >>>> >>>> >>>> On Monday, May 16, 2016 at 1:50:47 PM UTC+5:30, Abhishek Choudhary >>>> wrote: >>>>> >>>>> When I click on "new review request" I see following logs in >>>>> reviewboard: >>>>> ... >>>>> [Mon May 16 01:17:46.025209 2016] [wsgi:error] [pid 19078] Before >>>>> executing the git fetch statement: >>>>> [Mon May 16 01:17:46.025234 2016] [wsgi:error] [pid 19078] The path >>>>> is: /data/sdlctools/reviewboard/repositories/git/test/batch_db/.git >>>>> [Mon May 16 01:17:46.676418 2016] [wsgi:error] [pid 19078] (0, >>>>> 'Fetching origin') >>>>> [Mon May 16 01:17:46.676437 2016] [wsgi:error] [pid 19078] Done >>>>> [Mon May 16 01:17:46.679610 2016] [wsgi:error] [pid 19078] Before >>>>> executing the git fetch statement: >>>>> [Mon May 16 01:17:46.679634 2016] [wsgi:error] [pid 19078] The path >>>>> is: >>>>> /data/sdlctools/reviewboard/repositories/git/enterprise/web-solutions/.git >>>>> [Mon May 16 01:17:47.339001 2016] [wsgi:error] [pid 19078] (0, >>>>> 'Fetching origin') >>>>> .. >>>>> >>>>> Seems that it tries to do git fetch for all repositories and the >>>>> Gateway timeout error occurs before these logs entries stop. Could this >>>>> be >>>>> an indicative of a problem? >>>>> >>>>> Thanks for the help >>>>> >>>>> On Saturday, May 14, 2016 at 3:59:43 PM UTC+5:30, Abhishek Choudhary >>>>> wrote: >>>>>> >>>>>> This happens when loading the New Review Request page. browsing the >>>>>> already created review requests works fine. I am using GIT repository >>>>>> which >>>>>> is hosted on a internal servers. >>>>>> >>>>>> Steps: >>>>>> Open dashboard page. >>>>>> Click on new review request button and the after waiting for about a >>>>>> minute the gateway timeout error happens. >>>>>> >>>>>> On Saturday, May 14, 2016 at 2:21:26 AM UTC+5:30, Christian Hammond >>>>>> wrote: >>>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> At what point do you see this? When loading the New Review Request >>>>>>> page, or browsing commits, or...? Can you walk through every step? >>>>>>> >>>>>>> Also, what type of repository, and where is it hosted? >>>>>>> >>>>>>> Christian >>>>>>> >>>>>>> >>>>>>> On Friday, May 13, 2016, Abhishek Choudhary <xab...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> I am seeing gateway timeout error with my reviewboard setup >>>>>>>> whenever i try to create a new request using 'New Review Request >>>>>>>> <http://reviewboard.nyc.deshaw.com/r/new/>' option. Dashboard >>>>>>>> loads up pretty quickly and other functionalities are working fine. >>>>>>>> The >>>>>>>> problem occurs with new request only. >>>>>>>> >>>>>>>> Server info: >>>>>>>> Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.1e-fips >>>>>>>> mod_auth_kerb/5.4 mod_wsgi/4.4.11 Python/2.7.11 Server >>>>>>>> >>>>>>>> I am not sure where to start looking for the issue. Has anyone seen >>>>>>>> this error before? >>>>>>>> >>>>>>>> Please help! >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Abhishek >>>>>>>> >>>>>>>> -- >>>>>>>> Supercharge your Review Board with Power Pack: >>>>>>>> https://www.reviewboard.org/powerpack/ >>>>>>>> Want us to host Review Board for you? Check out RBCommons: >>>>>>>> https://rbcommons.com/ >>>>>>>> Happy user? Let us know! https://www.reviewboard.org/users/ >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "reviewboard" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to reviewboard+unsubscr...@googlegroups.com. >>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> -- >>>>>>> Christian Hammond >>>>>>> President/CEO of Beanbag <https://www.beanbaginc.com/> >>>>>>> Makers of Review Board <https://www.reviewboard.org/> >>>>>>> >>>>>>> -- >>>> Supercharge your Review Board with Power Pack: >>>> https://www.reviewboard.org/powerpack/ >>>> Want us to host Review Board for you? Check out RBCommons: >>>> https://rbcommons.com/ >>>> Happy user? Let us know! https://www.reviewboard.org/users/ >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "reviewboard" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to reviewboard...@googlegroups.com. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- Supercharge your Review Board with Power Pack: https://www.reviewboard.org/powerpack/ Want us to host Review Board for you? Check out RBCommons: https://rbcommons.com/ Happy user? Let us know! https://www.reviewboard.org/users/ --- You received this message because you are subscribed to the Google Groups "reviewboard" group. To unsubscribe from this group and stop receiving emails from it, send an email to reviewboard+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
