Re: [Wikitech-l] pywikibot troubleshooting in recitation-bot

[Anthony Di Franco]

Actually I've made a bit of progress diagnosing this. It has nothing to do
with the login or looping in my code but may have to do with the
composition of my use of multiprocessing and pywikibot's use of
multithreading and may have to do with this bug:
https://phabricator.wikimedia.org/T135986
Any advice on managing this?

On Sat, Dec 24, 2016 at 1:36 PM Legoktm  wrote:

Hi,

+cc pywiki...@lists.wikimedia.org

On 12/22/2016 03:55 PM, Anthony Di Franco wrote:
> Hi all,
>  I'm doing some renovations on recitation-bot and running into trouble
when
> the time comes for pywikibot to upload article data to wikisource and
> commons. The thread doing so hangs without any sort of informative error.
I
> made sure that the unix user under which the web service that is using
> pywikibot is running is logged into each wiki per Max's advice but I still
> have the problem. I'm going to try to get more information about what's
> going on but would also appreciate pointers about what might be going
> wrong. Particularly, the web service is now running under Kubernetes
rather
> than sun grid engine, so I suspect that the login state might not be
making
> it into the container - can anyone advise on where the login state is
> maintained and whether this will be transferred into the kubernetes
> container?

Pywikibot stores all of its state in the same directory that your
user-config.py file is in.

In my experience python hanging is typically an accidental infinite
loop. Adding debug logging can help pinpoint where it starts hanging and
narrow down the problematic code.

-- Legoktm

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] pywikibot troubleshooting in recitation-bot

[Legoktm]

Hi,

+cc pywiki...@lists.wikimedia.org

On 12/22/2016 03:55 PM, Anthony Di Franco wrote:
> Hi all,
>  I'm doing some renovations on recitation-bot and running into trouble when
> the time comes for pywikibot to upload article data to wikisource and
> commons. The thread doing so hangs without any sort of informative error. I
> made sure that the unix user under which the web service that is using
> pywikibot is running is logged into each wiki per Max's advice but I still
> have the problem. I'm going to try to get more information about what's
> going on but would also appreciate pointers about what might be going
> wrong. Particularly, the web service is now running under Kubernetes rather
> than sun grid engine, so I suspect that the login state might not be making
> it into the container - can anyone advise on where the login state is
> maintained and whether this will be transferred into the kubernetes
> container?

Pywikibot stores all of its state in the same directory that your
user-config.py file is in.

In my experience python hanging is typically an accidental infinite
loop. Adding debug logging can help pinpoint where it starts hanging and
narrow down the problematic code.

-- Legoktm

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] pywikibot troubleshooting in recitation-bot

[Anthony Di Franco]

Hi all,
 I'm doing some renovations on recitation-bot and running into trouble when
the time comes for pywikibot to upload article data to wikisource and
commons. The thread doing so hangs without any sort of informative error. I
made sure that the unix user under which the web service that is using
pywikibot is running is logged into each wiki per Max's advice but I still
have the problem. I'm going to try to get more information about what's
going on but would also appreciate pointers about what might be going
wrong. Particularly, the web service is now running under Kubernetes rather
than sun grid engine, so I suspect that the login state might not be making
it into the container - can anyone advise on where the login state is
maintained and whether this will be transferred into the kubernetes
container?
Thanks,
Anthony
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l