Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Sam Wilson
Ah yes! So I think we just need to make ia-upload be better. :-) https://www.mediawiki.org/wiki/API:Upload#Chunked_uploading On Tue, 12 Sep 2017, at 08:17 PM, Nicolas VIGNERON wrote: > 2017-09-12 14:07 GMT+02:00 Yann Forget : >> Hi, >> >> The upload limit on Commons is 4 GB, so there should be

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Sam Wilson
Oh right! I'm behind the times for sure. :-) I guess it's because we don't support multi-part uploads then? Each chunk must be smaller than some amount? New bug now at: https://phabricator.wikimedia.org/T175680 On Tue, 12 Sep 2017, at 08:07 PM, Yann Forget wrote: > Hi, > > The upload limit on C

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Nicolas VIGNERON
2017-09-12 14:07 GMT+02:00 Yann Forget : > Hi, > > The upload limit on Commons is 4 GB, so there should be any issue. > If the script can't upload files bigger than 100 MB, it should be fixed. > See how other tools work, as an example (i.e. video2commons). > 100 MB is the « regular » limit. 4 GB

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Federico Leva (Nemo)
Sam Wilson, 12/09/2017 15:03: I'm not sure how to get around this. Probably by delegating the upload to a library which is able to use chuncked uploading, https://www.mediawiki.org/wiki/API:Upload#Chunked_uploading Nemo ___ Wikisource-l mailing li

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Yann Forget
Hi, The upload limit on Commons is 4 GB, so there should be any issue. If the script can't upload files bigger than 100 MB, it should be fixed. See how other tools work, as an example (i.e. video2commons). Regards, Yann 2017-09-12 14:03 GMT+02:00 Sam Wilson : > Yes, this happens when the resu

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Sam Wilson
Yes, this happens when the resultant DjVu file is larger than Commons will allow. I think 100 MB is the limit? I'm not sure how to get around this. Perhaps we resize the images smaller? But we don't want to do that every time, so perhaps we have to generate the DjVu, see how big it is, and if it's

Re: [Wikisource-l] IA Upload queue

2017-09-12 Thread Ilario Valdelli
[2017-08-02 08:00:49] LOG.CRITICAL: Client error: `POST https://commons.wikimedia.org/w/api.php` resulted in a `413 Request Entity Too Large` response: 413 Request Entity Too Large 413 Request Entity (truncated...) [] [] Or the program is not able to process huge files or, simply, the disk

[Wikisource-l] IA Upload queue

2017-09-12 Thread Andrea Zanni
Dear all, someone could help understand if we have an issue here? https://tools.wmflabs.org/ia-upload/commons/init Some librarians uploaded books months ago, but they were never processed. Is the tool working, or it simply never signals when it fails? __