Re: [Arches] Re: Uploaded files status: "queued"
Thanks Adam, I'll dive into that On Monday, 15 October 2018 16:42:17 UTC+2, Adam Cox wrote: > > Vincent, here's where the value should be set, it's at the end of the > method that handles the filelist request. > > > https://github.com/archesproject/arches/blob/master/arches/app/datatypes/datatypes.py#L948 > > I'd suggest adding some step-by-step print statements in that function, > because it seems to be failing silently for you, and indeed it could be a > bug... > > Adam > > On Mon, Oct 15, 2018 at 9:28 AM Vincent Meijer > wrote: > >> I am still seemingly randomly getting uploaded file tiles that have the >> 'queued' status. This is preventing me from getting the download url of the >> file (and thus displaying its contents). >> >> Could this be a bug in Arches? It is quite a big problem for my project >> at the moment. >> >> Thanks! >> Vincent >> >> >> On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote: >>> >>> And there is also this: >>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121 >>> But I still can't find where it could get that 'status = queued' value. >>> >>> >>> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote: My main problem now is that when status = queued, the url property is also null. I can't find any Arches code that even hints at setting these properties, except in datatypes.FileListDataType where status is set to "uploaded": https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948 On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote: > > Hi Vincent, this touches on something we at Legion GIS came across > recently, while trying to include file pathsd in a CSV upload. Turns out > that because the actual upload process isn't run, even if the files exist > in the file system before the import their status is never updated to > "uploaded". Our first work around is a management command that goes in > after the fact and manually changes all statuses to "uploaded". > > This is only tangentially related to your question, as it doesn't > address the "queued" value, but I wanted to mention it because ultimately > we too are wondering what the status property is for... > > On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer > wrote: >> >> Sometimes after I uploaded a file and then try to display them in the >> frontend, the item has a status 'queued', where I would expect the >> status >> to be 'uploaded'. >> This property is used e.g. in the Image Header template (image.js): >> >> if (item.status && >> item.type && >> item.status === 'uploaded' && >> item.type.indexOf('image') > -1 && >> _.contains(nodes, key) >> ) { >> imgs.push({ >> src: item.url, >> alt: item.name >> }); >> } >> >> I am using a similar approach on a custom template to read file names >> of uploaded zips: >> >> if (item.status && >> item.status === 'uploaded' && >> (item.name.split('.').pop() == 'zip') >> ) { >> potreeZipFiles.push({ >> src: item.url, >> name: item.name >> }); >> } >> >> >> What is the function of this status property and why does it still >> have the 'queued' value while the upload has already finished? >> >> -- >> -- To post, send email to arches...@googlegroups.com . To >> unsubscribe, send email to archesprojec...@googlegroups.com . >> For more information, visit >> https://groups.google.com/d/forum/archesproject?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Arches Project" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to archesprojec...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [Arches] Re: Uploaded files status: "queued"
Vincent, here's where the value should be set, it's at the end of the method that handles the filelist request. https://github.com/archesproject/arches/blob/master/arches/app/datatypes/datatypes.py#L948 I'd suggest adding some step-by-step print statements in that function, because it seems to be failing silently for you, and indeed it could be a bug... Adam On Mon, Oct 15, 2018 at 9:28 AM Vincent Meijer wrote: > I am still seemingly randomly getting uploaded file tiles that have the > 'queued' status. This is preventing me from getting the download url of the > file (and thus displaying its contents). > > Could this be a bug in Arches? It is quite a big problem for my project at > the moment. > > Thanks! > Vincent > > > On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote: >> >> And there is also this: >> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121 >> But I still can't find where it could get that 'status = queued' value. >> >> >> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote: >>> >>> My main problem now is that when status = queued, the url property is >>> also null. >>> I can't find any Arches code that even hints at setting these >>> properties, except in datatypes.FileListDataType where status is set to >>> "uploaded": >>> >>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948 >>> >>> >>> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote: Hi Vincent, this touches on something we at Legion GIS came across recently, while trying to include file pathsd in a CSV upload. Turns out that because the actual upload process isn't run, even if the files exist in the file system before the import their status is never updated to "uploaded". Our first work around is a management command that goes in after the fact and manually changes all statuses to "uploaded". This is only tangentially related to your question, as it doesn't address the "queued" value, but I wanted to mention it because ultimately we too are wondering what the status property is for... On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote: > > Sometimes after I uploaded a file and then try to display them in the > frontend, the item has a status 'queued', where I would expect the status > to be 'uploaded'. > This property is used e.g. in the Image Header template (image.js): > > if (item.status && > item.type && > item.status === 'uploaded' && > item.type.indexOf('image') > -1 && > _.contains(nodes, key) > ) { > imgs.push({ > src: item.url, > alt: item.name > }); > } > > I am using a similar approach on a custom template to read file names > of uploaded zips: > > if (item.status && > item.status === 'uploaded' && > (item.name.split('.').pop() == 'zip') > ) { > potreeZipFiles.push({ > src: item.url, > name: item.name > }); > } > > > What is the function of this status property and why does it still > have the 'queued' value while the upload has already finished? > > -- > -- To post, send email to archesproject@googlegroups.com. To unsubscribe, > send email to archesproject+unsubscr...@googlegroups.com. For more > information, visit https://groups.google.com/d/forum/archesproject?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Arches Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to archesproject+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[Arches] Re: Uploaded files status: "queued"
I am still seemingly randomly getting uploaded file tiles that have the 'queued' status. This is preventing me from getting the download url of the file (and thus displaying its contents). Could this be a bug in Arches? It is quite a big problem for my project at the moment. Thanks! Vincent On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote: > > And there is also this: > https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121 > But I still can't find where it could get that 'status = queued' value. > > > On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote: >> >> My main problem now is that when status = queued, the url property is >> also null. >> I can't find any Arches code that even hints at setting these properties, >> except in datatypes.FileListDataType where status is set to "uploaded": >> >> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948 >> >> >> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote: >>> >>> Hi Vincent, this touches on something we at Legion GIS came across >>> recently, while trying to include file pathsd in a CSV upload. Turns out >>> that because the actual upload process isn't run, even if the files exist >>> in the file system before the import their status is never updated to >>> "uploaded". Our first work around is a management command that goes in >>> after the fact and manually changes all statuses to "uploaded". >>> >>> This is only tangentially related to your question, as it doesn't >>> address the "queued" value, but I wanted to mention it because ultimately >>> we too are wondering what the status property is for... >>> >>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote: Sometimes after I uploaded a file and then try to display them in the frontend, the item has a status 'queued', where I would expect the status to be 'uploaded'. This property is used e.g. in the Image Header template (image.js): if (item.status && item.type && item.status === 'uploaded' && item.type.indexOf('image') > -1 && _.contains(nodes, key) ) { imgs.push({ src: item.url, alt: item.name }); } I am using a similar approach on a custom template to read file names of uploaded zips: if (item.status && item.status === 'uploaded' && (item.name.split('.').pop() == 'zip') ) { potreeZipFiles.push({ src: item.url, name: item.name }); } What is the function of this status property and why does it still have the 'queued' value while the upload has already finished? -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[Arches] Re: Uploaded files status: "queued"
And there is also this: https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121 But I still can't find where it could get that 'status = queued' value. On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote: > > My main problem now is that when status = queued, the url property is also > null. > I can't find any Arches code that even hints at setting these properties, > except in datatypes.FileListDataType where status is set to "uploaded": > > https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948 > > > On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote: >> >> Hi Vincent, this touches on something we at Legion GIS came across >> recently, while trying to include file pathsd in a CSV upload. Turns out >> that because the actual upload process isn't run, even if the files exist >> in the file system before the import their status is never updated to >> "uploaded". Our first work around is a management command that goes in >> after the fact and manually changes all statuses to "uploaded". >> >> This is only tangentially related to your question, as it doesn't address >> the "queued" value, but I wanted to mention it because ultimately we too >> are wondering what the status property is for... >> >> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote: >>> >>> Sometimes after I uploaded a file and then try to display them in the >>> frontend, the item has a status 'queued', where I would expect the status >>> to be 'uploaded'. >>> This property is used e.g. in the Image Header template (image.js): >>> >>> if (item.status && >>> item.type && >>> item.status === 'uploaded' && >>> item.type.indexOf('image') > -1 && >>> _.contains(nodes, key) >>> ) { >>> imgs.push({ >>> src: item.url, >>> alt: item.name >>> }); >>> } >>> >>> I am using a similar approach on a custom template to read file names of >>> uploaded zips: >>> >>> if (item.status && >>> item.status === 'uploaded' && >>> (item.name.split('.').pop() == 'zip') >>> ) { >>> potreeZipFiles.push({ >>> src: item.url, >>> name: item.name >>> }); >>> } >>> >>> >>> What is the function of this status property and why does it still have >>> the 'queued' value while the upload has already finished? >>> >>> -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[Arches] Re: Uploaded files status: "queued"
My main problem now is that when status = queued, the url property is also null. I can't find any Arches code that even hints at setting these properties, except in datatypes.FileListDataType where status is set to "uploaded": https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948 On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote: > > Hi Vincent, this touches on something we at Legion GIS came across > recently, while trying to include file pathsd in a CSV upload. Turns out > that because the actual upload process isn't run, even if the files exist > in the file system before the import their status is never updated to > "uploaded". Our first work around is a management command that goes in > after the fact and manually changes all statuses to "uploaded". > > This is only tangentially related to your question, as it doesn't address > the "queued" value, but I wanted to mention it because ultimately we too > are wondering what the status property is for... > > On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote: >> >> Sometimes after I uploaded a file and then try to display them in the >> frontend, the item has a status 'queued', where I would expect the status >> to be 'uploaded'. >> This property is used e.g. in the Image Header template (image.js): >> >> if (item.status && >> item.type && >> item.status === 'uploaded' && >> item.type.indexOf('image') > -1 && >> _.contains(nodes, key) >> ) { >> imgs.push({ >> src: item.url, >> alt: item.name >> }); >> } >> >> I am using a similar approach on a custom template to read file names of >> uploaded zips: >> >> if (item.status && >> item.status === 'uploaded' && >> (item.name.split('.').pop() == 'zip') >> ) { >> potreeZipFiles.push({ >> src: item.url, >> name: item.name >> }); >> } >> >> >> What is the function of this status property and why does it still have >> the 'queued' value while the upload has already finished? >> >> -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[Arches] Re: Uploaded files status: "queued"
Hi Vincent, this touches on something we at Legion GIS came across recently, while trying to include file pathsd in a CSV upload. Turns out that because the actual upload process isn't run, even if the files exist in the file system before the import their status is never updated to "uploaded". Our first work around is a management command that goes in after the fact and manually changes all statuses to "uploaded". This is only tangentially related to your question, as it doesn't address the "queued" value, but I wanted to mention it because ultimately we too are wondering what the status property is for... On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote: > > Sometimes after I uploaded a file and then try to display them in the > frontend, the item has a status 'queued', where I would expect the status > to be 'uploaded'. > This property is used e.g. in the Image Header template (image.js): > > if (item.status && > item.type && > item.status === 'uploaded' && > item.type.indexOf('image') > -1 && > _.contains(nodes, key) > ) { > imgs.push({ > src: item.url, > alt: item.name > }); > } > > I am using a similar approach on a custom template to read file names of > uploaded zips: > > if (item.status && > item.status === 'uploaded' && > (item.name.split('.').pop() == 'zip') > ) { > potreeZipFiles.push({ > src: item.url, > name: item.name > }); > } > > > What is the function of this status property and why does it still have > the 'queued' value while the upload has already finished? > > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.