Re: [Arches] Re: Uploaded files status: "queued"

2018-10-15 Thread Vincent Meijer
Thanks Adam, I'll dive into that


On Monday, 15 October 2018 16:42:17 UTC+2, Adam Cox wrote:
>
> Vincent, here's where the value should be set, it's at the end of the 
> method that handles the filelist request.
>
>
> https://github.com/archesproject/arches/blob/master/arches/app/datatypes/datatypes.py#L948
>
> I'd suggest adding some step-by-step print statements in that function, 
> because it seems to be failing silently for you, and indeed it could be a 
> bug...
>
> Adam
>
> On Mon, Oct 15, 2018 at 9:28 AM Vincent Meijer  > wrote:
>
>> I am still seemingly randomly getting uploaded file tiles that have the 
>> 'queued' status. This is preventing me from getting the download url of the 
>> file (and thus displaying its contents).
>>
>> Could this be a bug in Arches? It is quite a big problem for my project 
>> at the moment. 
>>
>> Thanks!
>> Vincent
>>
>>
>> On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote:
>>>
>>> And there is also this: 
>>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
>>> But I still can't find where it could get that 'status = queued' value.
>>>
>>>
>>> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:

 My main problem now is that when status = queued, the url property is 
 also null. 
 I can't find any Arches code that even hints at setting these 
 properties, except in datatypes.FileListDataType where status is set 
 to "uploaded":

 https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948


 On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>
> Hi Vincent, this touches on something we at Legion GIS came across 
> recently, while trying to include file pathsd in a CSV upload. Turns out 
> that because the actual upload process isn't run, even if the files exist 
> in the file system before the import their status is never updated to 
> "uploaded". Our first work around is a management command that goes in 
> after the fact and manually changes all statuses to "uploaded".
>
> This is only tangentially related to your question, as it doesn't 
> address the "queued" value, but I wanted to mention it because ultimately 
> we too are wondering what the status property is for...
>
> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer 
> wrote:
>>
>> Sometimes after I uploaded a file and then try to display them in the 
>> frontend, the item has a status 'queued', where I would expect the 
>> status 
>> to be 'uploaded'.
>> This property is used e.g. in the Image Header template  (image.js):
>>
>> if (item.status &&
>> item.type &&
>> item.status === 'uploaded' &&
>> item.type.indexOf('image') > -1 &&
>> _.contains(nodes, key)
>> ) {
>> imgs.push({
>> src: item.url,
>> alt: item.name
>> });
>> }
>>
>> I am using a similar approach on a custom template to read file names 
>> of uploaded zips:
>>
>> if (item.status &&
>> item.status === 'uploaded' &&
>> (item.name.split('.').pop() == 'zip')
>> ) {
>> potreeZipFiles.push({
>> src: item.url,
>> name: item.name
>> });
>> }
>>
>>
>> What is the function of this status property and why does it still 
>> have the 'queued' value while the upload has already finished?
>>
>> -- 
>> -- To post, send email to arches...@googlegroups.com . To 
>> unsubscribe, send email to archesprojec...@googlegroups.com . 
>> For more information, visit 
>> https://groups.google.com/d/forum/archesproject?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Arches Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to archesprojec...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [Arches] Re: Uploaded files status: "queued"

2018-10-15 Thread Adam Cox
Vincent, here's where the value should be set, it's at the end of the
method that handles the filelist request.

https://github.com/archesproject/arches/blob/master/arches/app/datatypes/datatypes.py#L948

I'd suggest adding some step-by-step print statements in that function,
because it seems to be failing silently for you, and indeed it could be a
bug...

Adam

On Mon, Oct 15, 2018 at 9:28 AM Vincent Meijer 
wrote:

> I am still seemingly randomly getting uploaded file tiles that have the
> 'queued' status. This is preventing me from getting the download url of the
> file (and thus displaying its contents).
>
> Could this be a bug in Arches? It is quite a big problem for my project at
> the moment.
>
> Thanks!
> Vincent
>
>
> On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote:
>>
>> And there is also this:
>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
>> But I still can't find where it could get that 'status = queued' value.
>>
>>
>> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>>>
>>> My main problem now is that when status = queued, the url property is
>>> also null.
>>> I can't find any Arches code that even hints at setting these
>>> properties, except in datatypes.FileListDataType where status is set to
>>> "uploaded":
>>>
>>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>>>
>>>
>>> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:

 Hi Vincent, this touches on something we at Legion GIS came across
 recently, while trying to include file pathsd in a CSV upload. Turns out
 that because the actual upload process isn't run, even if the files exist
 in the file system before the import their status is never updated to
 "uploaded". Our first work around is a management command that goes in
 after the fact and manually changes all statuses to "uploaded".

 This is only tangentially related to your question, as it doesn't
 address the "queued" value, but I wanted to mention it because ultimately
 we too are wondering what the status property is for...

 On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>
> Sometimes after I uploaded a file and then try to display them in the
> frontend, the item has a status 'queued', where I would expect the status
> to be 'uploaded'.
> This property is used e.g. in the Image Header template  (image.js):
>
> if (item.status &&
> item.type &&
> item.status === 'uploaded' &&
> item.type.indexOf('image') > -1 &&
> _.contains(nodes, key)
> ) {
> imgs.push({
> src: item.url,
> alt: item.name
> });
> }
>
> I am using a similar approach on a custom template to read file names
> of uploaded zips:
>
> if (item.status &&
> item.status === 'uploaded' &&
> (item.name.split('.').pop() == 'zip')
> ) {
> potreeZipFiles.push({
> src: item.url,
> name: item.name
> });
> }
>
>
> What is the function of this status property and why does it still
> have the 'queued' value while the upload has already finished?
>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[Arches] Re: Uploaded files status: "queued"

2018-10-15 Thread Vincent Meijer
I am still seemingly randomly getting uploaded file tiles that have the 
'queued' status. This is preventing me from getting the download url of the 
file (and thus displaying its contents).

Could this be a bug in Arches? It is quite a big problem for my project at 
the moment. 

Thanks!
Vincent


On Friday, 12 October 2018 14:41:47 UTC+2, Vincent Meijer wrote:
>
> And there is also this: 
> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
> But I still can't find where it could get that 'status = queued' value.
>
>
> On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>>
>> My main problem now is that when status = queued, the url property is 
>> also null. 
>> I can't find any Arches code that even hints at setting these properties, 
>> except in datatypes.FileListDataType where status is set to "uploaded":
>>
>> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>>
>>
>> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>>>
>>> Hi Vincent, this touches on something we at Legion GIS came across 
>>> recently, while trying to include file pathsd in a CSV upload. Turns out 
>>> that because the actual upload process isn't run, even if the files exist 
>>> in the file system before the import their status is never updated to 
>>> "uploaded". Our first work around is a management command that goes in 
>>> after the fact and manually changes all statuses to "uploaded".
>>>
>>> This is only tangentially related to your question, as it doesn't 
>>> address the "queued" value, but I wanted to mention it because ultimately 
>>> we too are wondering what the status property is for...
>>>
>>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:

 Sometimes after I uploaded a file and then try to display them in the 
 frontend, the item has a status 'queued', where I would expect the status 
 to be 'uploaded'.
 This property is used e.g. in the Image Header template  (image.js):

 if (item.status &&
 item.type &&
 item.status === 'uploaded' &&
 item.type.indexOf('image') > -1 &&
 _.contains(nodes, key)
 ) {
 imgs.push({
 src: item.url,
 alt: item.name
 });
 }

 I am using a similar approach on a custom template to read file names 
 of uploaded zips:

 if (item.status &&
 item.status === 'uploaded' &&
 (item.name.split('.').pop() == 'zip')
 ) {
 potreeZipFiles.push({
 src: item.url,
 name: item.name
 });
 }


 What is the function of this status property and why does it still have 
 the 'queued' value while the upload has already finished?



-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[Arches] Re: Uploaded files status: "queued"

2018-10-12 Thread Vincent Meijer
And there is also 
this: 
https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/media/js/views/components/widgets/file.js#L121
But I still can't find where it could get that 'status = queued' value.


On Friday, 12 October 2018 13:50:24 UTC+2, Vincent Meijer wrote:
>
> My main problem now is that when status = queued, the url property is also 
> null. 
> I can't find any Arches code that even hints at setting these properties, 
> except in datatypes.FileListDataType where status is set to "uploaded":
>
> https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948
>
>
> On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>>
>> Hi Vincent, this touches on something we at Legion GIS came across 
>> recently, while trying to include file pathsd in a CSV upload. Turns out 
>> that because the actual upload process isn't run, even if the files exist 
>> in the file system before the import their status is never updated to 
>> "uploaded". Our first work around is a management command that goes in 
>> after the fact and manually changes all statuses to "uploaded".
>>
>> This is only tangentially related to your question, as it doesn't address 
>> the "queued" value, but I wanted to mention it because ultimately we too 
>> are wondering what the status property is for...
>>
>> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>>>
>>> Sometimes after I uploaded a file and then try to display them in the 
>>> frontend, the item has a status 'queued', where I would expect the status 
>>> to be 'uploaded'.
>>> This property is used e.g. in the Image Header template  (image.js):
>>>
>>> if (item.status &&
>>> item.type &&
>>> item.status === 'uploaded' &&
>>> item.type.indexOf('image') > -1 &&
>>> _.contains(nodes, key)
>>> ) {
>>> imgs.push({
>>> src: item.url,
>>> alt: item.name
>>> });
>>> }
>>>
>>> I am using a similar approach on a custom template to read file names of 
>>> uploaded zips:
>>>
>>> if (item.status &&
>>> item.status === 'uploaded' &&
>>> (item.name.split('.').pop() == 'zip')
>>> ) {
>>> potreeZipFiles.push({
>>> src: item.url,
>>> name: item.name
>>> });
>>> }
>>>
>>>
>>> What is the function of this status property and why does it still have 
>>> the 'queued' value while the upload has already finished?
>>>
>>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[Arches] Re: Uploaded files status: "queued"

2018-10-12 Thread Vincent Meijer
My main problem now is that when status = queued, the url property is also 
null. 
I can't find any Arches code that even hints at setting these properties, 
except in datatypes.FileListDataType where status is set to "uploaded":
https://github.com/archesproject/arches/blob/07d5ac0652af60f435ff1316ee7d26c06c9e0e56/arches/app/datatypes/datatypes.py#L948


On Thursday, 11 October 2018 16:58:48 UTC+2, Adam Cox wrote:
>
> Hi Vincent, this touches on something we at Legion GIS came across 
> recently, while trying to include file pathsd in a CSV upload. Turns out 
> that because the actual upload process isn't run, even if the files exist 
> in the file system before the import their status is never updated to 
> "uploaded". Our first work around is a management command that goes in 
> after the fact and manually changes all statuses to "uploaded".
>
> This is only tangentially related to your question, as it doesn't address 
> the "queued" value, but I wanted to mention it because ultimately we too 
> are wondering what the status property is for...
>
> On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>>
>> Sometimes after I uploaded a file and then try to display them in the 
>> frontend, the item has a status 'queued', where I would expect the status 
>> to be 'uploaded'.
>> This property is used e.g. in the Image Header template  (image.js):
>>
>> if (item.status &&
>> item.type &&
>> item.status === 'uploaded' &&
>> item.type.indexOf('image') > -1 &&
>> _.contains(nodes, key)
>> ) {
>> imgs.push({
>> src: item.url,
>> alt: item.name
>> });
>> }
>>
>> I am using a similar approach on a custom template to read file names of 
>> uploaded zips:
>>
>> if (item.status &&
>> item.status === 'uploaded' &&
>> (item.name.split('.').pop() == 'zip')
>> ) {
>> potreeZipFiles.push({
>> src: item.url,
>> name: item.name
>> });
>> }
>>
>>
>> What is the function of this status property and why does it still have 
>> the 'queued' value while the upload has already finished?
>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[Arches] Re: Uploaded files status: "queued"

2018-10-11 Thread Adam Cox
Hi Vincent, this touches on something we at Legion GIS came across 
recently, while trying to include file pathsd in a CSV upload. Turns out 
that because the actual upload process isn't run, even if the files exist 
in the file system before the import their status is never updated to 
"uploaded". Our first work around is a management command that goes in 
after the fact and manually changes all statuses to "uploaded".

This is only tangentially related to your question, as it doesn't address 
the "queued" value, but I wanted to mention it because ultimately we too 
are wondering what the status property is for...

On Thursday, October 11, 2018 at 3:06:05 AM UTC-5, Vincent Meijer wrote:
>
> Sometimes after I uploaded a file and then try to display them in the 
> frontend, the item has a status 'queued', where I would expect the status 
> to be 'uploaded'.
> This property is used e.g. in the Image Header template  (image.js):
>
> if (item.status &&
> item.type &&
> item.status === 'uploaded' &&
> item.type.indexOf('image') > -1 &&
> _.contains(nodes, key)
> ) {
> imgs.push({
> src: item.url,
> alt: item.name
> });
> }
>
> I am using a similar approach on a custom template to read file names of 
> uploaded zips:
>
> if (item.status &&
> item.status === 'uploaded' &&
> (item.name.split('.').pop() == 'zip')
> ) {
> potreeZipFiles.push({
> src: item.url,
> name: item.name
> });
> }
>
>
> What is the function of this status property and why does it still have 
> the 'queued' value while the upload has already finished?
>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.