Re: [Dspace-tech] access to page spins

[Jose Blanco]

Thank you both very much!!  I just checked AuthorizeManager.java and I had
created an infinite look when I merged.  It is working now!!

-Jose

On Thu, May 14, 2015 at 10:14 AM, Tim Donohue 
wrote:

> Hi Jose,
>
> Just as a reference, DSpace 5.1 recommends:
> * Maven 3.0.5
> * PostgreSQL 9 or above
>
> https://wiki.duraspace.org/display/DSDOC5x/Installing+DSpace
>
> It is possible DSpace 5.1 will work on older versions, but it is not
> tested on these older versions. Also, just an FYI, Postgres 8.4 is
> end-of-life and no longer supported in general:
> http://www.postgresql.org/support/versioning/
>
> That all being said, I don't think either of these would be causing a page
> to "spin" for Items which have non-Anonymous access rights. That doesn't
> sound like anything related to Postgres, and it's definitely not related to
> Maven (as Maven is only used to build/compile DSpace).
>
> As Andrea Schweer noted in another message in this thread, you may also
> wish to look more closely at your code customizations. Did you make any
> customizations to the access rights code? Or make heavy customizations to
> the item pages themselves?
>
> I'm not seeing this same "spinning" behavior for access restricted Items
> on any other DSpace 5.1 sites I have access to, nor on the Demo site (
> http://demo.dspace.org/xmlui/). So, I do wonder if you have any custom
> code dealing with access rights?  Is it even possible for you to replicate
> this on a development instance and step through the code to see where it
> "hangs"?
>
> - Tim
>
> On 5/13/2015 5:35 PM, Jose Blanco wrote:
>
>> Tim, one more thing,,, we have
>>
>> Apache Maven 3.0.1 and
>>
>> PostgresSQL 8.4
>>
>> Do you think this could have something to do with it?
>>
>> On Wed, May 13, 2015 at 3:19 PM, Jose Blanco > > wrote:
>>
>> Tim, The index completed successfully using:
>>
>> [dspace]/bin/dspace index-discovery -b
>>
>> But the spinning continues.
>>
>> When the indexing is done via the restart of tomcat, it fails when
>> it encounters an item that has non Anonymous rights.
>>
>> I'm attaching the error log with the last done successfully and then
>> the one it chokes on.  You can see that this one:
>>
>> TEMP-BOGUS/232403
>>
>> is done successfully, and then this one fails:
>>
>> TEMP-BOGUS/233500.
>>
>> Why would having a non Anonymous access right cause this error?
>>
>> THanks!
>> Jose
>>
>> On Wed, May 13, 2015 at 1:24 PM, Jose Blanco > > wrote:
>>
>> Thanks Tim, What seems to stopping the indexing is that when it
>> encounters an item that has rights other than Anonymous, it
>> fails.  I have confirmed this by editing an item it was failing
>> on and making all its access rights anonymous and then it went
>> on till it found another with non Anonymous rights.  I found
>> this out restarting tomcat and then going to the home page.  I
>> have not run the manual index, but will try that now and see
>> what kind of error it spits out.
>>
>> -Jose
>>
>> On Wed, May 13, 2015 at 1:12 PM, Tim Donohue
>> mailto:tdono...@duraspace.org>> wrote:
>>
>> Hi Jose,
>>
>> The reindexing process only occurs for the Search/Browse
>> indexes (and it doesn't touch the Solr Statistics index).
>> So, it would not be directly related to any issues with Solr
>> Statistics. The only part of the upgrade that affects the
>> Solr Statistics index is that the Solr Stats index will be
>> *upgraded* (to the latest version of Solr) during the "ant
>> update" step.
>>
>> Since you said the re-indexing (of Search/Browse index)
>> didn't complete, you probably should manually re-run it
>> (just in case it is somehow affecting the "spinning" you are
>> seeing):
>>
>> [dspace]/bin/index-discovery -b
>>
>> (By default, during the 5.x upgrade, that "index-discovery
>> -b" command runs automatically when you first startup Tomcat
>> after upgrading to 5.x. The only way to re-run it after that
>> point is to run it manually from the commandline.)
>>
>> - Tim
>>
>>
>> On 5/13/2015 10:27 AM, Jose Blanco wrote:
>>
>> Tim, I know the reindexing did not finish.  I'm trying
>> to grab log
>> output as it runs so I restarted tomcat, but nothing
>> gets written to the
>> log.  It seems like I have to go to the browser and
>> initiate a browse by
>> title for indexing to start.  Is that right?
>>
>>
>>
>> On Tue, May 12, 2015 at 5:37 PM, Tim Donohue
>> mailto:tdono...@duraspace.org>
>> > 

Re: [Dspace-tech] access to page spins

[Tim Donohue]

Hi Jose,

Just as a reference, DSpace 5.1 recommends:
* Maven 3.0.5
* PostgreSQL 9 or above

https://wiki.duraspace.org/display/DSDOC5x/Installing+DSpace

It is possible DSpace 5.1 will work on older versions, but it is not 
tested on these older versions. Also, just an FYI, Postgres 8.4 is 
end-of-life and no longer supported in general: 
http://www.postgresql.org/support/versioning/

That all being said, I don't think either of these would be causing a 
page to "spin" for Items which have non-Anonymous access rights. That 
doesn't sound like anything related to Postgres, and it's definitely not 
related to Maven (as Maven is only used to build/compile DSpace).

As Andrea Schweer noted in another message in this thread, you may also 
wish to look more closely at your code customizations. Did you make any 
customizations to the access rights code? Or make heavy customizations 
to the item pages themselves?

I'm not seeing this same "spinning" behavior for access restricted Items 
on any other DSpace 5.1 sites I have access to, nor on the Demo site 
(http://demo.dspace.org/xmlui/). So, I do wonder if you have any custom 
code dealing with access rights?  Is it even possible for you to 
replicate this on a development instance and step through the code to 
see where it "hangs"?

- Tim

On 5/13/2015 5:35 PM, Jose Blanco wrote:
> Tim, one more thing,,, we have
>
> Apache Maven 3.0.1 and
>
> PostgresSQL 8.4
>
> Do you think this could have something to do with it?
>
> On Wed, May 13, 2015 at 3:19 PM, Jose Blanco  > wrote:
>
> Tim, The index completed successfully using:
>
> [dspace]/bin/dspace index-discovery -b
>
> But the spinning continues.
>
> When the indexing is done via the restart of tomcat, it fails when
> it encounters an item that has non Anonymous rights.
>
> I'm attaching the error log with the last done successfully and then
> the one it chokes on.  You can see that this one:
>
> TEMP-BOGUS/232403
>
> is done successfully, and then this one fails:
>
> TEMP-BOGUS/233500.
>
> Why would having a non Anonymous access right cause this error?
>
> THanks!
> Jose
>
> On Wed, May 13, 2015 at 1:24 PM, Jose Blanco  > wrote:
>
> Thanks Tim, What seems to stopping the indexing is that when it
> encounters an item that has rights other than Anonymous, it
> fails.  I have confirmed this by editing an item it was failing
> on and making all its access rights anonymous and then it went
> on till it found another with non Anonymous rights.  I found
> this out restarting tomcat and then going to the home page.  I
> have not run the manual index, but will try that now and see
> what kind of error it spits out.
>
> -Jose
>
> On Wed, May 13, 2015 at 1:12 PM, Tim Donohue
> mailto:tdono...@duraspace.org>> wrote:
>
> Hi Jose,
>
> The reindexing process only occurs for the Search/Browse
> indexes (and it doesn't touch the Solr Statistics index).
> So, it would not be directly related to any issues with Solr
> Statistics. The only part of the upgrade that affects the
> Solr Statistics index is that the Solr Stats index will be
> *upgraded* (to the latest version of Solr) during the "ant
> update" step.
>
> Since you said the re-indexing (of Search/Browse index)
> didn't complete, you probably should manually re-run it
> (just in case it is somehow affecting the "spinning" you are
> seeing):
>
> [dspace]/bin/index-discovery -b
>
> (By default, during the 5.x upgrade, that "index-discovery
> -b" command runs automatically when you first startup Tomcat
> after upgrading to 5.x. The only way to re-run it after that
> point is to run it manually from the commandline.)
>
> - Tim
>
>
> On 5/13/2015 10:27 AM, Jose Blanco wrote:
>
> Tim, I know the reindexing did not finish.  I'm trying
> to grab log
> output as it runs so I restarted tomcat, but nothing
> gets written to the
> log.  It seems like I have to go to the browser and
> initiate a browse by
> title for indexing to start.  Is that right?
>
>
>
> On Tue, May 12, 2015 at 5:37 PM, Tim Donohue
> mailto:tdono...@duraspace.org>
>  >> wrote:
>
>  Hi Jose,
>
>  Are you saying that some of the accesses to Solr
> Stats work fine?
>  While others are spinning? Is there any difference
> in the type of
>  content that see

Re: [Dspace-tech] access to page spins

[Andrea Schweer]

Hi,

On 14/05/15 05:24, Jose Blanco wrote:
> Thanks Tim, What seems to stopping the indexing is that when it 
> encounters an item that has rights other than Anonymous, it fails.  I 
> have confirmed this by editing an item it was failing on and making 
> all its access rights anonymous and then it went on till it found 
> another with non Anonymous rights.  I found this out restarting tomcat 
> and then going to the home page.  I have not run the manual index, but 
> will try that now and see what kind of error it spits out.

You mentioned you have some customisations in your code. Do any of them 
touch access permissions at all? I've had some problems similar to what 
you describe with customisations that used a fresh context and mixed 
calls to AuthorizeManager methods with the resource policy type in the 
parameter list and those without. I believe these two types of methods 
treat item.update calls differently and this can lead to database race 
conditions. If I remember correctly, I resolved this by using the 
existing context whenever possible and not mixing these two types of 
methods otherwise. I can't remember whether there was anything useful in 
the database logs when I encountered this issue.

cheers,
Andrea

-- 
Dr Andrea Schweer
IRR Technical Specialist, ITS Information Systems
The University of Waikato, Hamilton, New Zealand


--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] access to page spins

[Jose Blanco]

Tim, one more thing,,, we have

Apache Maven 3.0.1 and

PostgresSQL 8.4

Do you think this could have something to do with it?

On Wed, May 13, 2015 at 3:19 PM, Jose Blanco  wrote:

> Tim, The index completed successfully using:
>
> [dspace]/bin/dspace index-discovery -b
>
> But the spinning continues.
>
> When the indexing is done via the restart of tomcat, it fails when it
> encounters an item that has non Anonymous rights.
>
> I'm attaching the error log with the last done successfully and then the
> one it chokes on.  You can see that this one:
>
> TEMP-BOGUS/232403
>
> is done successfully, and then this one fails:
>
> TEMP-BOGUS/233500.
>
> Why would having a non Anonymous access right cause this error?
>
> THanks!
> Jose
>
> On Wed, May 13, 2015 at 1:24 PM, Jose Blanco  wrote:
>
>> Thanks Tim, What seems to stopping the indexing is that when it
>> encounters an item that has rights other than Anonymous, it fails.  I have
>> confirmed this by editing an item it was failing on and making all its
>> access rights anonymous and then it went on till it found another with non
>> Anonymous rights.  I found this out restarting tomcat and then going to the
>> home page.  I have not run the manual index, but will try that now and see
>> what kind of error it spits out.
>>
>> -Jose
>>
>> On Wed, May 13, 2015 at 1:12 PM, Tim Donohue 
>> wrote:
>>
>>> Hi Jose,
>>>
>>> The reindexing process only occurs for the Search/Browse indexes (and it
>>> doesn't touch the Solr Statistics index). So, it would not be directly
>>> related to any issues with Solr Statistics. The only part of the upgrade
>>> that affects the Solr Statistics index is that the Solr Stats index will be
>>> *upgraded* (to the latest version of Solr) during the "ant update" step.
>>>
>>> Since you said the re-indexing (of Search/Browse index) didn't complete,
>>> you probably should manually re-run it (just in case it is somehow
>>> affecting the "spinning" you are seeing):
>>>
>>> [dspace]/bin/index-discovery -b
>>>
>>> (By default, during the 5.x upgrade, that "index-discovery -b" command
>>> runs automatically when you first startup Tomcat after upgrading to 5.x.
>>> The only way to re-run it after that point is to run it manually from the
>>> commandline.)
>>>
>>> - Tim
>>>
>>>
>>> On 5/13/2015 10:27 AM, Jose Blanco wrote:
>>>
 Tim, I know the reindexing did not finish.  I'm trying to grab log
 output as it runs so I restarted tomcat, but nothing gets written to the
 log.  It seems like I have to go to the browser and initiate a browse by
 title for indexing to start.  Is that right?



 On Tue, May 12, 2015 at 5:37 PM, Tim Donohue >>> > wrote:

 Hi Jose,

 Are you saying that some of the accesses to Solr Stats work fine?
 While others are spinning? Is there any difference in the type of
 content that seems to cause Solr to spin (i.e. anything different
 about those Items in any way that you can tell)?

 I'm just trying to see if it's possible to narrow down the issue. It
 sounds like it's not Solr overall (as some accesses work and some do
 not). But, then the question becomes what is different between those
 that work and those that do not.

 Since this happened post-upgrade to 5.x, I'm assuming all the
 automatic upgrades to your Solr look to have succeeded? During the
 "ant update" process, your indexes should have been automatically
 upgraded to the latest Solr version (including the statistics
 index). Just wanted to make sure that whole process also went
 smoothly with regards to the Solr Statistics index.

 - Tim

 On 5/12/2015 3:46 PM, Jose Blanco wrote:

 TIm, from the tomcat area:

 This is from a good access:

 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
 /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET

 /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
 HTTP/1.1" 200 215
 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET

 /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
 HTTP/1.1" 200 272
 141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
 /handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -



 This is from one that spins:

 141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
 /solr/statist

Re: [Dspace-tech] access to page spins

[Jose Blanco]

Thanks Tim, What seems to stopping the indexing is that when it encounters
an item that has rights other than Anonymous, it fails.  I have confirmed
this by editing an item it was failing on and making all its access rights
anonymous and then it went on till it found another with non Anonymous
rights.  I found this out restarting tomcat and then going to the home
page.  I have not run the manual index, but will try that now and see what
kind of error it spits out.

-Jose

On Wed, May 13, 2015 at 1:12 PM, Tim Donohue  wrote:

> Hi Jose,
>
> The reindexing process only occurs for the Search/Browse indexes (and it
> doesn't touch the Solr Statistics index). So, it would not be directly
> related to any issues with Solr Statistics. The only part of the upgrade
> that affects the Solr Statistics index is that the Solr Stats index will be
> *upgraded* (to the latest version of Solr) during the "ant update" step.
>
> Since you said the re-indexing (of Search/Browse index) didn't complete,
> you probably should manually re-run it (just in case it is somehow
> affecting the "spinning" you are seeing):
>
> [dspace]/bin/index-discovery -b
>
> (By default, during the 5.x upgrade, that "index-discovery -b" command
> runs automatically when you first startup Tomcat after upgrading to 5.x.
> The only way to re-run it after that point is to run it manually from the
> commandline.)
>
> - Tim
>
>
> On 5/13/2015 10:27 AM, Jose Blanco wrote:
>
>> Tim, I know the reindexing did not finish.  I'm trying to grab log
>> output as it runs so I restarted tomcat, but nothing gets written to the
>> log.  It seems like I have to go to the browser and initiate a browse by
>> title for indexing to start.  Is that right?
>>
>>
>>
>> On Tue, May 12, 2015 at 5:37 PM, Tim Donohue > > wrote:
>>
>> Hi Jose,
>>
>> Are you saying that some of the accesses to Solr Stats work fine?
>> While others are spinning? Is there any difference in the type of
>> content that seems to cause Solr to spin (i.e. anything different
>> about those Items in any way that you can tell)?
>>
>> I'm just trying to see if it's possible to narrow down the issue. It
>> sounds like it's not Solr overall (as some accesses work and some do
>> not). But, then the question becomes what is different between those
>> that work and those that do not.
>>
>> Since this happened post-upgrade to 5.x, I'm assuming all the
>> automatic upgrades to your Solr look to have succeeded? During the
>> "ant update" process, your indexes should have been automatically
>> upgraded to the latest Solr version (including the statistics
>> index). Just wanted to make sure that whole process also went
>> smoothly with regards to the Solr Statistics index.
>>
>> - Tim
>>
>> On 5/12/2015 3:46 PM, Jose Blanco wrote:
>>
>> TIm, from the tomcat area:
>>
>> This is from a good access:
>>
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
>> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
>>
>> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
>> HTTP/1.1" 200 215
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
>>
>> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
>> HTTP/1.1" 200 272
>> 141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
>> /handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -
>>
>>
>>
>> This is from one that spins:
>>
>> 141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
>> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>>
>>
>> On Tue, May 12, 2015 at 4:37 PM, Jose Blanco > 
>> >> wrote:
>>
>>  Tim, I think it may have to do with solr statistics. Is
>> there a say
>>  to turn it off.
>>
>>  Attached is part of the dspace log file created when the
>> spinning
>>  takes place.
>>
>>
>>
>>  On Tue, May 12, 2015 at 3:54 PM, Tim Donohue
>> mailto:tdono...@duraspace.org>
>>  >
>> >> wrote:
>>
>>  Hi Jose,
>>
>>  You might want to check your logs (both DSpace and
>> Tomcat logs)
>>  to see if there's anything going on there while the
>> browser "spins".
>>
>>  Otherwise, it's a bit hard to guess at what could 

Re: [Dspace-tech] access to page spins

[Tim Donohue]

Hi Jose,

The reindexing process only occurs for the Search/Browse indexes (and it 
doesn't touch the Solr Statistics index). So, it would not be directly 
related to any issues with Solr Statistics. The only part of the upgrade 
that affects the Solr Statistics index is that the Solr Stats index will 
be *upgraded* (to the latest version of Solr) during the "ant update" step.

Since you said the re-indexing (of Search/Browse index) didn't complete, 
you probably should manually re-run it (just in case it is somehow 
affecting the "spinning" you are seeing):

[dspace]/bin/index-discovery -b

(By default, during the 5.x upgrade, that "index-discovery -b" command 
runs automatically when you first startup Tomcat after upgrading to 5.x. 
The only way to re-run it after that point is to run it manually from 
the commandline.)

- Tim


On 5/13/2015 10:27 AM, Jose Blanco wrote:
> Tim, I know the reindexing did not finish.  I'm trying to grab log
> output as it runs so I restarted tomcat, but nothing gets written to the
> log.  It seems like I have to go to the browser and initiate a browse by
> title for indexing to start.  Is that right?
>
>
>
> On Tue, May 12, 2015 at 5:37 PM, Tim Donohue  > wrote:
>
> Hi Jose,
>
> Are you saying that some of the accesses to Solr Stats work fine?
> While others are spinning? Is there any difference in the type of
> content that seems to cause Solr to spin (i.e. anything different
> about those Items in any way that you can tell)?
>
> I'm just trying to see if it's possible to narrow down the issue. It
> sounds like it's not Solr overall (as some accesses work and some do
> not). But, then the question becomes what is different between those
> that work and those that do not.
>
> Since this happened post-upgrade to 5.x, I'm assuming all the
> automatic upgrades to your Solr look to have succeeded? During the
> "ant update" process, your indexes should have been automatically
> upgraded to the latest Solr version (including the statistics
> index). Just wanted to make sure that whole process also went
> smoothly with regards to the Solr Statistics index.
>
> - Tim
>
> On 5/12/2015 3:46 PM, Jose Blanco wrote:
>
> TIm, from the tomcat area:
>
> This is from a good access:
>
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
> 
> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
> HTTP/1.1" 200 215
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
> 
> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
> HTTP/1.1" 200 272
> 141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
> /handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -
>
>
>
> This is from one that spins:
>
> 141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>
>
> On Tue, May 12, 2015 at 4:37 PM, Jose Blanco  
> >> wrote:
>
>  Tim, I think it may have to do with solr statistics. Is
> there a say
>  to turn it off.
>
>  Attached is part of the dspace log file created when the
> spinning
>  takes place.
>
>
>
>  On Tue, May 12, 2015 at 3:54 PM, Tim Donohue
> mailto:tdono...@duraspace.org>
>   >> wrote:
>
>  Hi Jose,
>
>  You might want to check your logs (both DSpace and
> Tomcat logs)
>  to see if there's anything going on there while the
> browser "spins".
>
>  Otherwise, it's a bit hard to guess at what could cause the
>  browser to hang. My best guess is that it's waiting on
> something
>  that is running behind the scenes, but it's hard to
> tell what
>  that "something" is (and I'm hoping maybe the logs
> would give
>  you and us a hint).
>
>  You also might want to test what scenarios cause the
> "spinning".
>  Is it accessing *any* community/collection/item? Or, is
> it just
>  some objects? Does it happen when logged in only? Or,
> also when
>  accessi

Re: [Dspace-tech] access to page spins

[Jose Blanco]

Tim, I know the reindexing did not finish.  I'm trying to grab log output
as it runs so I restarted tomcat, but nothing gets written to the log.  It
seems like I have to go to the browser and initiate a browse by title for
indexing to start.  Is that right?



On Tue, May 12, 2015 at 5:37 PM, Tim Donohue  wrote:

> Hi Jose,
>
> Are you saying that some of the accesses to Solr Stats work fine? While
> others are spinning? Is there any difference in the type of content that
> seems to cause Solr to spin (i.e. anything different about those Items in
> any way that you can tell)?
>
> I'm just trying to see if it's possible to narrow down the issue. It
> sounds like it's not Solr overall (as some accesses work and some do not).
> But, then the question becomes what is different between those that work
> and those that do not.
>
> Since this happened post-upgrade to 5.x, I'm assuming all the automatic
> upgrades to your Solr look to have succeeded? During the "ant update"
> process, your indexes should have been automatically upgraded to the latest
> Solr version (including the statistics index). Just wanted to make sure
> that whole process also went smoothly with regards to the Solr Statistics
> index.
>
> - Tim
>
> On 5/12/2015 3:46 PM, Jose Blanco wrote:
>
>> TIm, from the tomcat area:
>>
>> This is from a good access:
>>
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
>> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
>>
>> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
>> HTTP/1.1" 200 215
>> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
>>
>> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
>> HTTP/1.1" 200 272
>> 141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
>> /handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -
>>
>>
>>
>> This is from one that spins:
>>
>> 141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
>> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>>
>>
>> On Tue, May 12, 2015 at 4:37 PM, Jose Blanco > > wrote:
>>
>> Tim, I think it may have to do with solr statistics. Is there a say
>> to turn it off.
>>
>> Attached is part of the dspace log file created when the spinning
>> takes place.
>>
>>
>>
>> On Tue, May 12, 2015 at 3:54 PM, Tim Donohue > > wrote:
>>
>> Hi Jose,
>>
>> You might want to check your logs (both DSpace and Tomcat logs)
>> to see if there's anything going on there while the browser
>> "spins".
>>
>> Otherwise, it's a bit hard to guess at what could cause the
>> browser to hang. My best guess is that it's waiting on something
>> that is running behind the scenes, but it's hard to tell what
>> that "something" is (and I'm hoping maybe the logs would give
>> you and us a hint).
>>
>> You also might want to test what scenarios cause the "spinning".
>> Is it accessing *any* community/collection/item? Or, is it just
>> some objects? Does it happen when logged in only? Or, also when
>> accessing the site anonymously?
>>
>> - Tim
>>
>>
>> On 5/12/2015 2:14 PM, Jose Blanco wrote:
>>
>> I'm testing my merged code from of 4.2 and 5.2 and I made a
>> user a
>> submitter to a collection and when I login as that user and
>> go to that
>> collection, the connection just spins.  This may be due to
>> something in
>> my merge, but any clues to where to check for this would be
>> good.
>>
>> I noticed the same thing happening when I restricted access
>> to a
>> bitstream and then just accessing the item, made the browser
>> just spin.
>> I could not get to the item.
>>
>> There must be a check going on somewhere that's just spinning.
>>
>> Thanks!
>> Jose
>>
>>
>>
>> --
>> One dashboard for servers and applications across
>> Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you
>> Actionable Insights
>> Deep dive visibility with transaction tracing using APM
>> Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>
>>
>>
>> ___
>> DSpace-tech ma

Re: [Dspace-tech] access to page spins

[Tim Donohue]

Hi Jose,

Are you saying that some of the accesses to Solr Stats work fine? While 
others are spinning? Is there any difference in the type of content that 
seems to cause Solr to spin (i.e. anything different about those Items 
in any way that you can tell)?

I'm just trying to see if it's possible to narrow down the issue. It 
sounds like it's not Solr overall (as some accesses work and some do 
not). But, then the question becomes what is different between those 
that work and those that do not.

Since this happened post-upgrade to 5.x, I'm assuming all the automatic 
upgrades to your Solr look to have succeeded? During the "ant update" 
process, your indexes should have been automatically upgraded to the 
latest Solr version (including the statistics index). Just wanted to 
make sure that whole process also went smoothly with regards to the Solr 
Statistics index.

- Tim

On 5/12/2015 3:46 PM, Jose Blanco wrote:
> TIm, from the tomcat area:
>
> This is from a good access:
>
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
> HTTP/1.1" 200 215
> 141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
> /solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
> HTTP/1.1" 200 272
> 141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
> /handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -
>
>
>
> This is from one that spins:
>
> 141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
> /solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
>
>
> On Tue, May 12, 2015 at 4:37 PM, Jose Blanco  > wrote:
>
> Tim, I think it may have to do with solr statistics. Is there a say
> to turn it off.
>
> Attached is part of the dspace log file created when the spinning
> takes place.
>
>
>
> On Tue, May 12, 2015 at 3:54 PM, Tim Donohue  > wrote:
>
> Hi Jose,
>
> You might want to check your logs (both DSpace and Tomcat logs)
> to see if there's anything going on there while the browser "spins".
>
> Otherwise, it's a bit hard to guess at what could cause the
> browser to hang. My best guess is that it's waiting on something
> that is running behind the scenes, but it's hard to tell what
> that "something" is (and I'm hoping maybe the logs would give
> you and us a hint).
>
> You also might want to test what scenarios cause the "spinning".
> Is it accessing *any* community/collection/item? Or, is it just
> some objects? Does it happen when logged in only? Or, also when
> accessing the site anonymously?
>
> - Tim
>
>
> On 5/12/2015 2:14 PM, Jose Blanco wrote:
>
> I'm testing my merged code from of 4.2 and 5.2 and I made a
> user a
> submitter to a collection and when I login as that user and
> go to that
> collection, the connection just spins.  This may be due to
> something in
> my merge, but any clues to where to check for this would be
> good.
>
> I noticed the same thing happening when I restricted access to a
> bitstream and then just accessing the item, made the browser
> just spin.
> I could not get to the item.
>
> There must be a check going on somewhere that's just spinning.
>
> Thanks!
> Jose
>
>
> 
> --
> One dashboard for servers and applications across
> Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you
> Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>
>
>
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> 
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
>
>

--
One dashboard for servers and applications across Physica

Re: [Dspace-tech] access to page spins

[Jose Blanco]

TIm, from the tomcat area:

This is from a good access:

141.213.232.243 - - [12/May/2015:16:44:32 -0400] "POST
/solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40
141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
/solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=0&wt=javabin&version=2
HTTP/1.1" 200 215
141.213.232.243 - - [12/May/2015:16:44:32 -0400] "GET
/solr/search/select?q=*%3A*&fq=NOT%28withdrawn%3Atrue%29&fq=NOT%28discoverable%3Afalse%29&fq=location%3Al814&fq=search.resourcetype%3A2&fq=read%3A%28g0+OR+g0+OR+g80+OR+g431+OR+g617%29&start=0&rows=20&sort=dc.date.accessioned_dt+desc&wt=javabin&version=2
HTTP/1.1" 200 272
141.211.43.157 - deepblue [12/May/2015:16:44:32 -0400] "GET
/handle/TEMP-BOGUS/214864 HTTP/1.1" 304 -



This is from one that spins:

141.213.232.243 - - [12/May/2015:16:45:33 -0400] "POST
/solr/statistics/update?wt=javabin&version=2 HTTP/1.1" 200 40


On Tue, May 12, 2015 at 4:37 PM, Jose Blanco  wrote:

> Tim, I think it may have to do with solr statistics. Is there a say to
> turn it off.
>
> Attached is part of the dspace log file created when the spinning takes
> place.
>
>
>
> On Tue, May 12, 2015 at 3:54 PM, Tim Donohue 
> wrote:
>
>> Hi Jose,
>>
>> You might want to check your logs (both DSpace and Tomcat logs) to see if
>> there's anything going on there while the browser "spins".
>>
>> Otherwise, it's a bit hard to guess at what could cause the browser to
>> hang. My best guess is that it's waiting on something that is running
>> behind the scenes, but it's hard to tell what that "something" is (and I'm
>> hoping maybe the logs would give you and us a hint).
>>
>> You also might want to test what scenarios cause the "spinning". Is it
>> accessing *any* community/collection/item? Or, is it just some objects?
>> Does it happen when logged in only? Or, also when accessing the site
>> anonymously?
>>
>> - Tim
>>
>>
>> On 5/12/2015 2:14 PM, Jose Blanco wrote:
>>
>>> I'm testing my merged code from of 4.2 and 5.2 and I made a user a
>>> submitter to a collection and when I login as that user and go to that
>>> collection, the connection just spins.  This may be due to something in
>>> my merge, but any clues to where to check for this would be good.
>>>
>>> I noticed the same thing happening when I restricted access to a
>>> bitstream and then just accessing the item, made the browser just spin.
>>> I could not get to the item.
>>>
>>> There must be a check going on somewhere that's just spinning.
>>>
>>> Thanks!
>>> Jose
>>>
>>>
>>>
>>> --
>>> One dashboard for servers and applications across Physical-Virtual-Cloud
>>> Widest out-of-the-box monitoring support with 50+ applications
>>> Performance metrics, stats and reports that give you Actionable Insights
>>> Deep dive visibility with transaction tracing using APM Insight.
>>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>>
>>>
>>>
>>> ___
>>> DSpace-tech mailing list
>>> DSpace-tech@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>> List Etiquette:
>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>
>>>
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] access to page spins

[Jose Blanco]

Tim, I think it may have to do with solr statistics. Is there a say to turn
it off.

Attached is part of the dspace log file created when the spinning takes
place.



On Tue, May 12, 2015 at 3:54 PM, Tim Donohue  wrote:

> Hi Jose,
>
> You might want to check your logs (both DSpace and Tomcat logs) to see if
> there's anything going on there while the browser "spins".
>
> Otherwise, it's a bit hard to guess at what could cause the browser to
> hang. My best guess is that it's waiting on something that is running
> behind the scenes, but it's hard to tell what that "something" is (and I'm
> hoping maybe the logs would give you and us a hint).
>
> You also might want to test what scenarios cause the "spinning". Is it
> accessing *any* community/collection/item? Or, is it just some objects?
> Does it happen when logged in only? Or, also when accessing the site
> anonymously?
>
> - Tim
>
>
> On 5/12/2015 2:14 PM, Jose Blanco wrote:
>
>> I'm testing my merged code from of 4.2 and 5.2 and I made a user a
>> submitter to a collection and when I login as that user and go to that
>> collection, the connection just spins.  This may be due to something in
>> my merge, but any clues to where to check for this would be good.
>>
>> I noticed the same thing happening when I restricted access to a
>> bitstream and then just accessing the item, made the browser just spin.
>> I could not get to the item.
>>
>> There must be a check going on somewhere that's just spinning.
>>
>> Thanks!
>> Jose
>>
>>
>>
>> --
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>
>>
>>
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
>>


spin_error.log
Description: Binary data
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] access to page spins

[Tim Donohue]

Hi Jose,

You might want to check your logs (both DSpace and Tomcat logs) to see 
if there's anything going on there while the browser "spins".

Otherwise, it's a bit hard to guess at what could cause the browser to 
hang. My best guess is that it's waiting on something that is running 
behind the scenes, but it's hard to tell what that "something" is (and 
I'm hoping maybe the logs would give you and us a hint).

You also might want to test what scenarios cause the "spinning". Is it 
accessing *any* community/collection/item? Or, is it just some objects? 
Does it happen when logged in only? Or, also when accessing the site 
anonymously?

- Tim

On 5/12/2015 2:14 PM, Jose Blanco wrote:
> I'm testing my merged code from of 4.2 and 5.2 and I made a user a
> submitter to a collection and when I login as that user and go to that
> collection, the connection just spins.  This may be due to something in
> my merge, but any clues to where to check for this would be good.
>
> I noticed the same thing happening when I restricted access to a
> bitstream and then just accessing the item, made the browser just spin.
> I could not get to the item.
>
> There must be a check going on somewhere that's just spinning.
>
> Thanks!
> Jose
>
>
> --
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>
>
>
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>

--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] access to page spins

[Jose Blanco]

I'm testing my merged code from of 4.2 and 5.2 and I made a user a
submitter to a collection and when I login as that user and go to that
collection, the connection just spins.  This may be due to something in my
merge, but any clues to where to check for this would be good.

I noticed the same thing happening when I restricted access to a bitstream
and then just accessing the item, made the browser just spin.  I could not
get to the item.

There must be a check going on somewhere that's just spinning.

Thanks!
Jose
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette