Re: [Dspace-tech] R: R: Mirage 2

2015-02-02 Thread Andrea Schweer
Hi Hilton,

On 02/02/15 20:47, Hilton Gibson wrote:
 I have tested again and it seems DSpace 5.X with Mirage 2 only works 
 on Ubuntu 14.04 LTS.

I've compiled it successfully on RHEL6.6, so this is very definitely not 
true.

cheers,
Andrea

-- 
Dr Andrea Schweer
IRR Technical Specialist, ITS Information Systems
The University of Waikato, Hamilton, New Zealand
+64-7-838 4466 ext. 6972


--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] R: R: Mirage 2

2015-02-02 Thread Andrea Schweer

  
  
Hi Sean,

On 02/02/15 19:19, Sean Carte wrote:


  

  On 2 February 2015 at 06:31, Andrea
Schweer schw...@waikato.ac.nz
wrote:

On 31/01/15 00:19, Sean Carte wrote:

  For what it's worth, I've got the same error and I'm
  running mvn as the dspace user.
  
  I suspect the problem is due to the firewall here.
  Following Andrea's suggestion of changing git to use
  https did allow maven to download more things, but
  still not enough.


  
  Are you getting any error messages during the maven build
  step? If not, is there a way you might be able to get a
  list of denied outgoing access attempts from your
  firewall? I'm assuming you're allowing outgoing https
  access to github and maven central / wherever else you're
  getting your maven artifacts from.
  
  

Unfortunately it's the institutional
  firewall and I don't have access to those logs. The other
  themes work, just not Mirage 2.
  

Rerunning mvn with a close eye on the
  output, this doesn't look too healthy:
  

[INFO] bower
  datatables#1.10.3  
  ECMDERR Failed to execute "git ls-remote --tags --heads git://github.com/DataTables/DataTables.git",
  exit code of #128

  


Did you run the git config change that I put on the wiki? This is
the exact error message I got, and forcing git to use https rather
than the git protocol fixed the problem for me (also a firewall
issue).

git config --global url."https://github.com/".insteadOf
git://github.com/
see
https://wiki.duraspace.org/display/DSDOC5x/Mirage+2+Configuration+and+Customization#Mirage2ConfigurationandCustomization-CommonBuildIssues

cheers,
Andrea

-- 
Dr Andrea Schweer
IRR Technical Specialist, ITS Information Systems
The University of Waikato, Hamilton, New Zealand
  


--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] R: R: Mirage 2

2015-02-02 Thread Hilton Gibson
Hi Andrea

Thats great to hear.
I am strictly an Ubuntu/Debian person.
See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Open_System
And: http://wiki.lib.sun.ac.za/index.php/SUNScholar/DSpace/Why_Ubuntu_Server

I hope you do, as I do, believe in freedom of choice in the very important
matter of preserving the digital scholarly record.
The more open the system used, the better I feel.

Therefore my reply was in the context of using Ubuntu, for which I feel
qualified.
If I had also tested on Redhat, I would have said the same, if the results
demanded it.
Hopefully in the future, the community will endorse a reference
architecture for each release of DSpace.
See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Reference_Architecture

Cheers

hg


*Hilton Gibson*
Ubuntu Linux Systems Administrator
JS Gericke Library
Room 1025C
Stellenbosch University
Private Bag X5036
Stellenbosch
7599
South Africa

Tel: +27 21 808 4100 | Cell: +27 84 646 4758

On 2 February 2015 at 22:38, Andrea Schweer schw...@waikato.ac.nz wrote:

 Hi Hilton,

 On 02/02/15 20:47, Hilton Gibson wrote:

 I have tested again and it seems DSpace 5.X with Mirage 2 only works on
 Ubuntu 14.04 LTS.


 I've compiled it successfully on RHEL6.6, so this is very definitely not
 true.

 cheers,
 Andrea

 --
 Dr Andrea Schweer
 IRR Technical Specialist, ITS Information Systems
 The University of Waikato, Hamilton, New Zealand
 +64-7-838 4466 ext. 6972


--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Migrate statistics

2015-02-02 Thread Steven Hayles

If your statistics are using Solr, there will be a dspace/solr/statistics 
folder.

I had to bring statistics from version 1.8.3 to 4.2.

I optimised under 1.8.3 and then 4.2, but found that the old records were 
missing uid, _version_ and statistics_type fields. I ended up copying all 
the records and deleting the originals. I don't know whether that was a 
sensible solution, but it seemed to work.

I ran the following (sorry, it's Python) to talk to Solr under 4.2. The 
debug was in there to allow investigation if anything unexpected happened 
(it didn't).

#! /usr/bin/python

import urllib2
import json
import pdb

BATCH_SIZE=1
REQ_URL='http://127.0.0.1:8080/solr/statistics/select?q=*:*+AND+-uid:[*%%20TO%%20*]wt=jsonindent=truerows=%dstart=%d'
UPDATE_URL='http://localhost:8080/solr/statistics/update'

start = 0

query_res = urllib2.urlopen(REQ_URL%(BATCH_SIZE,start))
if query_res.getcode() != 200:
 pdb.set_trace()
doc_list = json.load(query_res)['response']['docs']
while doc_list:
 start += BATCH_SIZE
 update_req = 
urllib2.Request(UPDATE_URL,json.dumps(doc_list),{'Content-type':'application/json'})
 update_res = urllib2.urlopen(update_req)
 if update_res.getcode() != 200:
 pdb.set_trace()
 print Added %d % start
 query_res = urllib2.urlopen(REQ_URL%(BATCH_SIZE,start))
 if query_res.getcode() != 200:
 pdb.set_trace()
 doc_list = json.load(query_res)['response']['docs']

# If the above goes OK, we can delete everything without a uid field
update_req = urllib2.Request(UPDATE_URL,'{delete:{query:-uid:[* TO 
*]}}',{'Content-type':'application/json'})
update_res = urllib2.urlopen(update_req)
if update_res.getcode() != 200:
 pdb.set_trace()

commit_res = urllib2.urlopen(UPDATE_URL+'?commit=true')
if commit_res.getcode() != 200:
 pdb.set_trace()


Steven Hayles
Systems Analyst

IT Services, University of Leicester,
Propsect House, 94 Regent Rd, Leicester, LE1 7DA, UK

T: +44 (0)116 229 7950
E: s...@le.ac.uk

The Queen's Anniversary Prizes 1994, 2002  2013
THE Awards Winners 2007-2013

Elite without being elitist

Follow us on Twitter http://twitter.com/uniofleicester or
visit our Facebook page https://facebook.com/UniofLeicester


 On 1 February 2015 at 14:43, . . alsap...@hotmail.es wrote:

 Hello, we DSpace version 1.6 running (we do not have installed). We have
 made the upgrade to version 4.2 andand works correctly).

 Now, we want to migrate to statistics from the old version 1.6 to 4.2. I
 think in 1.6 statistics run through solr. How can I check? And if so, how
 would the migration?

 regards

--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] HANDLE table entries without resource_id

2015-02-02 Thread Monika C. Mevenkamp
the query

SELECT HANDLE_ID, RESOURCE_TYPE_ID, RESOURCE_ID, HANDLE  FROM HANDLE WHERE 
RESOURCE_ID  IS NULL;

finds a couple entries

Is there a reason why I should not delete them ?

Monika


Monika Mevenkamp
phone: 609-258-4161
693 Alexander Road, Princeton University, Princeton, NJ 08544


--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Encryption, APIs in DSpace

2015-02-02 Thread Vikram .
Hi,
I am studying DSpace for management of Documents in project i am working on, 
one of the requirements is that the metadata and documents should be encrypted 
while being stored in DSpace.   
   - Is it possible to encrypt the documents and metadata in DSpace?   

   - If so, is it possible to run searches against the encrypted metadata and 
documents?
   - I am thinking of having an web application doing the role based access 
control between the user and DSpace. The user's interaction will be with the 
application which will connect to DSpace via one of it's APIs. I would be 
grateful if the learned members of this mailing could suggestion which 
Framework (J2EE/.Net etc) would be easier to work with in such a scenario.
Any links to tutorials or other documents to get me started with DSpace would 
be of great help too, as i am completely new at this.
Thank you :)
Vikram

--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] R: R: Mirage 2

2015-02-02 Thread Sean Carte
On 2 February 2015 at 22:40, Andrea Schweer schw...@waikato.ac.nz wrote:


 On 2 February 2015 at 06:31, Andrea Schweer schw...@waikato.ac.nz wrote:


 On 31/01/15 00:19, Sean Carte wrote:

 For what it's worth, I've got the same error and I'm running mvn as the
 dspace user.

 I suspect the problem is due to the firewall here.* Following Andrea's
 suggestion of changing git to use https did allow maven to download more
 things, but still not enough.*


  Are you getting any error messages during the maven build step? If not,
 is there a way you might be able to get a list of denied outgoing access
 attempts from your firewall? I'm assuming you're allowing outgoing https
 access to github and maven central / wherever else you're getting your
 maven artifacts from.


  Unfortunately it's the institutional firewall and I don't have access to
 those logs. The other themes work, just not Mirage 2.

  Rerunning mvn with a close eye on the output, this doesn't look too
 healthy:

  [INFO] bower
 datatables#1.10.3   ECMDERR
 Failed to execute git ls-remote --tags --heads git://
 github.com/DataTables/DataTables.git, exit code of #128


 Did you run the git config change that I put on the wiki? This is the
 exact error message I got, and forcing git to use https rather than the git
 protocol fixed the problem for me (also a firewall issue).

 git config --global url.https://github.com/; https://github.com/.insteadOf
 git://github.com/
 see
 https://wiki.duraspace.org/display/DSDOC5x/Mirage+2+Configuration+and+Customization#Mirage2ConfigurationandCustomization-CommonBuildIssues


Hi Andrea

Yes, I did (see above). I'll try again with a fresh download and see if
that makes any difference.

Meanwhile, someone replied to me off-list and sent me the missing files:
the
/dspace-xmlui-mirage2/src/main/webapp/vendor directory. Dropping that into
dspace-src did resolve the issue.

Sean
--
--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] R: R: Mirage 2

2015-02-02 Thread Sean Carte
On 3 February 2015 at 07:23, Sean Carte sean.ca...@gmail.com wrote:


 Yes, I did (see above). I'll try again with a fresh download and see if
 that makes any difference.


Well, it seems the problem is me. (Was there ever any doubt?) I had changed
the git config, but I did it as root instead of dspace, so that had no
effect on the mvn build process. I ran the git config command as the dspace
user and was able to build Mirage 2 without errors.

git config --global url.https://github.com/; https://github.com/.insteadOf
git://github.com/

Thank you, Andrea and all who tried to help me. And sorry to Massimiliano
for hijacking your thread. I hope you were able to resolve your problem!

Sean
--
--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette