Review Request: Add CAS-PGE support for multiple Property Adders

[brian Foster]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4303/
---

Review request for oodt, Chris Mattmann and Paul Ramirez.


Summary
---

Will introduce the reserved metadata field: PGETask_PropertyAdders and 
deprecate: PGETask_PropertyAdderClasspath


This addresses bug OODT-406.
https://issues.apache.org/jira/browse/OODT-406


Diffs
-

  trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 1299921 
  
trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/XmlFilePgeConfigBuilder.java
 1299921 
  trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 
1299921 
  
trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskMetadataKeys.java
 1298742 
  trunk/pge/src/test/org/apache/oodt/cas/pge/MockConfigFilePropertyAdder.java 
PRE-CREATION 
  trunk/pge/src/test/org/apache/oodt/cas/pge/TestPGETaskInstance.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/4303/diff


Testing
---

Added unit-tests


Thanks,

brian

Re: Review Request: Add CAS-PGE support for multiple Property Adders

[Chris Mattmann]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4303/#review5867
---



trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java


Great work!



trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java


looks like just whitespace change, no biggie.



trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java


Interesting, is this extraneous or actually part of the patch?



trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java


Interesting -- did this fix a bug in case actionIds was null?



trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/XmlFilePgeConfigBuilder.java


extraneous?



trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskMetadataKeys.java


Nice, way to indicate this.


- Chris


On 2012-03-13 01:31:24, brian Foster wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/4303/
> ---
> 
> (Updated 2012-03-13 01:31:24)
> 
> 
> Review request for oodt, Chris Mattmann and Paul Ramirez.
> 
> 
> Summary
> ---
> 
> Will introduce the reserved metadata field: PGETask_PropertyAdders and 
> deprecate: PGETask_PropertyAdderClasspath
> 
> 
> This addresses bug OODT-406.
> https://issues.apache.org/jira/browse/OODT-406
> 
> 
> Diffs
> -
> 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 
> 1299921 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/XmlFilePgeConfigBuilder.java
>  1299921 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 
> 1299921 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskMetadataKeys.java
>  1298742 
>   trunk/pge/src/test/org/apache/oodt/cas/pge/MockConfigFilePropertyAdder.java 
> PRE-CREATION 
>   trunk/pge/src/test/org/apache/oodt/cas/pge/TestPGETaskInstance.java 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/4303/diff
> 
> 
> Testing
> ---
> 
> Added unit-tests
> 
> 
> Thanks,
> 
> brian
> 
>

Re: Review Request: Port wengine ControlMetadata to cas-pge's PgeMetadata

[brian Foster]

> On 2012-03-10 17:49:33, Chris Mattmann wrote:
> > trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java, line 
> > 453
> > 
> >
> > Why not commit all keys -- or, maybe I am reading this wrong?

if you don't specify any args then all the marked keys will be committed, 
however you can provide a list of the mark keys which you would like to commit 
if so desired.


> On 2012-03-10 17:49:33, Chris Mattmann wrote:
> > trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java, 
> > line 48
> > 
> >
> > Is this a change in the prior behavior?

currently if you point a link key to a dynamic key and then try to change the 
link key's value, the dynamic metadata value remains unchanged and the link key 
is unlinked and readded as a key in the local metadata?... i can see how this 
new behavior of it now actually changing the dynamic key's value can be 
dangerous though if someone is not aware of it... i can change it back if you 
really think it is better to only have the one way which is marking the local 
or link key as dynamic then committing it.


- brian


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4269/#review5819
---


On 2012-03-10 01:32:07, brian Foster wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/4269/
> ---
> 
> (Updated 2012-03-10 01:32:07)
> 
> 
> Review request for oodt, Chris Mattmann and Paul Ramirez.
> 
> 
> Summary
> ---
> 
> Updates CAS-PGE's PgeMetadata to work similar to WEngine's ControlMetadata
> 
> 
> This addresses bug OODT-403.
> https://issues.apache.org/jira/browse/OODT-403
> 
> 
> Diffs
> -
> 
>   trunk/pge/pom.xml 1298742 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 
> 1298742 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/XmlFilePgeConfigBuilder.java
>  1298742 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 
> 1298742 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/PcsMetFileWriter.java 
> 1298742 
>   trunk/pge/src/test/org/apache/oodt/cas/pge/metadata/TestPgeMetadata.java 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/4269/diff
> 
> 
> Testing
> ---
> 
> added unit-test
> 
> 
> Thanks,
> 
> brian
> 
>

Re: Review Request: Port wengine ControlMetadata to cas-pge's PgeMetadata

[Paul Ramirez]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4269/#review5850
---

Ship it!


Love the varargs!

- Paul


On 2012-03-10 01:32:07, brian Foster wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/4269/
> ---
> 
> (Updated 2012-03-10 01:32:07)
> 
> 
> Review request for oodt, Chris Mattmann and Paul Ramirez.
> 
> 
> Summary
> ---
> 
> Updates CAS-PGE's PgeMetadata to work similar to WEngine's ControlMetadata
> 
> 
> This addresses bug OODT-403.
> https://issues.apache.org/jira/browse/OODT-403
> 
> 
> Diffs
> -
> 
>   trunk/pge/pom.xml 1298742 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 
> 1298742 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/XmlFilePgeConfigBuilder.java
>  1298742 
>   trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 
> 1298742 
>   
> trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/PcsMetFileWriter.java 
> 1298742 
>   trunk/pge/src/test/org/apache/oodt/cas/pge/metadata/TestPgeMetadata.java 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/4269/diff
> 
> 
> Testing
> ---
> 
> added unit-test
> 
> 
> Thanks,
> 
> brian
> 
>

Re: Filemgr query not returning list of values

[Ramirez, Paul M (388J)]

Hey Guys,

Just to let you know I believe the issue has been addressed in a fix that is 
currently under review and I'll commit later tonight.

--Paul


On Mar 12, 2012, at 7:33 AM, Sheryl John wrote:

> Hi Tom,
> 
> Thanks for looking into this. I just commented about the options I was
> using in OODT-404 in reply to Brian's question.
> 
> 
> 
> 
> 
> On Mon, Mar 12, 2012 at 6:05 AM, Thomas Bennett  wrote:
> 
>> Hey Paul,
>> 
>> Thanks for the reply.
>> 
>> What backend are you using for the catalog?
>> 
>> 
>> Lucene
>> 
>> 
>>> I just committed a unit test to show a round trip ingestion via the file
>>> manager client.
>> 
>> 
>> Thanks. I'll take a look at the test.
>> 
>> 
>>> This had multivalued metadata and stored and returned just fine. As Chris
>>> mentioned my next step is going to be to look into the new CLI stuff.
>>> 
>> 
>> Hmmm. Bazaar. I'll recheck what I've seen and get back to you with more
>> details ;)
>> 
>> Cheers,
>> Tom
>> 
>> 
>> 
>> 
>>> 
>>> --Paul
>>> 
>>> Sent from my iPhone
>>> 
>>> On Mar 12, 2012, at 1:28 AM, "Thomas Bennett" 
>> wrote:
>>> 
 Hi,
 
 Sorry... I realise I forgot to add some more to this email before I
>> sent
>>> it
 ;-)
 
 From what I can see the problem is on the File Manager side. I've
>>> captured
 the XML-RPC methodResponse to an ingestProduct methodCall and there
 are defiantly only single values in the reply...
 
 I'll dig a bit further and keep you guys posted.
 
 Cheers,
 Tom
 
 On 12 March 2012 05:56, Mattmann, Chris A (388J) <
 chris.a.mattm...@jpl.nasa.gov> wrote:
 
> Hey Tom,
> 
> OK, I'll take a look at this with Paul R. too...
> 
> Cheers,
> Chris
> 
> On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
> 
>> Hey Sheryl,
>> 
>> Just to let you know that I've also experienced exactly the same
>>> problem.
>> 
>> Cheers,
>> Tom
>> 
>> Sent from my iPhone
>> 
>> On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
>> 
>>> Hi,
>>> 
>>> I'm working with 0.4-SNAPSHOT( not latest build) and when querying
>> the
>>> Filemanager on a multivalue key, it's not returning the expected
>> list
>>> of
>>> values but it returned only the first value. I tested the query on
>> the
>>> filemgr-client and the query-tool and both returns only the first
>>> value.
>>> 
>>> I checked the filemgr catalog using the lucene luke tool and I can
>> see
> all
>>> the expected values for that key, so the key does have more than one
>>> metadata value. I tried the same query on 0.3v and that returns the
>>> concatenated list of values for the key.
>>> 
>>> Have I missed out something or did anyone else come across this
>> before
> with
>>> the 0.4-SNAPSHOT? I didn't check the code yet..
>>> 
>>> Thanks
>>> Sheryl
> 
> 
> ++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++
> 
> 
>>> 
>> 
> 
> 
> 
> -- 
> -Sheryl

Apache Airvata GSoC 2012

[Mattmann, Chris A (388J)]

Hey Guys,

The Apache Airavata community posted 2 GSoC 2012 issues for students
to help integrate OODT and Airavata, see here:

https://issues.apache.org/jira/browse/AIRAVATA-52

and its sub-issue.

Comments, thoughts, and mentorship welcome! :)

Cheers,
Chris

++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattm...@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++

Re: [ANNOUNCE] Welcome Bruce Barkstrom as Apache OODT PMC member + committer

[Sheryl John]

Welcome aboard Sir!
We're glad to have you on the team. :)

On Mon, Mar 12, 2012 at 10:37 AM, Bruce Barkstrom wrote:

> OK - I'm a retired civil servant with about 25 years with NASA and 2 with
> NOAA.
> I was effectively PI for NASA's Earth Radiation Budget Experiment (ERBE)
> that
> measured the reflected sunlight and emitted terrestrial flux, determining
> that
> clouds cool the current climate.  I did the system architecture for
> the data production
> system that eventually had about 1/4 million lines of FORTRAN.  After
> ten years of
> that activity, including leading a science team with about twenty
> major Co-I's, I became
> a PI (with Bruce Wielicki) on the NASA EOS investigation of Clouds and
> the Earth's
> Radiant Energy System (CERES).  The team was about the same size as ERBE's,
> but the code (for which I was again the system architect) ran to about
> 2/3 million
> SLOC.  I spent five years as Head of the LaRC Atmospheric Sciences Data
> Center
> and had participated in all of the major design reviews for the Earth
> Observing System
> Data and Information System (EOSDIS).  At NOAA's National Climatic Data
> Center
> (NCDC), I became the Data Stewardship Project Manager for a couple of
> years.
> Since retiring from the federal government, I've participated heavily
> in the Earth Science
> Information Partner (ESIP) Federation's Working Group on Data Preservation
> (and
> related topics).  That's probably more than enough about me.
>
> Bruce B.
>
> On Mon, Mar 12, 2012 at 11:23 AM, Mattmann, Chris A (388J)
>  wrote:
> > Hi All,
> >
> > We just elected to add Bruce Barkstrom to our ranks as an Apache OODT
> PMC member and committer.
> > Welcome Bruce! Feel free to say a bit about yourself.
> >
> > Cheers,
> > Chris
> >
> > ++
> > Chris Mattmann, Ph.D.
> > Senior Computer Scientist
> > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> > Office: 171-266B, Mailstop: 171-246
> > Email: chris.a.mattm...@nasa.gov
> > WWW:   http://sunset.usc.edu/~mattmann/
> > ++
> > Adjunct Assistant Professor, Computer Science Department
> > University of Southern California, Los Angeles, CA 90089 USA
> > ++
> >
>



-- 
-Sheryl

Re: [ANNOUNCE] Welcome Bruce Barkstrom as Apache OODT PMC member + committer

[Bruce Barkstrom]

OK - I'm a retired civil servant with about 25 years with NASA and 2 with NOAA.
I was effectively PI for NASA's Earth Radiation Budget Experiment (ERBE) that
measured the reflected sunlight and emitted terrestrial flux, determining that
clouds cool the current climate.  I did the system architecture for
the data production
system that eventually had about 1/4 million lines of FORTRAN.  After
ten years of
that activity, including leading a science team with about twenty
major Co-I's, I became
a PI (with Bruce Wielicki) on the NASA EOS investigation of Clouds and
the Earth's
Radiant Energy System (CERES).  The team was about the same size as ERBE's,
but the code (for which I was again the system architect) ran to about
2/3 million
SLOC.  I spent five years as Head of the LaRC Atmospheric Sciences Data Center
and had participated in all of the major design reviews for the Earth
Observing System
Data and Information System (EOSDIS).  At NOAA's National Climatic Data Center
(NCDC), I became the Data Stewardship Project Manager for a couple of years.
Since retiring from the federal government, I've participated heavily
in the Earth Science
Information Partner (ESIP) Federation's Working Group on Data Preservation (and
related topics).  That's probably more than enough about me.

Bruce B.

On Mon, Mar 12, 2012 at 11:23 AM, Mattmann, Chris A (388J)
 wrote:
> Hi All,
>
> We just elected to add Bruce Barkstrom to our ranks as an Apache OODT PMC 
> member and committer.
> Welcome Bruce! Feel free to say a bit about yourself.
>
> Cheers,
> Chris
>
> ++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++
>

[ANNOUNCE] Welcome Bruce Barkstrom as Apache OODT PMC member + committer

[Mattmann, Chris A (388J)]

Hi All,

We just elected to add Bruce Barkstrom to our ranks as an Apache OODT PMC 
member and committer. 
Welcome Bruce! Feel free to say a bit about yourself.

Cheers,
Chris

++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattm...@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++

Re: Filemgr query not returning list of values

[Sheryl John]

Hi Tom,

Thanks for looking into this. I just commented about the options I was
using in OODT-404 in reply to Brian's question.





On Mon, Mar 12, 2012 at 6:05 AM, Thomas Bennett  wrote:

> Hey Paul,
>
> Thanks for the reply.
>
> What backend are you using for the catalog?
>
>
> Lucene
>
>
> > I just committed a unit test to show a round trip ingestion via the file
> > manager client.
>
>
> Thanks. I'll take a look at the test.
>
>
> > This had multivalued metadata and stored and returned just fine. As Chris
> > mentioned my next step is going to be to look into the new CLI stuff.
> >
>
> Hmmm. Bazaar. I'll recheck what I've seen and get back to you with more
> details ;)
>
> Cheers,
> Tom
>
>
>
>
> >
> > --Paul
> >
> > Sent from my iPhone
> >
> > On Mar 12, 2012, at 1:28 AM, "Thomas Bennett" 
> wrote:
> >
> > > Hi,
> > >
> > > Sorry... I realise I forgot to add some more to this email before I
> sent
> > it
> > > ;-)
> > >
> > > From what I can see the problem is on the File Manager side. I've
> > captured
> > > the XML-RPC methodResponse to an ingestProduct methodCall and there
> > > are defiantly only single values in the reply...
> > >
> > > I'll dig a bit further and keep you guys posted.
> > >
> > > Cheers,
> > > Tom
> > >
> > > On 12 March 2012 05:56, Mattmann, Chris A (388J) <
> > > chris.a.mattm...@jpl.nasa.gov> wrote:
> > >
> > >> Hey Tom,
> > >>
> > >> OK, I'll take a look at this with Paul R. too...
> > >>
> > >> Cheers,
> > >> Chris
> > >>
> > >> On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
> > >>
> > >>> Hey Sheryl,
> > >>>
> > >>> Just to let you know that I've also experienced exactly the same
> > problem.
> > >>>
> > >>> Cheers,
> > >>> Tom
> > >>>
> > >>> Sent from my iPhone
> > >>>
> > >>> On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
> > >>>
> >  Hi,
> > 
> >  I'm working with 0.4-SNAPSHOT( not latest build) and when querying
> the
> >  Filemanager on a multivalue key, it's not returning the expected
> list
> > of
> >  values but it returned only the first value. I tested the query on
> the
> >  filemgr-client and the query-tool and both returns only the first
> > value.
> > 
> >  I checked the filemgr catalog using the lucene luke tool and I can
> see
> > >> all
> >  the expected values for that key, so the key does have more than one
> >  metadata value. I tried the same query on 0.3v and that returns the
> >  concatenated list of values for the key.
> > 
> >  Have I missed out something or did anyone else come across this
> before
> > >> with
> >  the 0.4-SNAPSHOT? I didn't check the code yet..
> > 
> >  Thanks
> >  Sheryl
> > >>
> > >>
> > >> ++
> > >> Chris Mattmann, Ph.D.
> > >> Senior Computer Scientist
> > >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> > >> Office: 171-266B, Mailstop: 171-246
> > >> Email: chris.a.mattm...@nasa.gov
> > >> WWW:   http://sunset.usc.edu/~mattmann/
> > >> ++
> > >> Adjunct Assistant Professor, Computer Science Department
> > >> University of Southern California, Los Angeles, CA 90089 USA
> > >> ++
> > >>
> > >>
> >
>



-- 
-Sheryl

Re: Filemgr query not returning list of values

[Ramirez, Paul M (388J)]

Hey Tom,

Actually according to OODT-404 Brian Foster created a test for the new CLI 
stuff that passes so the issue is probably down the QueryTool chain of stuff. 
Can you comment on what you are calling from the command line and your 
environment on that issue https://issues.apache.org/jira/browse/OODT-404.

Thanks,
Paul

On Mar 12, 2012, at 6:05 AM, Thomas Bennett wrote:

> Hey Paul,
> 
> Thanks for the reply.
> 
> What backend are you using for the catalog?
> 
> 
> Lucene
> 
> 
>> I just committed a unit test to show a round trip ingestion via the file
>> manager client.
> 
> 
> Thanks. I'll take a look at the test.
> 
> 
>> This had multivalued metadata and stored and returned just fine. As Chris
>> mentioned my next step is going to be to look into the new CLI stuff.
>> 
> 
> Hmmm. Bazaar. I'll recheck what I've seen and get back to you with more
> details ;)
> 
> Cheers,
> Tom
> 
> 
> 
> 
>> 
>> --Paul
>> 
>> Sent from my iPhone
>> 
>> On Mar 12, 2012, at 1:28 AM, "Thomas Bennett"  wrote:
>> 
>>> Hi,
>>> 
>>> Sorry... I realise I forgot to add some more to this email before I sent
>> it
>>> ;-)
>>> 
>>> From what I can see the problem is on the File Manager side. I've
>> captured
>>> the XML-RPC methodResponse to an ingestProduct methodCall and there
>>> are defiantly only single values in the reply...
>>> 
>>> I'll dig a bit further and keep you guys posted.
>>> 
>>> Cheers,
>>> Tom
>>> 
>>> On 12 March 2012 05:56, Mattmann, Chris A (388J) <
>>> chris.a.mattm...@jpl.nasa.gov> wrote:
>>> 
 Hey Tom,
 
 OK, I'll take a look at this with Paul R. too...
 
 Cheers,
 Chris
 
 On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
 
> Hey Sheryl,
> 
> Just to let you know that I've also experienced exactly the same
>> problem.
> 
> Cheers,
> Tom
> 
> Sent from my iPhone
> 
> On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
> 
>> Hi,
>> 
>> I'm working with 0.4-SNAPSHOT( not latest build) and when querying the
>> Filemanager on a multivalue key, it's not returning the expected list
>> of
>> values but it returned only the first value. I tested the query on the
>> filemgr-client and the query-tool and both returns only the first
>> value.
>> 
>> I checked the filemgr catalog using the lucene luke tool and I can see
 all
>> the expected values for that key, so the key does have more than one
>> metadata value. I tried the same query on 0.3v and that returns the
>> concatenated list of values for the key.
>> 
>> Have I missed out something or did anyone else come across this before
 with
>> the 0.4-SNAPSHOT? I didn't check the code yet..
>> 
>> Thanks
>> Sheryl
 
 
 ++
 Chris Mattmann, Ph.D.
 Senior Computer Scientist
 NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
 Office: 171-266B, Mailstop: 171-246
 Email: chris.a.mattm...@nasa.gov
 WWW:   http://sunset.usc.edu/~mattmann/
 ++
 Adjunct Assistant Professor, Computer Science Department
 University of Southern California, Los Angeles, CA 90089 USA
 ++
 
 
>> 

Re: Filemgr query not returning list of values

[Thomas Bennett]

Hey Paul,

Thanks for the reply.

What backend are you using for the catalog?


Lucene


> I just committed a unit test to show a round trip ingestion via the file
> manager client.


Thanks. I'll take a look at the test.


> This had multivalued metadata and stored and returned just fine. As Chris
> mentioned my next step is going to be to look into the new CLI stuff.
>

Hmmm. Bazaar. I'll recheck what I've seen and get back to you with more
details ;)

Cheers,
Tom




>
> --Paul
>
> Sent from my iPhone
>
> On Mar 12, 2012, at 1:28 AM, "Thomas Bennett"  wrote:
>
> > Hi,
> >
> > Sorry... I realise I forgot to add some more to this email before I sent
> it
> > ;-)
> >
> > From what I can see the problem is on the File Manager side. I've
> captured
> > the XML-RPC methodResponse to an ingestProduct methodCall and there
> > are defiantly only single values in the reply...
> >
> > I'll dig a bit further and keep you guys posted.
> >
> > Cheers,
> > Tom
> >
> > On 12 March 2012 05:56, Mattmann, Chris A (388J) <
> > chris.a.mattm...@jpl.nasa.gov> wrote:
> >
> >> Hey Tom,
> >>
> >> OK, I'll take a look at this with Paul R. too...
> >>
> >> Cheers,
> >> Chris
> >>
> >> On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
> >>
> >>> Hey Sheryl,
> >>>
> >>> Just to let you know that I've also experienced exactly the same
> problem.
> >>>
> >>> Cheers,
> >>> Tom
> >>>
> >>> Sent from my iPhone
> >>>
> >>> On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
> >>>
>  Hi,
> 
>  I'm working with 0.4-SNAPSHOT( not latest build) and when querying the
>  Filemanager on a multivalue key, it's not returning the expected list
> of
>  values but it returned only the first value. I tested the query on the
>  filemgr-client and the query-tool and both returns only the first
> value.
> 
>  I checked the filemgr catalog using the lucene luke tool and I can see
> >> all
>  the expected values for that key, so the key does have more than one
>  metadata value. I tried the same query on 0.3v and that returns the
>  concatenated list of values for the key.
> 
>  Have I missed out something or did anyone else come across this before
> >> with
>  the 0.4-SNAPSHOT? I didn't check the code yet..
> 
>  Thanks
>  Sheryl
> >>
> >>
> >> ++
> >> Chris Mattmann, Ph.D.
> >> Senior Computer Scientist
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 171-266B, Mailstop: 171-246
> >> Email: chris.a.mattm...@nasa.gov
> >> WWW:   http://sunset.usc.edu/~mattmann/
> >> ++
> >> Adjunct Assistant Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++
> >>
> >>
>

Re: Filemgr query not returning list of values

[Ramirez, Paul M (388J)]

Hey Tom,

What backend are you using for the catalog? I just committed a unit test to 
show a round trip ingestion via the file manager client. This had multivalued 
metadata and stored and returned just fine. As Chris mentioned my next step is 
going to be to look into the new CLI stuff. 

--Paul

Sent from my iPhone

On Mar 12, 2012, at 1:28 AM, "Thomas Bennett"  wrote:

> Hi,
> 
> Sorry... I realise I forgot to add some more to this email before I sent it
> ;-)
> 
> From what I can see the problem is on the File Manager side. I've captured
> the XML-RPC methodResponse to an ingestProduct methodCall and there
> are defiantly only single values in the reply...
> 
> I'll dig a bit further and keep you guys posted.
> 
> Cheers,
> Tom
> 
> On 12 March 2012 05:56, Mattmann, Chris A (388J) <
> chris.a.mattm...@jpl.nasa.gov> wrote:
> 
>> Hey Tom,
>> 
>> OK, I'll take a look at this with Paul R. too...
>> 
>> Cheers,
>> Chris
>> 
>> On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
>> 
>>> Hey Sheryl,
>>> 
>>> Just to let you know that I've also experienced exactly the same problem.
>>> 
>>> Cheers,
>>> Tom
>>> 
>>> Sent from my iPhone
>>> 
>>> On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
>>> 
 Hi,
 
 I'm working with 0.4-SNAPSHOT( not latest build) and when querying the
 Filemanager on a multivalue key, it's not returning the expected list of
 values but it returned only the first value. I tested the query on the
 filemgr-client and the query-tool and both returns only the first value.
 
 I checked the filemgr catalog using the lucene luke tool and I can see
>> all
 the expected values for that key, so the key does have more than one
 metadata value. I tried the same query on 0.3v and that returns the
 concatenated list of values for the key.
 
 Have I missed out something or did anyone else come across this before
>> with
 the 0.4-SNAPSHOT? I didn't check the code yet..
 
 Thanks
 Sheryl
>> 
>> 
>> ++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattm...@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++
>> 
>> 

Re: Filemgr query not returning list of values

[Thomas Bennett]

Hi,

Sorry... I realise I forgot to add some more to this email before I sent it
;-)

>From what I can see the problem is on the File Manager side. I've captured
the XML-RPC methodResponse to an ingestProduct methodCall and there
are defiantly only single values in the reply...

I'll dig a bit further and keep you guys posted.

Cheers,
Tom

On 12 March 2012 05:56, Mattmann, Chris A (388J) <
chris.a.mattm...@jpl.nasa.gov> wrote:

> Hey Tom,
>
> OK, I'll take a look at this with Paul R. too...
>
> Cheers,
> Chris
>
> On Mar 9, 2012, at 9:16 PM, Thomas Bennett wrote:
>
> > Hey Sheryl,
> >
> > Just to let you know that I've also experienced exactly the same problem.
> >
> > Cheers,
> > Tom
> >
> > Sent from my iPhone
> >
> > On 10 Mar 2012, at 1:37 AM, Sheryl John  wrote:
> >
> >> Hi,
> >>
> >> I'm working with 0.4-SNAPSHOT( not latest build) and when querying the
> >> Filemanager on a multivalue key, it's not returning the expected list of
> >> values but it returned only the first value. I tested the query on the
> >> filemgr-client and the query-tool and both returns only the first value.
> >>
> >> I checked the filemgr catalog using the lucene luke tool and I can see
> all
> >> the expected values for that key, so the key does have more than one
> >> metadata value. I tried the same query on 0.3v and that returns the
> >> concatenated list of values for the key.
> >>
> >> Have I missed out something or did anyone else come across this before
> with
> >> the 0.4-SNAPSHOT? I didn't check the code yet..
> >>
> >> Thanks
> >> Sheryl
>
>
> ++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++
>
>