Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-10-03 Thread Nan Galbraith
Things are hard to predict, especially in the future. :-) I agree with your position on groups (as well as on predictions) , but this discussion has also made me think that, to the extent that the proponents are advocating for a richer structure for attributes, that's something we should

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-10-01 Thread john caron
On 9/19/2013 3:58 PM, Schultz, Martin wrote: Now, here is another use case, which we haven't implemented yet - partly because we didn't see how it can be done in a CF consistent way: While there has been a definition of a standard file layout for data from multiple stations (a contribution

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-10-01 Thread john caron
Hi all: A few thoughts from my (possibly limited) POV. 1. Best strategy for storing very large collections of data in flat files like netcdf? - store coherent chunks of the dataset in each file. Seems like a good file size these days is 100M - 1 Gbyte. - choose coherence by deciding on the

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-29 Thread Charlie Zender
Hi Steve, Thank you for your continued engagement and responses. Looks like CF hasn't the appetite for group hierarchies anytime soon. I'll report the lessons learned in this fruitful discussion to our NASA WG next week. My concluding (for now) remarks are interleaved. Best, Charlie Le

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-26 Thread Jim Biard
Hi. I am currently building netCDF-4 files that use groups. I'd love it if CF were modified such that these files would be mostly compliant (which would require nothing more than acceptance of groups and hierarchical inheritance of 'file-level' attributes). I am well aware that my use case

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-25 Thread Steve Hankin
On 9/24/2013 9:45 PM, Charlie Zender wrote: It is not my place to determine whether there is a consensus, or how close we are, but it's clear to me there is no consensus yet. Bryan Lawrence, Steve Hankin, Jonathan Gregory, Karl Taylor, and Philip Cameron-Smith are not on board. I hope they

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-25 Thread Cameron-smith, Philip
Hi All, I think Steve's email (below) is a fair summary of how I see the current state of the discussion too. In order to move the discussion forward, I have put forward below a simple strawman suggestion that is very limited, but which I think would capture the most useful piece of

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-24 Thread Charlie Zender
Hi Martin, Thank you for taking the time to address my 3 points about ensembles, and for adding some new examples. Response interleaved... Le 19/09/2013 14:58, Schultz, Martin a écrit : Hi Charlie, very good and extensive explanation of the potential use for groups and group-aware metadata.

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-20 Thread Bryan Lawrence
... I should have read this first. Many of the same points! Bryan On 19 September 2013 22:58, m.schu...@fz-juelich.de wrote: Hi Charlie, very good and extensive explanation of the potential use for groups and group-aware metadata. Yet, I have a few remarks (which may in part reveal

Re: [CF-metadata] Are ensembles a compelling use case for group-aware metadata? (CZ)

2013-09-19 Thread Schultz, Martin
Hi Charlie, very good and extensive explanation of the potential use for groups and group-aware metadata. Yet, I have a few remarks (which may in part reveal that I should probably read the preamble of the CF convention again ;-): Point 1: How does the user know she has all the