Hi Stephen, Charlie, and all,
I was unaware that there was a cfchecker based on cdat. Is that the one
at the CF Trac site or the one at https://bitbucket.org/mde_/cfchecker ?
Does anyone know whether one of the cfcheckers is more
complete/correct/robust than the other?
If one is superior, we should make this known through the CF website.
If folks have funding/free energy to develop checkers, I think there is
a need to develop code that can check not only adherence to CF, but also
other conditions imposed by specific projects (like CMIP), which often
*require* certain CF-defined attributes and other metadata, that are not
necessarily required by CF itself. There may also be specific
"controlled vocabularies", filename constructs, non-CF-defined globsal
attributes and the like that are required by this projects. If someone
came up with a configurable checker that could be adopted by CMIP,
obs4MIPs, CORDEX and other projects to ensure conformance with their
requirements, it would be very useful. On the other hand, one should
realize that a truly general code of this kind might either be too
complex to work well, or too difficult to configure.
[The cmor code used to write much of the CMIP3 and CMIP5 output, as well
as CORDEX and obs4MIPs data, does perform a number of checks, which
almost always ensures conformance with the project specifications, but
not everyone uses this code to write there data. That's why a checker
would be useful.]
Best regards,
Karl
On 1/15/14 7:04 AM, [email protected] wrote:
It's great to hear there is another checker in active development. The one based on cdat
was developed some time ago and could really do with an update. We would like to replace
cdat entirely at some point and replace with python-netCDF4. It's a pitty that both of
our packages are called cfchecker though :-). In the UK "cfchecker" is
synonymous with the code available through the CF Trac site and available as a web
service at the BADC and University of Reading.
When we have time we will take a look at your package, and particularly the
test suite to see if we can draw both test suites together. This would allow
us to identify gaps in either tool and hopefully move towards a single way
forward.
Stephen.
On 13 Jan 2014, at 16:48, Charlie Zender wrote:
Hello Stephen,
ncdismember uses the cfchecker code developed by Michael Decker and
Martin Schultz and distributed at https://bitbucket.org/mde_/cfchecker
ncdismember makes no changes to that code. Is that the same as yours?
The ncdismember script is at http://nco.sf.net/nco.html#ncdismember
The part involving CFChecker is very straightforward.
We would welcome any changes that improve the user experience.
Are there multiple codes named "CFChecker"?
We'd be happy to accept a patch that allows ncdismember to use more
than one "CFChecker", or to exploit other options of the checker.
AFAICT we currently use all the options except the one that allows
explicit specifications of which tests to perform.
Charlie
Le 13/01/2014 01:42, [email protected] a écrit :
Hi Charlie,
I'm interested in how you are using the CFChecker code. Are you using the code
form the CF SVN [1] or the packaging I maintain based on the same codebase [2],
or is this independent code? Have you applied any patches to the version you
use in ncdismember? It would be good to keep any improvements to the code in
the main line.
Thanks,
Stephen.
[1]: https://cf-pcmdi.llnl.gov/trac/browser/cf-checker
[2]: https://pypi.python.org/pypi/cfchecker
---
Stephen Pascoe +44 (0)1235 445980
Centre of Environmental Data Archival
STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK
-----Original Message-----
From: CF-metadata [mailto:[email protected]] On Behalf Of
Charlie Zender
Sent: 09 January 2014 22:53
To: CF Metadata Mail List
Subject: [CF-metadata] Update on ncdismember (+CFchecker) for hierarchical files
Hello CFers,
A few months ago I introduced ncdismember, a script that uses the netCDF
Operators (NCO) to dismember hierarchical netCDF-compliant files into
netCDF3-compliant (flat-) files, then calls CFChecker on those. It is a simple
(one-line) procedure that checks CF-compliance of all groups in hierarchical
netCDF4/HDF5 files.
The recent releases of NCO 4.4.0 and netCDF 4.3.1-rc7 bring significant new
features to ncdismember...
1. Works on all groups in netCDF4/HDF5 files. Not only leaf groups.
2. Works on HDF4 files. No prior conversion to netCDF necessary.
3. Automatically translates input to netCDF3-supported types (e.g.,
nc_string->nc_char, nc_ubyte->nc_short).
4. Is faster: Uses CFChecker batch mode and avoids temporary output.
Example input (*.nc, *.hdf, *.h5, *.he5) and output (*.txt):
http://dust.ess.uci.edu/diwg
For more information see
http://nco.sf.net/nco.html#dismember
Feedback welcome on relevant NCO SourceForge forum
https://sourceforge.net/p/nco/discussion
Enjoy,
Charlie
--
Charlie Zender, Earth System Sci. & Computer Sci.
University of California, Irvine 949-891-2429 )'(
_______________________________________________
CF-metadata mailing list
[email protected]
http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
--
Charlie Zender, Earth System Sci. & Computer Sci.
University of California, Irvine 949-891-2429 )'(
_______________________________________________
CF-metadata mailing list
[email protected]
http://mailman.cgd.ucar.edu/mailman/listinfo/cf-metadata
