[ET Trac] [Einstein Toolkit] #1483: speed up reading metadata of HDF5 files in visit
Einstein Toolkit
trac-noreply at einsteintoolkit.org
Wed Nov 20 05:58:15 CST 2013
#1483: speed up reading metadata of HDF5 files in visit
--------------------------+-------------------------------------------------
Reporter: rhaas | Owner:
Type: enhancement | Status: review
Priority: minor | Milestone:
Component: Other | Version: development version
Resolution: | Keywords: CarpetHDF5
--------------------------+-------------------------------------------------
Comment (by hinder):
Is this beneficial even when using index files? We do a similar thing in
SimulationTools. Take a look at
https://bitbucket.org/simulationtools/simulationtools/src/8e0d40844bc9831bb3ba80e9fd453371c0574327/CarpetIOHDF5.m?at=master
around line 332 "Low-level interface for determining what's available in a
file". Essentially we read in all the dataset names and parse them, and
build up a lookup table which is then used to find datasets by the
key/value pairs from the name. Note that (as explained in the comment in
the file) we use the terminology "attribute" here to refer to the X=Y
parts of the dataset name, not the HDF5 attribute (this should probably be
changed). The HDF5 attributes are read using the Annotations function,
but this is only called when reading the data (to get the origin and
delta) or something (like cctk_time) that is only available in HDF5
attributes.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1483#comment:2>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
More information about the Trac
mailing list