[ET Trac] [Einstein Toolkit] #1483: speed up reading metadata of HDF5 files in visit

Einstein Toolkit trac-noreply at einsteintoolkit.org
Wed Nov 20 05:58:15 CST 2013


#1483: speed up reading metadata of HDF5 files in visit
--------------------------+-------------------------------------------------
  Reporter:  rhaas        |       Owner:                     
      Type:  enhancement  |      Status:  review             
  Priority:  minor        |   Milestone:                     
 Component:  Other        |     Version:  development version
Resolution:               |    Keywords:  CarpetHDF5         
--------------------------+-------------------------------------------------

Comment (by hinder):

 Is this beneficial even when using index files?  We do a similar thing in
 SimulationTools.  Take a look at
 https://bitbucket.org/simulationtools/simulationtools/src/8e0d40844bc9831bb3ba80e9fd453371c0574327/CarpetIOHDF5.m?at=master
 around line 332 "Low-level interface for determining what's available in a
 file".  Essentially we read in all the dataset names and parse them, and
 build up a lookup table which is then used to find datasets by the
 key/value pairs from the name.  Note that (as explained in the comment in
 the file) we use the terminology "attribute" here to refer to the X=Y
 parts of the dataset name, not the HDF5 attribute (this should probably be
 changed).  The HDF5 attributes are read using the Annotations function,
 but this is only called when reading the data (to get the origin and
 delta) or something (like cctk_time) that is only available in HDF5
 attributes.

-- 
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1483#comment:2>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit


More information about the Trac mailing list