#1483: speed up reading metadata of HDF5 files in visit --------------------------+------------------------------------------------- Reporter: rhaas | Owner: Type: enhancement | Status: review Priority: minor | Milestone: Component: Other | Version: development version Resolution: | Keywords: CarpetHDF5 --------------------------+-------------------------------------------------
Comment (by hinder):
Is this beneficial even when using index files? We do a similar thing in SimulationTools. Take a look at https://bitbucket.org/simulationtools/simulationtools/src/8e0d40844bc9831bb3... around line 332 "Low-level interface for determining what's available in a file". Essentially we read in all the dataset names and parse them, and build up a lookup table which is then used to find datasets by the key/value pairs from the name. Note that (as explained in the comment in the file) we use the terminology "attribute" here to refer to the X=Y parts of the dataset name, not the HDF5 attribute (this should probably be changed). The HDF5 attributes are read using the Annotations function, but this is only called when reading the data (to get the origin and delta) or something (like cctk_time) that is only available in HDF5 attributes.