[ET Trac] [Einstein Toolkit] #1878: hdf5 deflate fragments memory

Einstein Toolkit trac-noreply at einsteintoolkit.org
Wed Apr 27 11:12:26 CDT 2016


#1878: hdf5 deflate fragments memory
--------------------------+-------------------------------------------------
  Reporter:  knarf        |       Owner:                     
      Type:  enhancement  |      Status:  new                
  Priority:  minor        |   Milestone:                     
 Component:  Other        |     Version:  development version
Resolution:               |    Keywords:  HDF5               
--------------------------+-------------------------------------------------

Comment (by hinder):

 I have used tcmalloc at the same time as the HDF5 decompression, and this
 was not sufficient to alleviate the problem.  It might be that the HDF5
 library was not using the tcmalloc malloc (I think I asked you about this
 in the past Erik; I will have to check the email conversation), or the
 fragmentation was just too much, so that even tcmalloc was not able to
 cope.  I think that the problem originates in the HDF5 decompression
 routine, and could be made a lot better by a few small changes there.  We
 should find out whether the size of the original data field can be used or
 not.

-- 
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1878#comment:2>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit


More information about the Trac mailing list