<div dir="ltr">It is surprising to see how many such frameworks are available. I'd suggest that we create a wiki page that briefly describes them, and points to instructions for downloading and examples.<div><br></div><div>Incidentally, we are also developing such a framework here at Perimeter. The basic idea is to have a generic way of describing the data in a simulation, introducing concepts such as discretizations of a manifold, bases for the tangent space, tensor types, fields, etc. <<a href="https://github.com/eschnett/SimulationIO">https://github.com/eschnett/SimulationIO</a>>. We (i.e. Jonah Miller) are now testing and benchmarking it against real-world data, developing a yt <<a href="http://yt-project.org">http://yt-project.org</a>> reader in the process.</div><div><br></div><div>The SimulationIO library is supposed to be used directly for writing and reading data from Cactus. Currently, that hasn't been implemented yet, and so there is a converter from Carpet output that either collects all the metadata (with external links to the original datasets) or creates a single output file. Obviously the file format is still based on HDF5 -- the main advantage is that the metadata are much easier to access and interpret than having to loop over the components and parsing their names.</div><div><br></div><div>I assume Jonah will describe this at the Einstein Toolkit.<br><div><br></div><div>-erik</div></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 17, 2016 at 2:17 PM, Federico Guercilena <span dir="ltr"><<a href="mailto:guercilena@th.physik.uni-frankfurt.de" target="_blank">guercilena@th.physik.uni-frankfurt.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello,<div><br></div><div>I'd like to point out also my python library/script called "rugutils". This one started off inspired by David's scidata (and pygraph), but has developed into a set of tools to look in a quick and hassle-free way at Carpet data. It's written in python 3.5</div><div><br></div><div><a href="https://bitbucket.org/fguercilena/rugutils" target="_blank">https://bitbucket.org/fguercilena/rugutils</a><br></div><div><a href="https://docs.einsteintoolkit.org/et-docs/Analysis_and_post-processing" target="_blank">https://docs.einsteintoolkit.org/et-docs/Analysis_and_post-processing</a><br></div><div><br></div><div>Federico</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">2016-05-17 19:44 GMT+02:00 Roland Haas <span dir="ltr"><<a href="mailto:rhaas@aei.mpg.de" target="_blank">rhaas@aei.mpg.de</a>></span>:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">Hello Frank, Michael,<br>
<br>
@Michael: both of what Frank or David describe should work. If you know<br>
how to compile the VisIt reader yourselv, you can also try the copy of<br>
CarpetHDF5 at <a href="https://bitbucket.org/rhaas80/carpethdf5" rel="noreferrer" target="_blank">https://bitbucket.org/rhaas80/carpethdf5</a> either the<br>
"multifile" branch (which is the default one that has all features) or<br>
the "for_VisIt" branch which has fewer features and is what I wanted at<br>
one point propose for inclusion in VisIt. Both will let you<br>
create .visit files listing your hdf5 files and VisIt will treat them a<br>
a single database. You will have to create .visit files that look like<br>
this:<br>
<br>
!NBLOCKS 3<br>
output-0000/rho.file_0.h5<br>
output-0000/rho.file_1.h5<br>
output-0000/rho.file_2.h5<br>
output-0001/rho.file_0.h5<br>
output-0001/rho.file_1.h5<br>
output-0001/rho.file_2.h5<br>
<br>
for a 3 process run and similar for runs with more processes. You can probably (I have not tested this) also list both rho and eps:<br>
<br>
!NBLOCKS 3<br>
output-0000/rho.file_0.h5<br>
output-0000/rho.file_1.h5<br>
output-0000/rho.file_2.h5<br>
output-0000/eps.file_0.h5<br>
output-0000/eps.file_1.h5<br>
output-0000/eps.file_2.h5<br>
output-0001/rho.file_0.h5<br>
output-0001/rho.file_1.h5<br>
output-0001/rho.file_2.h5<br>
output-0001/eps.file_0.h5<br>
output-0001/eps.file_1.h5<br>
output-0001/eps.file_2.h5<br>
<br>
possibly you have to set NBLOCKS to 6 (2*3) for this, though I have not tested<br>
this either.<br>
<br>
@Frank:<br>
> Also, in case you have an old version of VisIt, you might need to enable<br>
> the use of soft links in the VisIt Carpet reader. I am currently not<br>
> sure if that change made it back upstream yet. The corresponding patch<br>
> is:<br>
><br>
> Index: avtCarpetHDF5FileFormat.C<br>
> ===================================================================<br>
> --- avtCarpetHDF5FileFormat.C (revision 57)<br>
> +++ avtCarpetHDF5FileFormat.C (working copy)<br>
> @@ -1044,7 +1044,7 @@<br>
> sprintf(fullname, "%s%s%s", rootname, rootname[strlen(rootname)-1]=='/' ? "" : "/",member_name);<br>
><br>
> // we are interested in datasets only - skip anything else<br>
> - H5Gget_objinfo (group_id, member_name, 0, &object_info);<br>
> + H5Gget_objinfo (group_id, member_name, 1, &object_info);<br>
> if (object_info.type != H5G_DATASET)<br>
> {<br>
> if (object_info.type == H5G_GROUP)<br>
As far as I can tell this code change has not even made it into the ET<br>
maintained copy of the reader:<br>
<a href="https://svn.cactuscode.org/VizTools/CarpetHDF5/" rel="noreferrer" target="_blank">https://svn.cactuscode.org/VizTools/CarpetHDF5/</a><br>
<br>
where if this does not cause any other problems I think it would be<br>
welcome as well.<br>
<br>
Yours,<br>
Roland<br>
<span><font color="#888888"><br>
<br>
<br>
--<br>
My email is as private as my paper mail. I therefore support encrypting<br>
and signing email messages. Get my PGP key from <a href="http://keys.gnupg.net" rel="noreferrer" target="_blank">http://keys.gnupg.net</a>.<br>
</font></span><br></div></div><span class="">_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@einsteintoolkit.org" target="_blank">Users@einsteintoolkit.org</a><br>
<a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
<br></span></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div><div dir="ltr"><div>Federico Guercilena</div><div>Institut für Theoretische Physik</div><div>Johann Wolfgang Goethe-Universität</div><div>Max-von-Laue-Str. 1</div><div>60438 Frankfurt am Main, Germany</div><div>Telephone: <a href="tel:%2B49%2069%20798%2047887" value="+496979847887" target="_blank">+49 69 798 47887</a></div><div>Email: guercilena[at]<a href="http://th.physik.uni-frankfurt.de" target="_blank">th.physik.uni-frankfurt.de</a></div></div></div>
</font></span></div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@einsteintoolkit.org">Users@einsteintoolkit.org</a><br>
<a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br><a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a></div>
</div>