Groups are the container mechanism by which HDF5 files are organized. From
a Python perspective, they operate somewhat like dictionaries. In this case
the “keys” are the names of group members, and the “values” are the members
Group objects also contain most of the machinery which makes HDF5 useful. The File object does double duty as the HDF5 root group, and serves as your entry point into the file:
>>> f = h5py.File('foo.hdf5','w') >>> f.name '/' >>> list(f.keys()) 
Names of all objects in the file are all text strings (
str). These will be encoded with the HDF5-approved UTF-8
encoding before being passed to the HDF5 C library. Objects may also be
retrieved using byte strings, which will be passed on to HDF5 as-is.
New groups are easy to create:
>>> grp = f.create_group("bar") >>> grp.name '/bar' >>> subgrp = grp.create_group("baz") >>> subgrp.name '/bar/baz'
Multiple intermediate groups can also be created implicitly:
>>> grp2 = f.create_group("/some/long/path") >>> grp2.name '/some/long/path' >>> grp3 = f['/some/long'] >>> grp3.name '/some/long'
Generally Group objects are created by opening objects in the file, or by the method
Group.create_group(). Call the constructor with a
GroupIDinstance to create a new Group bound to an existing low-level identifier.
Dict-like membership testing. name may be a relative or absolute path.
Create a new link, or automatically create a dataset. See Dict interface and links.
Check that the group is accessible. A group could be inaccessible for several reasons. For instance, the group, or the file it belongs to, may have been closed elsewhere.
>>> f = h5py.open(filename) >>> group = f["MyGroup"] >>> f.close() >>> if group: ... print("group is accessible") ... else: ... print("group is inaccessible") group is inaccessible
Returns: set-like object.
Get the objects contained in the group (Group and Dataset instances). Broken soft or external links show up as None.
Returns: a collection or bag-like object.
(name, value)pairs for object directly attached to this group. Values for broken soft or external links show up as None.
Returns: a set-like object.
get(name, default=None, getclass=False, getlink=False)¶
Retrieve an item, or information about an item. name and default work like the standard Python
- name – Name of the object to retrieve. May be a relative or absolute path.
- default – If the object isn’t found, return this instead.
- getclass – If True, return the class of object instead;
- getlink – If true, return the type of link via a
getclassis also True, returns the corresponding Link class without instantiating it.
Recursively visit all objects in this group and subgroups. You supply a callable with the signature:
callable(name) -> None or return value
name will be the name of the object relative to the current group. Return None to continue visiting until all objects are exhausted. Returning anything else will immediately stop visiting and return that value from
>>> def find_foo(name): ... """ Find first object with 'foo' anywhere in the name """ ... if 'foo' in name: ... return name >>> group.visit(find_foo) 'some/subgroup/foo'
Recursively visit all objects in this group and subgroups. Like
Group.visit(), except your callable should have the signature:
callable(name, object) -> None or return value
Move an object or link in the file. If source is a hard link, this effectively renames the object. If a soft or external link, the link itself is moved.
- source (String) – Name of object or link to move.
- dest (String) – New location for object or link.
copy(source, dest, name=None, shallow=False, expand_soft=False, expand_external=False, expand_refs=False, without_attrs=False)¶
Copy an object or group. The source and destination need not be in the same file. If the source is a Group object, by default all objects within that group will be copied recursively.
- source – What to copy. May be a path in the file or a Group/Dataset object.
- dest – Where to copy it. May be a path or Group object.
- name – If the destination is a Group object, use this for the name of the copied object (default is basename).
- shallow – Only copy immediate members of a group.
- expand_soft – Expand soft links into new objects.
- expand_external – Expand external links into new objects.
- expand_refs – Copy objects which are pointed to by references.
- without_attrs – Copy object(s) without copying HDF5 attributes.
Create and return a new group in the file.
- name (String or None) – Name of group to create. May be an absolute or relative path. Provide None to create an anonymous group, to be linked into the file later.
- track_order – Track dataset/group/attribute creation order under
this group if
True. Default is
Open a group in the file, creating it if it doesn’t exist. TypeError is raised if a conflicting object already exists. Parameters as in
create_dataset(name, shape=None, dtype=None, data=None, **kwds)¶
Create a new dataset. Options are explained in Creating datasets.
- name – Name of dataset to create. May be an absolute or relative path. Provide None to create an anonymous dataset, to be linked into the file later.
- shape – Shape of new dataset (Tuple).
- dtype – Data type for new dataset
- data – Initialize dataset to this (NumPy array).
- chunks – Chunk shape, or True to enable auto-chunking.
- maxshape – Dataset will be resizable up to this shape (Tuple). Automatically enables chunking. Use None for the axes you want to be unlimited.
- compression – Compression strategy. See Filter pipeline.
- compression_opts – Parameters for compression filter.
- scaleoffset – See Scale-Offset filter.
- shuffle – Enable shuffle filter (T/F). See Shuffle filter.
- fletcher32 – Enable Fletcher32 checksum (T/F). See Fletcher32 filter.
- fillvalue – This value will be used when reading uninitialized parts of the dataset.
- track_times – Enable dataset creation timestamps (T/F).
- track_order – Track attribute creation order if
True. Default is
- external – Store the dataset in one or more external, non-HDF5
files. This should be an iterable (such as a list) of tuples of
(name, offset, size)to store data from
offset + sizein the named file. Each name must be a str, bytes, or os.PathLike; each offset and size, an integer. The last file in the sequence may have size
h5py.h5f.UNLIMITEDto let it grow as needed. If only a name is given instead of an iterable of tuples, it is equivalent to
[(name, 0, h5py.h5f.UNLIMITED)].
- allow_unknown_filter – Do not check that the requested filter is
available for use (T/F). This should only be set if you will
write any data with
write_direct_chunk, compressing the data before passing it to h5py.
require_dataset(name, shape=None, dtype=None, exact=None, **kwds)¶
Open a dataset, creating it if it doesn’t exist.
If keyword “exact” is False (default), an existing dataset must have the same shape and a conversion-compatible dtype to be returned. If True, the shape and dtype must match exactly.
Other dataset keywords (see create_dataset) may be provided, but are only used if a new dataset is to be created.
Raises TypeError if an incompatible object already exists, or if the shape or dtype don’t match according to the above rules.
Parameters: exact – Require shape and type to match exactly (T/F)
create_dataset_like(name, other, **kwds)¶
Create a dataset similar to other, much like numpy’s _like functions.
- name – Name of the dataset (absolute or relative). Provide None to make an anonymous dataset.
- other – The dataset whom the new dataset should mimic. All properties, such as shape, dtype, chunking, … will be taken from it, but no data or attributes are being copied.
Any dataset keywords (see create_dataset) may be provided, including shape and dtype, in which case the provided values take precedence over those from other.
create_virtual_dataset(name, layout, fillvalue=None)¶
Create a new virtual dataset in this group. See Virtual Datasets (VDS) for more details.
- name (str) – Name of the dataset (absolute or relative).
- layout (VirtualLayout) – Defines what source data fills which parts of the virtual dataset.
- fillvalue – The value to use where there is no data.
Assemble a virtual dataset in this group.
This is used as a context manager:
with f.build_virtual_dataset('virt', (10, 1000), np.uint32) as layout: layout = h5py.VirtualSource('foo.h5', 'data', (1000,))
Inside the context, you populate a
VirtualLayoutobject. The file is only modified when you leave the context, and if there’s no error.
- name (str) – Name of the dataset (absolute or relative)
- shape (tuple) – Shape of the dataset
- dtype – A numpy dtype for data read from the virtual dataset
- maxshape (tuple) – Maximum dimensions if the dataset can grow (optional). Use None for unlimited dimensions.
- fillvalue – The value used where no data is available.
A proxy object allowing you to interrogate region references. See Using region references.
String giving the full path to this group.