...
Lustre being a parallel filesystem deals with locks in a different manner. If you copy/move your NetCDF files to a Lustre-based Filesystem such as SCRATCH or HPCPERM, you should be able to work with it them without experiencing the problem and still benefiting from the locking mechanism for safety.
Disabling File locking in HDF5
...
Code Block |
---|
|
os.environ['HDF5_USE_FILE_LOCKING']='FALSE' |
Note, however, that this approach may lead to data corruption in certain cases where the files are accessed concurrently by different processes.
Related articles
Content by Label |
---|
showLabels | false |
---|
max | 5 |
---|
spaces | UDOC |
---|
showSpace | false |
---|
sort | modified |
---|
reverse | true |
---|
type | page |
---|
cql | label in ("atos","hpc2020","netcdf","nfs") and type = "page" and space = "UDOC" |
---|
labels | atos hpc2020 netcdf nfs |
---|
|
...