Skip to content

Global adaptivity is limited to shared memory on device #217

@steffenger

Description

@steffenger

For documentation purposes mainly. I'm not sure to what extent this is a problem, but on some system shared memory is only 50% of RAM, which means that the user can only use 50% compared to local adaptivty option or no adaptivity.

It appears as if there is not enough space for /dev/shm/osc_sm.abc.1cbb0001.0.4 (the shared-memory backing
file). It is likely that your MPI job will now either abort or experience
performance degradation.

  Local host:  abc
  Space Requested: 70350139792 B
  Space Available: 66749136896 B
--------------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/USADR/ac135212/spack/var/spack/environments/examples_final/.spack-env/view/bin/micro-manager-precice", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/USADR/ac135212/spack/var/spack/environments/examples_final/.spack-env/._view/j2i6wdbluvyqkt5a3by5mzvsm7wvc5xw/lib/python3.12/site-packages/micro_manager/__init__.py", line 47, in main
    manager.initialize()
  File "/home/USADR/ac135212/spack/var/spack/environments/examples_final/.spack-env/._view/j2i6wdbluvyqkt5a3by5mzvsm7wvc5xw/lib/python3.12/site-packages/micro_manager/micro_manager.py", line 597, in initialize
    GlobalAdaptivityCalculator(
  File "/home/USADR/ac135212/spack/var/spack/environments/examples_final/.spack-env/._view/j2i6wdbluvyqkt5a3by5mzvsm7wvc5xw/lib/python3.12/site-packages/micro_manager/adaptivity/global_adaptivity.py", line 84, in __init__
    win = MPI.Win.Allocate_shared(nbytes, itemsize, comm=self._comm_node)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "src/mpi4py/MPI.src/Win.pyx", line 126, in mpi4py.MPI.Win.Allocate_shared
mpi4py.MPI.Exception: MPI_ERR_INTERN: internal error`

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions