[Pkg-openmpi-maintainers] Bug#873450: MPI_Init in C also fails [Re: Bug#873450: openmpi: MPI_init in fortran fails on kfreebsd-amd64]

Boud Roukema boud-debian at cosmo.torun.pl
Thu Aug 31 20:00:00 UTC 2017


This is not a pure fortran bug: the same error occurs for a C
even-less-than-hello-world program. These tests are on a different machine,
again on a physical partition. The fortran error is unchanged.

++++++ cat /etc/debian_version
buster/sid

++++++ uname -vorsmpi
GNU/kFreeBSD 10.3-0-amd64 #0 Fri Jan 20 17:41:38 UTC 2017 x86_64 amd64 Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz GNU/kFreeBSD

++++++ dpkg -l | egrep 'gcc|mpi'
ii  g++                                      4:7.1.0-2                      kfreebsd-amd64 GNU C++ compiler
ii  g++-7                                    7.2.0-2                        kfreebsd-amd64 GNU C++ compiler
ii  gcc                                      4:7.1.0-2                      kfreebsd-amd64 GNU C compiler
ii  gcc-5-base:kfreebsd-amd64                5.4.1-5                        kfreebsd-amd64 GCC, the GNU Compiler Collection (base package)
ii  gcc-6-base:kfreebsd-amd64                6.4.0-4                        kfreebsd-amd64 GCC, the GNU Compiler Collection (base package)
ii  gcc-7                                    7.2.0-2                        kfreebsd-amd64 GNU C compiler
ii  gcc-7-base:kfreebsd-amd64                7.2.0-2                        kfreebsd-amd64 GCC, the GNU Compiler Collection (base package)
ii  gfortran                                 4:7.1.0-2                      kfreebsd-amd64 GNU Fortran 95 compiler
ii  gfortran-7                               7.2.0-2                        kfreebsd-amd64 GNU Fortran compiler
ii  libb-hooks-endofscope-perl               0.21-1                         all            module for executing code after a scope finished compilation
ii  libgcc-7-dev:kfreebsd-amd64              7.2.0-2                        kfreebsd-amd64 GCC support library (development files)
ii  libgcc1:kfreebsd-amd64                   1:7.2.0-2                      kfreebsd-amd64 GCC support library
ii  libmagic-mgc                             1:5.31-1                       kfreebsd-amd64 File type determination library using "magic" numbers (compiled magic file)
ii  libopenmpi-dev                           2.1.1-6+b1                     kfreebsd-amd64 high performance message passing library -- header files
ii  libopenmpi2:kfreebsd-amd64               2.1.1-6+b1                     kfreebsd-amd64 high performance message passing library -- shared library
ii  make                                     4.1-9                          kfreebsd-amd64 utility for directing compilation
ii  mpi-default-bin                          1.9                            kfreebsd-amd64 Standard MPI runtime programs (metapackage)
ii  mpi-default-dev                          1.9                            kfreebsd-amd64 Standard MPI development files (metapackage)
ii  openmpi-bin                              2.1.1-6+b1                     kfreebsd-amd64 high performance message passing library -- binaries
ii  openmpi-common                           2.1.1-6                        all            high performance message passing library -- common files

++++++ gcc --version
gcc (Debian 7.2.0-2) 7.2.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.


++++++ cat mpi_include_mpi_h_detect.c
#include <mpi.h>
int main(int argc,
          char** argv){
   MPI_Init(NULL,NULL);
   MPI_Finalize();
   return 0;
}

++++++ rm -f a.out

++++++ mpicc --showme
gcc -I/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi -I/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent -I/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include -I/usr/lib/x86_64-kfreebsd-gnu/openmpi/include -pthread -L/usr//lib -L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib -lmpi

++++++ mpicc --verbose mpi_include_mpi_h_detect.c
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-kfreebsd-gnu/7/lto-wrapper
Target: x86_64-kfreebsd-gnu
Configured with: ../src/configure -v --with-pkgversion='Debian 7.2.0-2' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-kfreebsd-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --disable-libitm --disable-libsanitizer --enable-plugin --enable-default-pie --with-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --enable-multilib --with-tune=generic --enable-checking=release --build=x86_64-kfreebsd-gnu --host=x86_64-kfreebsd-gnu --target=x86_64-kfreebsd-gnu
Thread model: posix
gcc version 7.2.0 (Debian 7.2.0-2) 
COLLECT_GCC_OPTIONS='-v' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include' '-pthread' '-L/usr//lib' '-L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib' '-mtune=generic' '-march=x86-64'
  /usr/lib/gcc/x86_64-kfreebsd-gnu/7/cc1 -quiet -v -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include -imultiarch x86_64-kfreebsd-gnu -D_REENTRANT mpi_include_mpi_h_detect.c -quiet -dumpbase mpi_include_mpi_h_detect.c -mtune=generic -march=x86-64 -auxbase mpi_include_mpi_h_detect -version -o /tmp/ccIkyezc.s
GNU C11 (Debian 7.2.0-2) version 7.2.0 (x86_64-kfreebsd-gnu)
         compiled by GNU C version 7.2.0, GMP version 6.1.2, MPFR version 3.1.5, MPC version 1.0.3, isl version isl-0.18-GMP

warning: MPFR header version 3.1.5 differs from library version 3.1.6-rc1.
GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
ignoring nonexistent directory "/usr/local/include/x86_64-kfreebsd-gnu"
ignoring nonexistent directory "/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../../x86_64-kfreebsd-gnu/include"
#include "..." search starts here:
#include <...> search starts here:
  /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi
  /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent
  /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include
  /usr/lib/x86_64-kfreebsd-gnu/openmpi/include
  /usr/lib/gcc/x86_64-kfreebsd-gnu/7/include
  /usr/local/include
  /usr/lib/gcc/x86_64-kfreebsd-gnu/7/include-fixed
  /usr/include/x86_64-kfreebsd-gnu
  /usr/include
End of search list.
GNU C11 (Debian 7.2.0-2) version 7.2.0 (x86_64-kfreebsd-gnu)
         compiled by GNU C version 7.2.0, GMP version 6.1.2, MPFR version 3.1.5, MPC version 1.0.3, isl version isl-0.18-GMP

warning: MPFR header version 3.1.5 differs from library version 3.1.6-rc1.
GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
Compiler executable checksum: cd26414d0aceb3588b4bd917d50a2e8c
COLLECT_GCC_OPTIONS='-v' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include' '-pthread' '-L/usr//lib' '-L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib' '-mtune=generic' '-march=x86-64'
  as -v -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include -I /usr/lib/x86_64-kfreebsd-gnu/openmpi/include --64 -o /tmp/cc5t2eD0.o /tmp/ccIkyezc.s
GNU assembler version 2.29 (x86_64-kfreebsd-gnu) using BFD version (GNU Binutils for Debian) 2.29
COMPILER_PATH=/usr/lib/gcc/x86_64-kfreebsd-gnu/7/:/usr/lib/gcc/x86_64-kfreebsd-gnu/7/:/usr/lib/gcc/x86_64-kfreebsd-gnu/:/usr/lib/gcc/x86_64-kfreebsd-gnu/7/:/usr/lib/gcc/x86_64-kfreebsd-gnu/
LIBRARY_PATH=/usr/lib/gcc/x86_64-kfreebsd-gnu/7/:/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../x86_64-kfreebsd-gnu/:/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../../lib/:/lib/x86_64-kfreebsd-gnu/:/lib/../lib/:/usr/lib/x86_64-kfreebsd-gnu/:/usr/lib/../lib/:/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../:/lib/:/usr/lib/
COLLECT_GCC_OPTIONS='-v' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include' '-pthread' '-L/usr//lib' '-L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib' '-mtune=generic' '-march=x86-64'
  /usr/lib/gcc/x86_64-kfreebsd-gnu/7/collect2 -plugin /usr/lib/gcc/x86_64-kfreebsd-gnu/7/liblto_plugin.so -plugin-opt=/usr/lib/gcc/x86_64-kfreebsd-gnu/7/lto-wrapper -plugin-opt=-fresolution=/tmp/ccybRzKO.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_s -plugin-opt=-pass-through=-lpthread -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_s --sysroot=/ --build-id --eh-frame-hdr -m elf_x86_64_fbsd --hash-style=gnu -dynamic-linker /lib/ld-kfreebsd-x86-64.so.1 -pie /usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../x86_64-kfreebsd-gnu/Scrt1.o /usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../x86_64-kfreebsd-gnu/crti.o /usr/lib/gcc/x86_64-kfreebsd-gnu/7/crtbeginS.o -L/usr//lib -L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib -L/usr/lib/gcc/x86_64-kfreebsd-gnu/7 -L/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../x86_64-kfreebsd-gnu -L/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../../lib -L/lib/x86_64-kfreebsd-gnu -L/lib/../lib -L/usr/lib/x86_64-kfreebsd
 -gnu -L/usr/lib/../lib -L/usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../.. /tmp/cc5t2eD0.o -lmpi -lgcc --as-needed -lgcc_s --no-as-needed -lpthread -lc -lgcc --as-needed -lgcc_s --no-as-needed /usr/lib/gcc/x86_64-kfreebsd-gnu/7/crtendS.o /usr/lib/gcc/x86_64-kfreebsd-gnu/7/../../../x86_64-kfreebsd-gnu/crtn.o
COLLECT_GCC_OPTIONS='-v' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include' '-I' '/usr/lib/x86_64-kfreebsd-gnu/openmpi/include' '-pthread' '-L/usr//lib' '-L/usr/lib/x86_64-kfreebsd-gnu/openmpi/lib' '-mtune=generic' '-march=x86-64'

++++++ ./a.out
[delaun:24968] PMIX ERROR: UNREACHABLE in file src/client/pmix_client.c at line 1017
[delaun:24969] PMIX ERROR: NOT-SUPPORTED in file src/server/pmix_server_listener.c at line 540
[delaun:24968] PMIX ERROR: UNREACHABLE in file src/client/pmix_client.c at line 205
--------------------------------------------------------------------------
It looks like orte_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during orte_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

   init pmix failed
   --> Returned value Unreachable (-12) instead of ORTE_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like orte_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during orte_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

   orte_ess_init failed
   --> Returned value Unreachable (-12) instead of ORTE_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like MPI_INIT failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during MPI_INIT; some of which are due to configuration or environment
problems.  This failure appears to be an internal failure; here's some
additional information (which may only be relevant to an Open MPI
developer):

   ompi_mpi_init: ompi_rte_init failed
   --> Returned "Unreachable" (-12) instead of "Success" (0)
--------------------------------------------------------------------------
*** An error occurred in MPI_Init
*** on a NULL communicator
*** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
***    and potentially your MPI job)
[delaun:24968] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!

++++++ ldd a.out
         libmpi.so.20 => /usr/lib/x86_64-kfreebsd-gnu/libmpi.so.20 (0x0000000801601000)
         libpthread.so.0 => /lib/x86_64-kfreebsd-gnu/libpthread.so.0 (0x00000008018f7000)
         libc.so.0.1 => /lib/x86_64-kfreebsd-gnu/libc.so.0.1 (0x0000000801b0f000)
         libdl.so.2 => /lib/x86_64-kfreebsd-gnu/libdl.so.2 (0x0000000801e71000)
         libopen-rte.so.20 => /usr/lib/x86_64-kfreebsd-gnu/libopen-rte.so.20 (0x0000000802075000)
         libopen-pal.so.20 => /usr/lib/x86_64-kfreebsd-gnu/libopen-pal.so.20 (0x00000008022ff000)
         librt.so.1 => /lib/x86_64-kfreebsd-gnu/librt.so.1 (0x00000008025b5000)
         libm.so.1 => /lib/x86_64-kfreebsd-gnu/libm.so.1 (0x00000008027bc000)
         libutil.so.1 => /lib/x86_64-kfreebsd-gnu/libutil.so.1 (0x0000000802a50000)
         libhwloc.so.5 => /usr/lib/x86_64-kfreebsd-gnu/libhwloc.so.5 (0x0000000802c53000)
         /lib/ld-kfreebsd-x86-64.so.1 (0x0000000001021000)
         libltdl.so.7 => /usr/lib/x86_64-kfreebsd-gnu/libltdl.so.7 (0x0000000802e80000)


More information about the Pkg-openmpi-maintainers mailing list