Skip to content

Regression

Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)

Failing for the past 1 build (Since Failed #57 )
Took 12 sec.

Stacktrace

[9cc6956df2dc:18820] *** Process received signal ***
[9cc6956df2dc:18820] Signal: Segmentation fault (11)
[9cc6956df2dc:18820] Signal code: Address not mapped (1)
[9cc6956df2dc:18820] Failing at address: 0x18
[9cc6956df2dc:18820] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fac60684420]
[9cc6956df2dc:18820] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fac5eedc35d]
[9cc6956df2dc:18820] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fac5eee047d]
[9cc6956df2dc:18820] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fac5eeeb926]
[9cc6956df2dc:18820] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fac5ee23c90]
[9cc6956df2dc:18820] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fac5ee2eb5e]
[9cc6956df2dc:18820] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18820] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18820] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18820] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18820] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fac5e54b083]
[9cc6956df2dc:18820] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18820] *** End of error message ***
[9cc6956df2dc:18815] *** Process received signal ***
[9cc6956df2dc:18815] Signal: Segmentation fault (11)
[9cc6956df2dc:18815] Signal code: Address not mapped (1)
[9cc6956df2dc:18815] Failing at address: 0x18
[9cc6956df2dc:18815] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f512d503420]
[9cc6956df2dc:18815] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f512bd5b35d]
[9cc6956df2dc:18815] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f512bd5f47d]
[9cc6956df2dc:18815] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f512bd6a926]
[9cc6956df2dc:18815] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f512bca2c90]
[9cc6956df2dc:18815] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f512bcadb5e]
[9cc6956df2dc:18815] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18815] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18815] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18815] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18815] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f512b3ca083]
[9cc6956df2dc:18815] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18815] *** End of error message ***
[9cc6956df2dc:18812] *** Process received signal ***
[9cc6956df2dc:18812] Signal: Segmentation fault (11)
[9cc6956df2dc:18812] Signal code: Address not mapped (1)
[9cc6956df2dc:18812] Failing at address: 0x18
[9cc6956df2dc:18812] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff52866c420]
[9cc6956df2dc:18812] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff526ec435d]
[9cc6956df2dc:18812] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff526ec847d]
[9cc6956df2dc:18812] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff526ed3926]
[9cc6956df2dc:18812] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff526e0bc90]
[9cc6956df2dc:18812] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff526e16b5e]
[9cc6956df2dc:18812] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18812] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18812] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18812] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18812] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff526533083]
[9cc6956df2dc:18812] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18812] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
[9cc6956df2dc:18809] *** Process received signal ***
[9cc6956df2dc:18809] Signal: Segmentation fault (11)
[9cc6956df2dc:18809] Signal code: Address not mapped (1)
[9cc6956df2dc:18809] Failing at address: 0x18
[9cc6956df2dc:18809] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ffb9bbdf420]
[9cc6956df2dc:18809] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ffb9a43735d]
[9cc6956df2dc:18809] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ffb9a43b47d]
[9cc6956df2dc:18809] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ffb9a446926]
[9cc6956df2dc:18809] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ffb9a37ec90]
[9cc6956df2dc:18809] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ffb9a389b5e]
[9cc6956df2dc:18809] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18809] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18809] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18809] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18809] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ffb99aa6083]
[9cc6956df2dc:18809] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18809] *** End of error message ***
--------------------------------------------------------------------------
mpiexec noticed that process rank 2 with PID 0 on node 9cc6956df2dc exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

[9cc6956df2dc:18820] *** Process received signal ***
[9cc6956df2dc:18820] Signal: Segmentation fault (11)
[9cc6956df2dc:18820] Signal code: Address not mapped (1)
[9cc6956df2dc:18820] Failing at address: 0x18
[9cc6956df2dc:18820] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fac60684420]
[9cc6956df2dc:18820] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fac5eedc35d]
[9cc6956df2dc:18820] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fac5eee047d]
[9cc6956df2dc:18820] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fac5eeeb926]
[9cc6956df2dc:18820] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fac5ee23c90]
[9cc6956df2dc:18820] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fac5ee2eb5e]
[9cc6956df2dc:18820] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18820] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18820] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18820] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18820] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fac5e54b083]
[9cc6956df2dc:18820] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18820] *** End of error message ***
[9cc6956df2dc:18815] *** Process received signal ***
[9cc6956df2dc:18815] Signal: Segmentation fault (11)
[9cc6956df2dc:18815] Signal code: Address not mapped (1)
[9cc6956df2dc:18815] Failing at address: 0x18
[9cc6956df2dc:18815] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f512d503420]
[9cc6956df2dc:18815] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f512bd5b35d]
[9cc6956df2dc:18815] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f512bd5f47d]
[9cc6956df2dc:18815] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f512bd6a926]
[9cc6956df2dc:18815] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f512bca2c90]
[9cc6956df2dc:18815] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f512bcadb5e]
[9cc6956df2dc:18815] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18815] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18815] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18815] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18815] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f512b3ca083]
[9cc6956df2dc:18815] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18815] *** End of error message ***
[9cc6956df2dc:18812] *** Process received signal ***
[9cc6956df2dc:18812] Signal: Segmentation fault (11)
[9cc6956df2dc:18812] Signal code: Address not mapped (1)
[9cc6956df2dc:18812] Failing at address: 0x18
[9cc6956df2dc:18812] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff52866c420]
[9cc6956df2dc:18812] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff526ec435d]
[9cc6956df2dc:18812] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff526ec847d]
[9cc6956df2dc:18812] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff526ed3926]
[9cc6956df2dc:18812] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff526e0bc90]
[9cc6956df2dc:18812] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff526e16b5e]
[9cc6956df2dc:18812] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18812] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18812] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18812] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18812] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff526533083]
[9cc6956df2dc:18812] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18812] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
[9cc6956df2dc:18809] *** Process received signal ***
[9cc6956df2dc:18809] Signal: Segmentation fault (11)
[9cc6956df2dc:18809] Signal code: Address not mapped (1)
[9cc6956df2dc:18809] Failing at address: 0x18
[9cc6956df2dc:18809] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ffb9bbdf420]
[9cc6956df2dc:18809] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ffb9a43735d]
[9cc6956df2dc:18809] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ffb9a43b47d]
[9cc6956df2dc:18809] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ffb9a446926]
[9cc6956df2dc:18809] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ffb9a37ec90]
[9cc6956df2dc:18809] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ffb9a389b5e]
[9cc6956df2dc:18809] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[9cc6956df2dc:18809] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[9cc6956df2dc:18809] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[9cc6956df2dc:18809] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[9cc6956df2dc:18809] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ffb99aa6083]
[9cc6956df2dc:18809] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[9cc6956df2dc:18809] *** End of error message ***
--------------------------------------------------------------------------
mpiexec noticed that process rank 2 with PID 0 on node 9cc6956df2dc exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------