Skip to content

Regression

Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)

Failing for the past 1 build (Since Failed #56 )
Took 13 sec.

Stacktrace

[6c009d7e2d54:18784] *** Process received signal ***
[6c009d7e2d54:18784] Signal: Segmentation fault (11)
[6c009d7e2d54:18784] Signal code: Address not mapped (1)
[6c009d7e2d54:18784] Failing at address: 0x18
[6c009d7e2d54:18784] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f25ee635420]
[6c009d7e2d54:18784] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f25ece8d35d]
[6c009d7e2d54:18784] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f25ece9147d]
[6c009d7e2d54:18784] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f25ece9c926]
[6c009d7e2d54:18784] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f25ecdd4c90]
[6c009d7e2d54:18784] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f25ecddfb5e]
[6c009d7e2d54:18784] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18784] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18784] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18784] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18784] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f25ec4fc083]
[6c009d7e2d54:18784] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18784] *** End of error message ***
[6c009d7e2d54:18795] *** Process received signal ***
[6c009d7e2d54:18795] Signal: Segmentation fault (11)
[6c009d7e2d54:18795] Signal code: Address not mapped (1)
[6c009d7e2d54:18795] Failing at address: 0x18
[6c009d7e2d54:18795] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5737196420]
[6c009d7e2d54:18795] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f57359ee35d]
[6c009d7e2d54:18795] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f57359f247d]
[6c009d7e2d54:18795] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f57359fd926]
[6c009d7e2d54:18795] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5735935c90]
[6c009d7e2d54:18795] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5735940b5e]
[6c009d7e2d54:18795] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18795] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18795] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18795] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18795] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f573505d083]
[6c009d7e2d54:18795] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18795] *** End of error message ***
[6c009d7e2d54:18787] *** Process received signal ***
[6c009d7e2d54:18787] Signal: Segmentation fault (11)
[6c009d7e2d54:18787] Signal code: Address not mapped (1)
[6c009d7e2d54:18787] Failing at address: 0x18
[6c009d7e2d54:18787] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0cee9c6420]
[6c009d7e2d54:18787] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0ced21e35d]
[6c009d7e2d54:18787] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0ced22247d]
[6c009d7e2d54:18787] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0ced22d926]
[6c009d7e2d54:18787] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0ced165c90]
[6c009d7e2d54:18787] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0ced170b5e]
[6c009d7e2d54:18787] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18787] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18787] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18787] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18787] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0cec88d083]
[6c009d7e2d54:18787] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18787] *** End of error message ***
[6c009d7e2d54:18790] *** Process received signal ***
[6c009d7e2d54:18790] Signal: Segmentation fault (11)
[6c009d7e2d54:18790] Signal code: Address not mapped (1)
[6c009d7e2d54:18790] Failing at address: 0x18
[6c009d7e2d54:18790] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0b89712420]
[6c009d7e2d54:18790] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0b87f6a35d]
[6c009d7e2d54:18790] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0b87f6e47d]
[6c009d7e2d54:18790] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0b87f79926]
[6c009d7e2d54:18790] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0b87eb1c90]
[6c009d7e2d54:18790] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0b87ebcb5e]
[6c009d7e2d54:18790] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18790] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18790] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18790] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18790] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0b875d9083]
[6c009d7e2d54:18790] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18790] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 0 with PID 0 on node 6c009d7e2d54 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

[6c009d7e2d54:18784] *** Process received signal ***
[6c009d7e2d54:18784] Signal: Segmentation fault (11)
[6c009d7e2d54:18784] Signal code: Address not mapped (1)
[6c009d7e2d54:18784] Failing at address: 0x18
[6c009d7e2d54:18784] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f25ee635420]
[6c009d7e2d54:18784] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f25ece8d35d]
[6c009d7e2d54:18784] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f25ece9147d]
[6c009d7e2d54:18784] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f25ece9c926]
[6c009d7e2d54:18784] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f25ecdd4c90]
[6c009d7e2d54:18784] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f25ecddfb5e]
[6c009d7e2d54:18784] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18784] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18784] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18784] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18784] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f25ec4fc083]
[6c009d7e2d54:18784] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18784] *** End of error message ***
[6c009d7e2d54:18795] *** Process received signal ***
[6c009d7e2d54:18795] Signal: Segmentation fault (11)
[6c009d7e2d54:18795] Signal code: Address not mapped (1)
[6c009d7e2d54:18795] Failing at address: 0x18
[6c009d7e2d54:18795] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5737196420]
[6c009d7e2d54:18795] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f57359ee35d]
[6c009d7e2d54:18795] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f57359f247d]
[6c009d7e2d54:18795] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f57359fd926]
[6c009d7e2d54:18795] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5735935c90]
[6c009d7e2d54:18795] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5735940b5e]
[6c009d7e2d54:18795] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18795] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18795] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18795] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18795] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f573505d083]
[6c009d7e2d54:18795] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18795] *** End of error message ***
[6c009d7e2d54:18787] *** Process received signal ***
[6c009d7e2d54:18787] Signal: Segmentation fault (11)
[6c009d7e2d54:18787] Signal code: Address not mapped (1)
[6c009d7e2d54:18787] Failing at address: 0x18
[6c009d7e2d54:18787] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0cee9c6420]
[6c009d7e2d54:18787] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0ced21e35d]
[6c009d7e2d54:18787] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0ced22247d]
[6c009d7e2d54:18787] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0ced22d926]
[6c009d7e2d54:18787] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0ced165c90]
[6c009d7e2d54:18787] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0ced170b5e]
[6c009d7e2d54:18787] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18787] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18787] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18787] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18787] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0cec88d083]
[6c009d7e2d54:18787] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18787] *** End of error message ***
[6c009d7e2d54:18790] *** Process received signal ***
[6c009d7e2d54:18790] Signal: Segmentation fault (11)
[6c009d7e2d54:18790] Signal code: Address not mapped (1)
[6c009d7e2d54:18790] Failing at address: 0x18
[6c009d7e2d54:18790] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0b89712420]
[6c009d7e2d54:18790] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0b87f6a35d]
[6c009d7e2d54:18790] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0b87f6e47d]
[6c009d7e2d54:18790] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0b87f79926]
[6c009d7e2d54:18790] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0b87eb1c90]
[6c009d7e2d54:18790] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0b87ebcb5e]
[6c009d7e2d54:18790] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x332315b]
[6c009d7e2d54:18790] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e18c]
[6c009d7e2d54:18790] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330e0b8]
[6c009d7e2d54:18790] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33086b2]
[6c009d7e2d54:18790] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0b875d9083]
[6c009d7e2d54:18790] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d92e]
[6c009d7e2d54:18790] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 0 with PID 0 on node 6c009d7e2d54 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------