Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[54febd312b64:18277] *** Process received signal *** [54febd312b64:18277] Signal: Segmentation fault (11) [54febd312b64:18277] Signal code: Address not mapped (1) [54febd312b64:18277] Failing at address: 0x18 [54febd312b64:18277] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa92389f420] [54febd312b64:18277] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa9220f735d] [54febd312b64:18277] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa9220fb47d] [54febd312b64:18277] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa922106926] [54febd312b64:18277] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa92203ec90] [54febd312b64:18277] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa922049b5e] [54febd312b64:18277] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18277] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18277] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18277] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18277] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa921766083] [54febd312b64:18277] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18277] *** End of error message *** [54febd312b64:18280] *** Process received signal *** [54febd312b64:18280] Signal: Segmentation fault (11) [54febd312b64:18280] Signal code: Address not mapped (1) [54febd312b64:18280] Failing at address: 0x18 [54febd312b64:18280] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f7df75ae420] [54febd312b64:18280] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f7df5e0635d] [54febd312b64:18280] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f7df5e0a47d] [54febd312b64:18280] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f7df5e15926] [54febd312b64:18280] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f7df5d4dc90] [54febd312b64:18280] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f7df5d58b5e] [54febd312b64:18280] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18280] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18280] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18280] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18280] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f7df5475083] [54febd312b64:18280] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18280] *** End of error message *** [54febd312b64:18288] *** Process received signal *** [54febd312b64:18288] Signal: Segmentation fault (11) [54febd312b64:18288] Signal code: Address not mapped (1) [54febd312b64:18288] Failing at address: 0x18 [54febd312b64:18288] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff42aea0420] [54febd312b64:18288] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff4296f835d] [54febd312b64:18288] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff4296fc47d] [54febd312b64:18288] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff429707926] [54febd312b64:18288] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff42963fc90] [54febd312b64:18288] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff42964ab5e] [54febd312b64:18288] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18288] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18288] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18288] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18288] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff428d67083] [54febd312b64:18288] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18288] *** End of error message *** [54febd312b64:18283] *** Process received signal *** [54febd312b64:18283] Signal: Segmentation fault (11) [54febd312b64:18283] Signal code: Address not mapped (1) [54febd312b64:18283] Failing at address: 0x18 [54febd312b64:18283] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c3e4d1420] [54febd312b64:18283] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c3cd2935d] [54febd312b64:18283] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c3cd2d47d] [54febd312b64:18283] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c3cd38926] [54febd312b64:18283] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c3cc70c90] [54febd312b64:18283] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c3cc7bb5e] [54febd312b64:18283] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18283] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18283] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18283] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18283] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c3c398083] [54febd312b64:18283] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18283] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 0 with PID 0 on node 54febd312b64 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[54febd312b64:18277] *** Process received signal *** [54febd312b64:18277] Signal: Segmentation fault (11) [54febd312b64:18277] Signal code: Address not mapped (1) [54febd312b64:18277] Failing at address: 0x18 [54febd312b64:18277] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa92389f420] [54febd312b64:18277] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa9220f735d] [54febd312b64:18277] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa9220fb47d] [54febd312b64:18277] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa922106926] [54febd312b64:18277] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa92203ec90] [54febd312b64:18277] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa922049b5e] [54febd312b64:18277] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18277] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18277] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18277] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18277] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa921766083] [54febd312b64:18277] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18277] *** End of error message *** [54febd312b64:18280] *** Process received signal *** [54febd312b64:18280] Signal: Segmentation fault (11) [54febd312b64:18280] Signal code: Address not mapped (1) [54febd312b64:18280] Failing at address: 0x18 [54febd312b64:18280] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f7df75ae420] [54febd312b64:18280] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f7df5e0635d] [54febd312b64:18280] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f7df5e0a47d] [54febd312b64:18280] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f7df5e15926] [54febd312b64:18280] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f7df5d4dc90] [54febd312b64:18280] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f7df5d58b5e] [54febd312b64:18280] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18280] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18280] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18280] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18280] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f7df5475083] [54febd312b64:18280] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18280] *** End of error message *** [54febd312b64:18288] *** Process received signal *** [54febd312b64:18288] Signal: Segmentation fault (11) [54febd312b64:18288] Signal code: Address not mapped (1) [54febd312b64:18288] Failing at address: 0x18 [54febd312b64:18288] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff42aea0420] [54febd312b64:18288] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff4296f835d] [54febd312b64:18288] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff4296fc47d] [54febd312b64:18288] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff429707926] [54febd312b64:18288] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff42963fc90] [54febd312b64:18288] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff42964ab5e] [54febd312b64:18288] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18288] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18288] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18288] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18288] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff428d67083] [54febd312b64:18288] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18288] *** End of error message *** [54febd312b64:18283] *** Process received signal *** [54febd312b64:18283] Signal: Segmentation fault (11) [54febd312b64:18283] Signal code: Address not mapped (1) [54febd312b64:18283] Failing at address: 0x18 [54febd312b64:18283] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c3e4d1420] [54febd312b64:18283] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c3cd2935d] [54febd312b64:18283] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c3cd2d47d] [54febd312b64:18283] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c3cd38926] [54febd312b64:18283] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c3cc70c90] [54febd312b64:18283] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c3cc7bb5e] [54febd312b64:18283] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213ab] [54febd312b64:18283] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3dc] [54febd312b64:18283] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c308] [54febd312b64:18283] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306902] [54febd312b64:18283] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c3c398083] [54febd312b64:18283] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [54febd312b64:18283] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 0 with PID 0 on node 54febd312b64 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------