Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[8ec9c67b5d7f:18299] *** Process received signal *** [8ec9c67b5d7f:18299] Signal: Segmentation fault (11) [8ec9c67b5d7f:18299] Signal code: Address not mapped (1) [8ec9c67b5d7f:18299] Failing at address: 0x18 [8ec9c67b5d7f:18299] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f05ecdfc420] [8ec9c67b5d7f:18299] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f05eb65435d] [8ec9c67b5d7f:18299] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f05eb65847d] [8ec9c67b5d7f:18299] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f05eb663926] [8ec9c67b5d7f:18299] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f05eb59bc90] [8ec9c67b5d7f:18299] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f05eb5a6b5e] [8ec9c67b5d7f:18299] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18299] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18299] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18299] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18299] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f05eacc3083] [8ec9c67b5d7f:18299] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18299] *** End of error message *** [8ec9c67b5d7f:18302] *** Process received signal *** [8ec9c67b5d7f:18302] Signal: Segmentation fault (11) [8ec9c67b5d7f:18302] Signal code: Address not mapped (1) [8ec9c67b5d7f:18302] Failing at address: 0x18 [8ec9c67b5d7f:18302] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f00262de420] [8ec9c67b5d7f:18302] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0024b3635d] [8ec9c67b5d7f:18302] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0024b3a47d] [8ec9c67b5d7f:18302] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0024b45926] [8ec9c67b5d7f:18302] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0024a7dc90] [8ec9c67b5d7f:18302] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0024a88b5e] [8ec9c67b5d7f:18302] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18302] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18302] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18302] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18302] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f00241a5083] [8ec9c67b5d7f:18302] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18302] *** End of error message *** [8ec9c67b5d7f:18310] *** Process received signal *** [8ec9c67b5d7f:18310] Signal: Segmentation fault (11) [8ec9c67b5d7f:18310] Signal code: Address not mapped (1) [8ec9c67b5d7f:18310] Failing at address: 0x18 [8ec9c67b5d7f:18310] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7efd7be2e420] [8ec9c67b5d7f:18310] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7efd7a68635d] [8ec9c67b5d7f:18310] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7efd7a68a47d] [8ec9c67b5d7f:18310] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7efd7a695926] [8ec9c67b5d7f:18310] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7efd7a5cdc90] [8ec9c67b5d7f:18310] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7efd7a5d8b5e] [8ec9c67b5d7f:18310] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18310] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18310] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18310] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18310] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7efd79cf5083] [8ec9c67b5d7f:18310] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18310] *** End of error message *** [8ec9c67b5d7f:18305] *** Process received signal *** [8ec9c67b5d7f:18305] Signal: Segmentation fault (11) [8ec9c67b5d7f:18305] Signal code: Address not mapped (1) [8ec9c67b5d7f:18305] Failing at address: 0x18 [8ec9c67b5d7f:18305] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c6b38f420] [8ec9c67b5d7f:18305] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c69be735d] [8ec9c67b5d7f:18305] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c69beb47d] [8ec9c67b5d7f:18305] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c69bf6926] [8ec9c67b5d7f:18305] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c69b2ec90] [8ec9c67b5d7f:18305] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c69b39b5e] [8ec9c67b5d7f:18305] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18305] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18305] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18305] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18305] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c69256083] [8ec9c67b5d7f:18305] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18305] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 0 with PID 0 on node 8ec9c67b5d7f exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[8ec9c67b5d7f:18299] *** Process received signal *** [8ec9c67b5d7f:18299] Signal: Segmentation fault (11) [8ec9c67b5d7f:18299] Signal code: Address not mapped (1) [8ec9c67b5d7f:18299] Failing at address: 0x18 [8ec9c67b5d7f:18299] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f05ecdfc420] [8ec9c67b5d7f:18299] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f05eb65435d] [8ec9c67b5d7f:18299] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f05eb65847d] [8ec9c67b5d7f:18299] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f05eb663926] [8ec9c67b5d7f:18299] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f05eb59bc90] [8ec9c67b5d7f:18299] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f05eb5a6b5e] [8ec9c67b5d7f:18299] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18299] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18299] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18299] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18299] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f05eacc3083] [8ec9c67b5d7f:18299] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18299] *** End of error message *** [8ec9c67b5d7f:18302] *** Process received signal *** [8ec9c67b5d7f:18302] Signal: Segmentation fault (11) [8ec9c67b5d7f:18302] Signal code: Address not mapped (1) [8ec9c67b5d7f:18302] Failing at address: 0x18 [8ec9c67b5d7f:18302] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f00262de420] [8ec9c67b5d7f:18302] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0024b3635d] [8ec9c67b5d7f:18302] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0024b3a47d] [8ec9c67b5d7f:18302] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0024b45926] [8ec9c67b5d7f:18302] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0024a7dc90] [8ec9c67b5d7f:18302] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0024a88b5e] [8ec9c67b5d7f:18302] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18302] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18302] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18302] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18302] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f00241a5083] [8ec9c67b5d7f:18302] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18302] *** End of error message *** [8ec9c67b5d7f:18310] *** Process received signal *** [8ec9c67b5d7f:18310] Signal: Segmentation fault (11) [8ec9c67b5d7f:18310] Signal code: Address not mapped (1) [8ec9c67b5d7f:18310] Failing at address: 0x18 [8ec9c67b5d7f:18310] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7efd7be2e420] [8ec9c67b5d7f:18310] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7efd7a68635d] [8ec9c67b5d7f:18310] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7efd7a68a47d] [8ec9c67b5d7f:18310] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7efd7a695926] [8ec9c67b5d7f:18310] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7efd7a5cdc90] [8ec9c67b5d7f:18310] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7efd7a5d8b5e] [8ec9c67b5d7f:18310] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18310] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18310] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18310] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18310] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7efd79cf5083] [8ec9c67b5d7f:18310] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18310] *** End of error message *** [8ec9c67b5d7f:18305] *** Process received signal *** [8ec9c67b5d7f:18305] Signal: Segmentation fault (11) [8ec9c67b5d7f:18305] Signal code: Address not mapped (1) [8ec9c67b5d7f:18305] Failing at address: 0x18 [8ec9c67b5d7f:18305] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c6b38f420] [8ec9c67b5d7f:18305] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c69be735d] [8ec9c67b5d7f:18305] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c69beb47d] [8ec9c67b5d7f:18305] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c69bf6926] [8ec9c67b5d7f:18305] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c69b2ec90] [8ec9c67b5d7f:18305] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c69b39b5e] [8ec9c67b5d7f:18305] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [8ec9c67b5d7f:18305] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [8ec9c67b5d7f:18305] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [8ec9c67b5d7f:18305] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [8ec9c67b5d7f:18305] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c69256083] [8ec9c67b5d7f:18305] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [8ec9c67b5d7f:18305] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 0 with PID 0 on node 8ec9c67b5d7f exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------