Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[1effbede40a4:26652] *** Process received signal *** [1effbede40a4:26652] Signal: Segmentation fault (11) [1effbede40a4:26652] Signal code: Address not mapped (1) [1effbede40a4:26652] Failing at address: 0x18 [1effbede40a4:26652] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fea7e0b2420] [1effbede40a4:26652] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fea7c90a35d] [1effbede40a4:26652] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fea7c90e47d] [1effbede40a4:26652] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fea7c919926] [1effbede40a4:26652] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fea7c851c90] [1effbede40a4:26652] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fea7c85cb5e] [1effbede40a4:26652] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26652] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26652] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26652] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26652] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fea7bf79083] [1effbede40a4:26652] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26652] *** End of error message *** [1effbede40a4:26644] *** Process received signal *** [1effbede40a4:26644] Signal: Segmentation fault (11) [1effbede40a4:26644] Signal code: Address not mapped (1) [1effbede40a4:26644] Failing at address: 0x18 [1effbede40a4:26644] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fecc35e8420] [1effbede40a4:26644] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fecc1e4035d] [1effbede40a4:26644] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fecc1e4447d] [1effbede40a4:26644] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fecc1e4f926] [1effbede40a4:26644] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fecc1d87c90] [1effbede40a4:26644] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fecc1d92b5e] [1effbede40a4:26644] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26644] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26644] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26644] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26644] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fecc14af083] [1effbede40a4:26644] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26644] *** End of error message *** [1effbede40a4:26647] *** Process received signal *** [1effbede40a4:26647] Signal: Segmentation fault (11) [1effbede40a4:26647] Signal code: Address not mapped (1) [1effbede40a4:26647] Failing at address: 0x18 [1effbede40a4:26647] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f6ea88fc420] [1effbede40a4:26647] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f6ea715435d] [1effbede40a4:26647] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f6ea715847d] [1effbede40a4:26647] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f6ea7163926] [1effbede40a4:26647] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f6ea709bc90] [1effbede40a4:26647] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f6ea70a6b5e] [1effbede40a4:26647] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26647] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26647] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26647] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26647] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f6ea67c3083] [1effbede40a4:26647] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26647] *** End of error message *** [1effbede40a4:26655] *** Process received signal *** [1effbede40a4:26655] Signal: Segmentation fault (11) [1effbede40a4:26655] Signal code: Address not mapped (1) [1effbede40a4:26655] Failing at address: 0x18 [1effbede40a4:26655] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f7a8cade420] [1effbede40a4:26655] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f7a8b33635d] [1effbede40a4:26655] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f7a8b33a47d] [1effbede40a4:26655] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f7a8b345926] [1effbede40a4:26655] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f7a8b27dc90] [1effbede40a4:26655] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f7a8b288b5e] [1effbede40a4:26655] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26655] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26655] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26655] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26655] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f7a8a9a5083] [1effbede40a4:26655] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26655] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 1effbede40a4 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[1effbede40a4:26652] *** Process received signal *** [1effbede40a4:26652] Signal: Segmentation fault (11) [1effbede40a4:26652] Signal code: Address not mapped (1) [1effbede40a4:26652] Failing at address: 0x18 [1effbede40a4:26652] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fea7e0b2420] [1effbede40a4:26652] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fea7c90a35d] [1effbede40a4:26652] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fea7c90e47d] [1effbede40a4:26652] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fea7c919926] [1effbede40a4:26652] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fea7c851c90] [1effbede40a4:26652] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fea7c85cb5e] [1effbede40a4:26652] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26652] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26652] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26652] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26652] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fea7bf79083] [1effbede40a4:26652] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26652] *** End of error message *** [1effbede40a4:26644] *** Process received signal *** [1effbede40a4:26644] Signal: Segmentation fault (11) [1effbede40a4:26644] Signal code: Address not mapped (1) [1effbede40a4:26644] Failing at address: 0x18 [1effbede40a4:26644] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fecc35e8420] [1effbede40a4:26644] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fecc1e4035d] [1effbede40a4:26644] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fecc1e4447d] [1effbede40a4:26644] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fecc1e4f926] [1effbede40a4:26644] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fecc1d87c90] [1effbede40a4:26644] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fecc1d92b5e] [1effbede40a4:26644] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26644] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26644] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26644] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26644] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fecc14af083] [1effbede40a4:26644] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26644] *** End of error message *** [1effbede40a4:26647] *** Process received signal *** [1effbede40a4:26647] Signal: Segmentation fault (11) [1effbede40a4:26647] Signal code: Address not mapped (1) [1effbede40a4:26647] Failing at address: 0x18 [1effbede40a4:26647] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f6ea88fc420] [1effbede40a4:26647] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f6ea715435d] [1effbede40a4:26647] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f6ea715847d] [1effbede40a4:26647] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f6ea7163926] [1effbede40a4:26647] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f6ea709bc90] [1effbede40a4:26647] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f6ea70a6b5e] [1effbede40a4:26647] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26647] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26647] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26647] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26647] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f6ea67c3083] [1effbede40a4:26647] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26647] *** End of error message *** [1effbede40a4:26655] *** Process received signal *** [1effbede40a4:26655] Signal: Segmentation fault (11) [1effbede40a4:26655] Signal code: Address not mapped (1) [1effbede40a4:26655] Failing at address: 0x18 [1effbede40a4:26655] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f7a8cade420] [1effbede40a4:26655] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f7a8b33635d] [1effbede40a4:26655] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f7a8b33a47d] [1effbede40a4:26655] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f7a8b345926] [1effbede40a4:26655] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f7a8b27dc90] [1effbede40a4:26655] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f7a8b288b5e] [1effbede40a4:26655] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a7592b] [1effbede40a4:26655] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a6095c] [1effbede40a4:26655] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a60888] [1effbede40a4:26655] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3a5ae82] [1effbede40a4:26655] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f7a8a9a5083] [1effbede40a4:26655] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x2f43f0e] [1effbede40a4:26655] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 1effbede40a4 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------