Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[e140bc562587:18428] *** Process received signal *** [e140bc562587:18428] Signal: Segmentation fault (11) [e140bc562587:18428] Signal code: Address not mapped (1) [e140bc562587:18428] Failing at address: 0x18 [e140bc562587:18428] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9abfdc8420] [e140bc562587:18428] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9abe62035d] [e140bc562587:18428] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9abe62447d] [e140bc562587:18428] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9abe62f926] [e140bc562587:18428] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9abe567c90] [e140bc562587:18428] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9abe572b5e] [e140bc562587:18428] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18428] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18428] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18428] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18428] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9abdc8f083] [e140bc562587:18428] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18428] *** End of error message *** [e140bc562587:18417] *** Process received signal *** [e140bc562587:18417] Signal: Segmentation fault (11) [e140bc562587:18417] Signal code: Address not mapped (1) [e140bc562587:18417] Failing at address: 0x18 [e140bc562587:18417] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f15f79ad420] [e140bc562587:18417] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f15f620535d] [e140bc562587:18417] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f15f620947d] [e140bc562587:18417] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f15f6214926] [e140bc562587:18417] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f15f614cc90] [e140bc562587:18417] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f15f6157b5e] [e140bc562587:18417] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18417] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18417] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18417] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18417] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f15f5874083] [e140bc562587:18417] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18417] *** End of error message *** [e140bc562587:18420] *** Process received signal *** [e140bc562587:18420] Signal: Segmentation fault (11) [e140bc562587:18420] Signal code: Address not mapped (1) [e140bc562587:18420] Failing at address: 0x18 [e140bc562587:18420] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0a29eab420] [e140bc562587:18420] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0a2870335d] [e140bc562587:18420] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0a2870747d] [e140bc562587:18420] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0a28712926] [e140bc562587:18420] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0a2864ac90] [e140bc562587:18420] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0a28655b5e] [e140bc562587:18420] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18420] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18420] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18420] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18420] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0a27d72083] [e140bc562587:18420] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18420] *** End of error message *** [e140bc562587:18423] *** Process received signal *** [e140bc562587:18423] Signal: Segmentation fault (11) [e140bc562587:18423] Signal code: Address not mapped (1) [e140bc562587:18423] Failing at address: 0x18 [e140bc562587:18423] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f541cc35420] [e140bc562587:18423] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f541b48d35d] [e140bc562587:18423] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f541b49147d] [e140bc562587:18423] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f541b49c926] [e140bc562587:18423] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f541b3d4c90] [e140bc562587:18423] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f541b3dfb5e] [e140bc562587:18423] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18423] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18423] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18423] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18423] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f541aafc083] [e140bc562587:18423] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18423] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[e140bc562587:18428] *** Process received signal *** [e140bc562587:18428] Signal: Segmentation fault (11) [e140bc562587:18428] Signal code: Address not mapped (1) [e140bc562587:18428] Failing at address: 0x18 [e140bc562587:18428] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9abfdc8420] [e140bc562587:18428] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9abe62035d] [e140bc562587:18428] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9abe62447d] [e140bc562587:18428] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9abe62f926] [e140bc562587:18428] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9abe567c90] [e140bc562587:18428] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9abe572b5e] [e140bc562587:18428] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18428] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18428] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18428] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18428] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9abdc8f083] [e140bc562587:18428] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18428] *** End of error message *** [e140bc562587:18417] *** Process received signal *** [e140bc562587:18417] Signal: Segmentation fault (11) [e140bc562587:18417] Signal code: Address not mapped (1) [e140bc562587:18417] Failing at address: 0x18 [e140bc562587:18417] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f15f79ad420] [e140bc562587:18417] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f15f620535d] [e140bc562587:18417] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f15f620947d] [e140bc562587:18417] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f15f6214926] [e140bc562587:18417] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f15f614cc90] [e140bc562587:18417] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f15f6157b5e] [e140bc562587:18417] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18417] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18417] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18417] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18417] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f15f5874083] [e140bc562587:18417] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18417] *** End of error message *** [e140bc562587:18420] *** Process received signal *** [e140bc562587:18420] Signal: Segmentation fault (11) [e140bc562587:18420] Signal code: Address not mapped (1) [e140bc562587:18420] Failing at address: 0x18 [e140bc562587:18420] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0a29eab420] [e140bc562587:18420] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0a2870335d] [e140bc562587:18420] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0a2870747d] [e140bc562587:18420] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0a28712926] [e140bc562587:18420] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0a2864ac90] [e140bc562587:18420] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0a28655b5e] [e140bc562587:18420] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18420] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18420] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18420] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18420] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0a27d72083] [e140bc562587:18420] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18420] *** End of error message *** [e140bc562587:18423] *** Process received signal *** [e140bc562587:18423] Signal: Segmentation fault (11) [e140bc562587:18423] Signal code: Address not mapped (1) [e140bc562587:18423] Failing at address: 0x18 [e140bc562587:18423] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f541cc35420] [e140bc562587:18423] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f541b48d35d] [e140bc562587:18423] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f541b49147d] [e140bc562587:18423] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f541b49c926] [e140bc562587:18423] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f541b3d4c90] [e140bc562587:18423] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f541b3dfb5e] [e140bc562587:18423] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb] [e140bc562587:18423] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc] [e140bc562587:18423] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328] [e140bc562587:18423] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922] [e140bc562587:18423] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f541aafc083] [e140bc562587:18423] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe] [e140bc562587:18423] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------