Skip to content

Regression

Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)

Failing for the past 1 build (Since Failed #51 )
Took 13 sec.

Stacktrace

[e140bc562587:18428] *** Process received signal ***
[e140bc562587:18428] Signal: Segmentation fault (11)
[e140bc562587:18428] Signal code: Address not mapped (1)
[e140bc562587:18428] Failing at address: 0x18
[e140bc562587:18428] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9abfdc8420]
[e140bc562587:18428] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9abe62035d]
[e140bc562587:18428] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9abe62447d]
[e140bc562587:18428] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9abe62f926]
[e140bc562587:18428] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9abe567c90]
[e140bc562587:18428] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9abe572b5e]
[e140bc562587:18428] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18428] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18428] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18428] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18428] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9abdc8f083]
[e140bc562587:18428] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18428] *** End of error message ***
[e140bc562587:18417] *** Process received signal ***
[e140bc562587:18417] Signal: Segmentation fault (11)
[e140bc562587:18417] Signal code: Address not mapped (1)
[e140bc562587:18417] Failing at address: 0x18
[e140bc562587:18417] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f15f79ad420]
[e140bc562587:18417] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f15f620535d]
[e140bc562587:18417] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f15f620947d]
[e140bc562587:18417] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f15f6214926]
[e140bc562587:18417] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f15f614cc90]
[e140bc562587:18417] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f15f6157b5e]
[e140bc562587:18417] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18417] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18417] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18417] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18417] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f15f5874083]
[e140bc562587:18417] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18417] *** End of error message ***
[e140bc562587:18420] *** Process received signal ***
[e140bc562587:18420] Signal: Segmentation fault (11)
[e140bc562587:18420] Signal code: Address not mapped (1)
[e140bc562587:18420] Failing at address: 0x18
[e140bc562587:18420] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0a29eab420]
[e140bc562587:18420] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0a2870335d]
[e140bc562587:18420] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0a2870747d]
[e140bc562587:18420] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0a28712926]
[e140bc562587:18420] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0a2864ac90]
[e140bc562587:18420] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0a28655b5e]
[e140bc562587:18420] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18420] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18420] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18420] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18420] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0a27d72083]
[e140bc562587:18420] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18420] *** End of error message ***
[e140bc562587:18423] *** Process received signal ***
[e140bc562587:18423] Signal: Segmentation fault (11)
[e140bc562587:18423] Signal code: Address not mapped (1)
[e140bc562587:18423] Failing at address: 0x18
[e140bc562587:18423] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f541cc35420]
[e140bc562587:18423] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f541b48d35d]
[e140bc562587:18423] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f541b49147d]
[e140bc562587:18423] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f541b49c926]
[e140bc562587:18423] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f541b3d4c90]
[e140bc562587:18423] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f541b3dfb5e]
[e140bc562587:18423] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18423] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18423] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18423] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18423] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f541aafc083]
[e140bc562587:18423] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18423] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 3 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

[e140bc562587:18428] *** Process received signal ***
[e140bc562587:18428] Signal: Segmentation fault (11)
[e140bc562587:18428] Signal code: Address not mapped (1)
[e140bc562587:18428] Failing at address: 0x18
[e140bc562587:18428] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9abfdc8420]
[e140bc562587:18428] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9abe62035d]
[e140bc562587:18428] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9abe62447d]
[e140bc562587:18428] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9abe62f926]
[e140bc562587:18428] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9abe567c90]
[e140bc562587:18428] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9abe572b5e]
[e140bc562587:18428] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18428] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18428] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18428] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18428] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9abdc8f083]
[e140bc562587:18428] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18428] *** End of error message ***
[e140bc562587:18417] *** Process received signal ***
[e140bc562587:18417] Signal: Segmentation fault (11)
[e140bc562587:18417] Signal code: Address not mapped (1)
[e140bc562587:18417] Failing at address: 0x18
[e140bc562587:18417] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f15f79ad420]
[e140bc562587:18417] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f15f620535d]
[e140bc562587:18417] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f15f620947d]
[e140bc562587:18417] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f15f6214926]
[e140bc562587:18417] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f15f614cc90]
[e140bc562587:18417] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f15f6157b5e]
[e140bc562587:18417] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18417] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18417] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18417] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18417] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f15f5874083]
[e140bc562587:18417] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18417] *** End of error message ***
[e140bc562587:18420] *** Process received signal ***
[e140bc562587:18420] Signal: Segmentation fault (11)
[e140bc562587:18420] Signal code: Address not mapped (1)
[e140bc562587:18420] Failing at address: 0x18
[e140bc562587:18420] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f0a29eab420]
[e140bc562587:18420] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f0a2870335d]
[e140bc562587:18420] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f0a2870747d]
[e140bc562587:18420] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f0a28712926]
[e140bc562587:18420] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f0a2864ac90]
[e140bc562587:18420] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f0a28655b5e]
[e140bc562587:18420] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18420] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18420] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18420] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18420] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0a27d72083]
[e140bc562587:18420] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18420] *** End of error message ***
[e140bc562587:18423] *** Process received signal ***
[e140bc562587:18423] Signal: Segmentation fault (11)
[e140bc562587:18423] Signal code: Address not mapped (1)
[e140bc562587:18423] Failing at address: 0x18
[e140bc562587:18423] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f541cc35420]
[e140bc562587:18423] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f541b48d35d]
[e140bc562587:18423] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f541b49147d]
[e140bc562587:18423] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f541b49c926]
[e140bc562587:18423] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f541b3d4c90]
[e140bc562587:18423] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f541b3dfb5e]
[e140bc562587:18423] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e140bc562587:18423] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e140bc562587:18423] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e140bc562587:18423] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e140bc562587:18423] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f541aafc083]
[e140bc562587:18423] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e140bc562587:18423] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 3 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------