Skip to content

Regression

Build / HIP-5.6 / projectroot.test.ArborX_Test_DistributedTree (from CTest)

Failing for the past 1 build (Since Failed #52 )
Took 13 sec.

Stacktrace

[e621f6f40f56:18434] *** Process received signal ***
[e621f6f40f56:18434] Signal: Segmentation fault (11)
[e621f6f40f56:18434] Signal code: Address not mapped (1)
[e621f6f40f56:18434] Failing at address: 0x18
[e621f6f40f56:18434] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fdf0a370420]
[e621f6f40f56:18434] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fdf08bc835d]
[e621f6f40f56:18434] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fdf08bcc47d]
[e621f6f40f56:18434] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fdf08bd7926]
[e621f6f40f56:18434] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fdf08b0fc90]
[e621f6f40f56:18434] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fdf08b1ab5e]
[e621f6f40f56:18434] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18434] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18434] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18434] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18434] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fdf08237083]
[e621f6f40f56:18434] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18434] *** End of error message ***
[e621f6f40f56:18431] *** Process received signal ***
[e621f6f40f56:18431] Signal: Segmentation fault (11)
[e621f6f40f56:18431] Signal code: Address not mapped (1)
[e621f6f40f56:18431] Failing at address: 0x18
[e621f6f40f56:18431] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f74dc3a0420]
[e621f6f40f56:18431] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f74dabf835d]
[e621f6f40f56:18431] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f74dabfc47d]
[e621f6f40f56:18431] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f74dac07926]
[e621f6f40f56:18431] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f74dab3fc90]
[e621f6f40f56:18431] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f74dab4ab5e]
[e621f6f40f56:18431] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18431] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18431] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18431] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18431] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f74da267083]
[e621f6f40f56:18431] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18431] *** End of error message ***
[e621f6f40f56:18439] *** Process received signal ***
[e621f6f40f56:18439] Signal: Segmentation fault (11)
[e621f6f40f56:18439] Signal code: Address not mapped (1)
[e621f6f40f56:18439] Failing at address: 0x18
[e621f6f40f56:18439] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fd391e9e420]
[e621f6f40f56:18439] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fd3906f635d]
[e621f6f40f56:18439] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fd3906fa47d]
[e621f6f40f56:18439] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fd390705926]
[e621f6f40f56:18439] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fd39063dc90]
[e621f6f40f56:18439] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fd390648b5e]
[e621f6f40f56:18439] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18439] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18439] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18439] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18439] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fd38fd65083]
[e621f6f40f56:18439] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18439] *** End of error message ***
[e621f6f40f56:18442] *** Process received signal ***
[e621f6f40f56:18442] Signal: Segmentation fault (11)
[e621f6f40f56:18442] Signal code: Address not mapped (1)
[e621f6f40f56:18442] Failing at address: 0x18
[e621f6f40f56:18442] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f98abb63420]
[e621f6f40f56:18442] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f98aa3bb35d]
[e621f6f40f56:18442] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f98aa3bf47d]
[e621f6f40f56:18442] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f98aa3ca926]
[e621f6f40f56:18442] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f98aa302c90]
[e621f6f40f56:18442] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f98aa30db5e]
[e621f6f40f56:18442] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18442] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18442] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18442] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18442] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f98a9a2a083]
[e621f6f40f56:18442] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18442] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 1 with PID 0 on node e621f6f40f56 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

[e621f6f40f56:18434] *** Process received signal ***
[e621f6f40f56:18434] Signal: Segmentation fault (11)
[e621f6f40f56:18434] Signal code: Address not mapped (1)
[e621f6f40f56:18434] Failing at address: 0x18
[e621f6f40f56:18434] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fdf0a370420]
[e621f6f40f56:18434] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fdf08bc835d]
[e621f6f40f56:18434] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fdf08bcc47d]
[e621f6f40f56:18434] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fdf08bd7926]
[e621f6f40f56:18434] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fdf08b0fc90]
[e621f6f40f56:18434] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fdf08b1ab5e]
[e621f6f40f56:18434] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18434] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18434] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18434] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18434] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fdf08237083]
[e621f6f40f56:18434] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18434] *** End of error message ***
[e621f6f40f56:18431] *** Process received signal ***
[e621f6f40f56:18431] Signal: Segmentation fault (11)
[e621f6f40f56:18431] Signal code: Address not mapped (1)
[e621f6f40f56:18431] Failing at address: 0x18
[e621f6f40f56:18431] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f74dc3a0420]
[e621f6f40f56:18431] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f74dabf835d]
[e621f6f40f56:18431] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f74dabfc47d]
[e621f6f40f56:18431] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f74dac07926]
[e621f6f40f56:18431] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f74dab3fc90]
[e621f6f40f56:18431] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f74dab4ab5e]
[e621f6f40f56:18431] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18431] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18431] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18431] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18431] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f74da267083]
[e621f6f40f56:18431] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18431] *** End of error message ***
[e621f6f40f56:18439] *** Process received signal ***
[e621f6f40f56:18439] Signal: Segmentation fault (11)
[e621f6f40f56:18439] Signal code: Address not mapped (1)
[e621f6f40f56:18439] Failing at address: 0x18
[e621f6f40f56:18439] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fd391e9e420]
[e621f6f40f56:18439] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fd3906f635d]
[e621f6f40f56:18439] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fd3906fa47d]
[e621f6f40f56:18439] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fd390705926]
[e621f6f40f56:18439] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fd39063dc90]
[e621f6f40f56:18439] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fd390648b5e]
[e621f6f40f56:18439] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18439] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18439] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18439] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18439] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fd38fd65083]
[e621f6f40f56:18439] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18439] *** End of error message ***
[e621f6f40f56:18442] *** Process received signal ***
[e621f6f40f56:18442] Signal: Segmentation fault (11)
[e621f6f40f56:18442] Signal code: Address not mapped (1)
[e621f6f40f56:18442] Failing at address: 0x18
[e621f6f40f56:18442] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f98abb63420]
[e621f6f40f56:18442] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f98aa3bb35d]
[e621f6f40f56:18442] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f98aa3bf47d]
[e621f6f40f56:18442] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f98aa3ca926]
[e621f6f40f56:18442] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f98aa302c90]
[e621f6f40f56:18442] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f98aa30db5e]
[e621f6f40f56:18442] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x33213cb]
[e621f6f40f56:18442] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c3fc]
[e621f6f40f56:18442] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x330c328]
[e621f6f40f56:18442] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x3306922]
[e621f6f40f56:18442] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f98a9a2a083]
[e621f6f40f56:18442] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x288d3fe]
[e621f6f40f56:18442] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 1 with PID 0 on node e621f6f40f56 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------