Skip to content

Regression

Build / HIP-5.6 / projectroot.test.ArborX_Test_DetailsDistributedTreeImpl (from CTest)

Failing for the past 1 build (Since Failed #51 )
Took 13 sec.

Stacktrace

[e140bc562587:18482] *** Process received signal ***
[e140bc562587:18482] Signal: Segmentation fault (11)
[e140bc562587:18482] Signal code: Address not mapped (1)
[e140bc562587:18482] Failing at address: 0x18
[e140bc562587:18482] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f584580f420]
[e140bc562587:18482] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f584406735d]
[e140bc562587:18482] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f584406b47d]
[e140bc562587:18482] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5844076926]
[e140bc562587:18482] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5843faec90]
[e140bc562587:18482] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5843fb9b5e]
[e140bc562587:18482] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18482] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18482] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18482] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18482] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f58436d6083]
[e140bc562587:18482] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18482] *** End of error message ***
[e140bc562587:18479] *** Process received signal ***
[e140bc562587:18479] Signal: Segmentation fault (11)
[e140bc562587:18479] Signal code: Address not mapped (1)
[e140bc562587:18479] Failing at address: 0x18
[e140bc562587:18479] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa761552420]
[e140bc562587:18479] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa75fdaa35d]
[e140bc562587:18479] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa75fdae47d]
[e140bc562587:18479] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa75fdb9926]
[e140bc562587:18479] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa75fcf1c90]
[e140bc562587:18479] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa75fcfcb5e]
[e140bc562587:18479] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18479] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18479] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18479] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18479] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa75f419083]
[e140bc562587:18479] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18479] *** End of error message ***
[e140bc562587:18487] *** Process received signal ***
[e140bc562587:18487] Signal: Segmentation fault (11)
[e140bc562587:18487] Signal code: Address not mapped (1)
[e140bc562587:18487] Failing at address: 0x18
[e140bc562587:18487] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c1d1cf420]
[e140bc562587:18487] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c1ba2735d]
[e140bc562587:18487] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c1ba2b47d]
[e140bc562587:18487] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c1ba36926]
[e140bc562587:18487] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c1b96ec90]
[e140bc562587:18487] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c1b979b5e]
[e140bc562587:18487] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18487] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18487] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18487] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18487] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c1b096083]
[e140bc562587:18487] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18487] *** End of error message ***
[e140bc562587:18492] *** Process received signal ***
[e140bc562587:18492] Signal: Segmentation fault (11)
[e140bc562587:18492] Signal code: Address not mapped (1)
[e140bc562587:18492] Failing at address: 0x18
[e140bc562587:18492] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5b5a9fe420]
[e140bc562587:18492] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f5b5925635d]
[e140bc562587:18492] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f5b5925a47d]
[e140bc562587:18492] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5b59265926]
[e140bc562587:18492] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5b5919dc90]
[e140bc562587:18492] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5b591a8b5e]
[e140bc562587:18492] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18492] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18492] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18492] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18492] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f5b588c5083]
[e140bc562587:18492] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18492] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 1 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

[e140bc562587:18482] *** Process received signal ***
[e140bc562587:18482] Signal: Segmentation fault (11)
[e140bc562587:18482] Signal code: Address not mapped (1)
[e140bc562587:18482] Failing at address: 0x18
[e140bc562587:18482] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f584580f420]
[e140bc562587:18482] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f584406735d]
[e140bc562587:18482] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f584406b47d]
[e140bc562587:18482] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5844076926]
[e140bc562587:18482] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5843faec90]
[e140bc562587:18482] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5843fb9b5e]
[e140bc562587:18482] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18482] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18482] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18482] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18482] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f58436d6083]
[e140bc562587:18482] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18482] *** End of error message ***
[e140bc562587:18479] *** Process received signal ***
[e140bc562587:18479] Signal: Segmentation fault (11)
[e140bc562587:18479] Signal code: Address not mapped (1)
[e140bc562587:18479] Failing at address: 0x18
[e140bc562587:18479] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa761552420]
[e140bc562587:18479] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa75fdaa35d]
[e140bc562587:18479] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa75fdae47d]
[e140bc562587:18479] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa75fdb9926]
[e140bc562587:18479] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa75fcf1c90]
[e140bc562587:18479] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa75fcfcb5e]
[e140bc562587:18479] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18479] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18479] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18479] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18479] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa75f419083]
[e140bc562587:18479] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18479] *** End of error message ***
[e140bc562587:18487] *** Process received signal ***
[e140bc562587:18487] Signal: Segmentation fault (11)
[e140bc562587:18487] Signal code: Address not mapped (1)
[e140bc562587:18487] Failing at address: 0x18
[e140bc562587:18487] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c1d1cf420]
[e140bc562587:18487] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c1ba2735d]
[e140bc562587:18487] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c1ba2b47d]
[e140bc562587:18487] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c1ba36926]
[e140bc562587:18487] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c1b96ec90]
[e140bc562587:18487] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c1b979b5e]
[e140bc562587:18487] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18487] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18487] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18487] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18487] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c1b096083]
[e140bc562587:18487] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18487] *** End of error message ***
[e140bc562587:18492] *** Process received signal ***
[e140bc562587:18492] Signal: Segmentation fault (11)
[e140bc562587:18492] Signal code: Address not mapped (1)
[e140bc562587:18492] Failing at address: 0x18
[e140bc562587:18492] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5b5a9fe420]
[e140bc562587:18492] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f5b5925635d]
[e140bc562587:18492] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f5b5925a47d]
[e140bc562587:18492] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5b59265926]
[e140bc562587:18492] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5b5919dc90]
[e140bc562587:18492] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5b591a8b5e]
[e140bc562587:18492] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b]
[e140bc562587:18492] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc]
[e140bc562587:18492] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8]
[e140bc562587:18492] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2]
[e140bc562587:18492] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f5b588c5083]
[e140bc562587:18492] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e]
[e140bc562587:18492] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 1 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------