Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DetailsDistributedTreeImpl (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[e140bc562587:18482] *** Process received signal *** [e140bc562587:18482] Signal: Segmentation fault (11) [e140bc562587:18482] Signal code: Address not mapped (1) [e140bc562587:18482] Failing at address: 0x18 [e140bc562587:18482] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f584580f420] [e140bc562587:18482] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f584406735d] [e140bc562587:18482] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f584406b47d] [e140bc562587:18482] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5844076926] [e140bc562587:18482] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5843faec90] [e140bc562587:18482] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5843fb9b5e] [e140bc562587:18482] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18482] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18482] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18482] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18482] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f58436d6083] [e140bc562587:18482] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18482] *** End of error message *** [e140bc562587:18479] *** Process received signal *** [e140bc562587:18479] Signal: Segmentation fault (11) [e140bc562587:18479] Signal code: Address not mapped (1) [e140bc562587:18479] Failing at address: 0x18 [e140bc562587:18479] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa761552420] [e140bc562587:18479] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa75fdaa35d] [e140bc562587:18479] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa75fdae47d] [e140bc562587:18479] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa75fdb9926] [e140bc562587:18479] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa75fcf1c90] [e140bc562587:18479] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa75fcfcb5e] [e140bc562587:18479] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18479] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18479] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18479] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18479] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa75f419083] [e140bc562587:18479] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18479] *** End of error message *** [e140bc562587:18487] *** Process received signal *** [e140bc562587:18487] Signal: Segmentation fault (11) [e140bc562587:18487] Signal code: Address not mapped (1) [e140bc562587:18487] Failing at address: 0x18 [e140bc562587:18487] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c1d1cf420] [e140bc562587:18487] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c1ba2735d] [e140bc562587:18487] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c1ba2b47d] [e140bc562587:18487] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c1ba36926] [e140bc562587:18487] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c1b96ec90] [e140bc562587:18487] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c1b979b5e] [e140bc562587:18487] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18487] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18487] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18487] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18487] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c1b096083] [e140bc562587:18487] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18487] *** End of error message *** [e140bc562587:18492] *** Process received signal *** [e140bc562587:18492] Signal: Segmentation fault (11) [e140bc562587:18492] Signal code: Address not mapped (1) [e140bc562587:18492] Failing at address: 0x18 [e140bc562587:18492] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5b5a9fe420] [e140bc562587:18492] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f5b5925635d] [e140bc562587:18492] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f5b5925a47d] [e140bc562587:18492] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5b59265926] [e140bc562587:18492] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5b5919dc90] [e140bc562587:18492] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5b591a8b5e] [e140bc562587:18492] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18492] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18492] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18492] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18492] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f5b588c5083] [e140bc562587:18492] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18492] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 1 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[e140bc562587:18482] *** Process received signal *** [e140bc562587:18482] Signal: Segmentation fault (11) [e140bc562587:18482] Signal code: Address not mapped (1) [e140bc562587:18482] Failing at address: 0x18 [e140bc562587:18482] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f584580f420] [e140bc562587:18482] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f584406735d] [e140bc562587:18482] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f584406b47d] [e140bc562587:18482] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5844076926] [e140bc562587:18482] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5843faec90] [e140bc562587:18482] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5843fb9b5e] [e140bc562587:18482] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18482] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18482] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18482] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18482] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f58436d6083] [e140bc562587:18482] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18482] *** End of error message *** [e140bc562587:18479] *** Process received signal *** [e140bc562587:18479] Signal: Segmentation fault (11) [e140bc562587:18479] Signal code: Address not mapped (1) [e140bc562587:18479] Failing at address: 0x18 [e140bc562587:18479] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fa761552420] [e140bc562587:18479] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fa75fdaa35d] [e140bc562587:18479] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fa75fdae47d] [e140bc562587:18479] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fa75fdb9926] [e140bc562587:18479] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fa75fcf1c90] [e140bc562587:18479] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fa75fcfcb5e] [e140bc562587:18479] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18479] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18479] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18479] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18479] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fa75f419083] [e140bc562587:18479] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18479] *** End of error message *** [e140bc562587:18487] *** Process received signal *** [e140bc562587:18487] Signal: Segmentation fault (11) [e140bc562587:18487] Signal code: Address not mapped (1) [e140bc562587:18487] Failing at address: 0x18 [e140bc562587:18487] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2c1d1cf420] [e140bc562587:18487] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2c1ba2735d] [e140bc562587:18487] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2c1ba2b47d] [e140bc562587:18487] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2c1ba36926] [e140bc562587:18487] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2c1b96ec90] [e140bc562587:18487] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2c1b979b5e] [e140bc562587:18487] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18487] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18487] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18487] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18487] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2c1b096083] [e140bc562587:18487] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18487] *** End of error message *** [e140bc562587:18492] *** Process received signal *** [e140bc562587:18492] Signal: Segmentation fault (11) [e140bc562587:18492] Signal code: Address not mapped (1) [e140bc562587:18492] Failing at address: 0x18 [e140bc562587:18492] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f5b5a9fe420] [e140bc562587:18492] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f5b5925635d] [e140bc562587:18492] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f5b5925a47d] [e140bc562587:18492] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f5b59265926] [e140bc562587:18492] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f5b5919dc90] [e140bc562587:18492] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f5b591a8b5e] [e140bc562587:18492] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [e140bc562587:18492] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [e140bc562587:18492] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [e140bc562587:18492] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [e140bc562587:18492] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f5b588c5083] [e140bc562587:18492] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [e140bc562587:18492] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 1 with PID 0 on node e140bc562587 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------