![[Jenkins]](/jenkins-ci/static/54027423/images/svgs/logo.svg){kind=logo}
Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DetailsDistributedTreeImpl (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[9cc6956df2dc:18874] *** Process received signal *** [9cc6956df2dc:18874] Signal: Segmentation fault (11) [9cc6956df2dc:18874] Signal code: Address not mapped (1) [9cc6956df2dc:18874] Failing at address: 0x18 [9cc6956df2dc:18874] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fd969679420] [9cc6956df2dc:18874] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fd967ed135d] [9cc6956df2dc:18874] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fd967ed547d] [9cc6956df2dc:18874] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fd967ee0926] [9cc6956df2dc:18874] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fd967e18c90] [9cc6956df2dc:18874] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fd967e23b5e] [9cc6956df2dc:18874] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18874] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18874] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18874] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18874] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fd967540083] [9cc6956df2dc:18874] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18874] *** End of error message *** [9cc6956df2dc:18882] *** Process received signal *** [9cc6956df2dc:18882] Signal: Segmentation fault (11) [9cc6956df2dc:18882] Signal code: Address not mapped (1) [9cc6956df2dc:18882] Failing at address: 0x18 [9cc6956df2dc:18882] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9fcb909420] [9cc6956df2dc:18882] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9fca16135d] [9cc6956df2dc:18882] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9fca16547d] [9cc6956df2dc:18882] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9fca170926] [9cc6956df2dc:18882] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9fca0a8c90] [9cc6956df2dc:18882] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9fca0b3b5e] [9cc6956df2dc:18882] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18882] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18882] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18882] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18882] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9fc97d0083] [9cc6956df2dc:18882] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18882] *** End of error message *** [9cc6956df2dc:18871] *** Process received signal *** [9cc6956df2dc:18871] Signal: Segmentation fault (11) [9cc6956df2dc:18871] Signal code: Address not mapped (1) [9cc6956df2dc:18871] Failing at address: 0x18 [9cc6956df2dc:18871] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f74b9c91420] [9cc6956df2dc:18871] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f74b84e935d] [9cc6956df2dc:18871] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f74b84ed47d] [9cc6956df2dc:18871] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f74b84f8926] [9cc6956df2dc:18871] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f74b8430c90] [9cc6956df2dc:18871] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f74b843bb5e] [9cc6956df2dc:18871] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18871] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18871] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18871] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18871] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f74b7b58083] [9cc6956df2dc:18871] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18871] *** End of error message *** [9cc6956df2dc:18879] *** Process received signal *** [9cc6956df2dc:18879] Signal: Segmentation fault (11) [9cc6956df2dc:18879] Signal code: Address not mapped (1) [9cc6956df2dc:18879] Failing at address: 0x18 [9cc6956df2dc:18879] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2bd3682420] [9cc6956df2dc:18879] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2bd1eda35d] [9cc6956df2dc:18879] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2bd1ede47d] [9cc6956df2dc:18879] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2bd1ee9926] [9cc6956df2dc:18879] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2bd1e21c90] [9cc6956df2dc:18879] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2bd1e2cb5e] [9cc6956df2dc:18879] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18879] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18879] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18879] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18879] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2bd1549083] [9cc6956df2dc:18879] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18879] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 9cc6956df2dc exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[9cc6956df2dc:18874] *** Process received signal *** [9cc6956df2dc:18874] Signal: Segmentation fault (11) [9cc6956df2dc:18874] Signal code: Address not mapped (1) [9cc6956df2dc:18874] Failing at address: 0x18 [9cc6956df2dc:18874] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fd969679420] [9cc6956df2dc:18874] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fd967ed135d] [9cc6956df2dc:18874] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fd967ed547d] [9cc6956df2dc:18874] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fd967ee0926] [9cc6956df2dc:18874] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fd967e18c90] [9cc6956df2dc:18874] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fd967e23b5e] [9cc6956df2dc:18874] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18874] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18874] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18874] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18874] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fd967540083] [9cc6956df2dc:18874] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18874] *** End of error message *** [9cc6956df2dc:18882] *** Process received signal *** [9cc6956df2dc:18882] Signal: Segmentation fault (11) [9cc6956df2dc:18882] Signal code: Address not mapped (1) [9cc6956df2dc:18882] Failing at address: 0x18 [9cc6956df2dc:18882] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f9fcb909420] [9cc6956df2dc:18882] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f9fca16135d] [9cc6956df2dc:18882] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f9fca16547d] [9cc6956df2dc:18882] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f9fca170926] [9cc6956df2dc:18882] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f9fca0a8c90] [9cc6956df2dc:18882] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f9fca0b3b5e] [9cc6956df2dc:18882] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18882] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18882] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18882] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18882] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f9fc97d0083] [9cc6956df2dc:18882] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18882] *** End of error message *** [9cc6956df2dc:18871] *** Process received signal *** [9cc6956df2dc:18871] Signal: Segmentation fault (11) [9cc6956df2dc:18871] Signal code: Address not mapped (1) [9cc6956df2dc:18871] Failing at address: 0x18 [9cc6956df2dc:18871] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f74b9c91420] [9cc6956df2dc:18871] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f74b84e935d] [9cc6956df2dc:18871] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f74b84ed47d] [9cc6956df2dc:18871] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f74b84f8926] [9cc6956df2dc:18871] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f74b8430c90] [9cc6956df2dc:18871] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f74b843bb5e] [9cc6956df2dc:18871] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18871] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18871] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18871] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18871] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f74b7b58083] [9cc6956df2dc:18871] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18871] *** End of error message *** [9cc6956df2dc:18879] *** Process received signal *** [9cc6956df2dc:18879] Signal: Segmentation fault (11) [9cc6956df2dc:18879] Signal code: Address not mapped (1) [9cc6956df2dc:18879] Failing at address: 0x18 [9cc6956df2dc:18879] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f2bd3682420] [9cc6956df2dc:18879] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f2bd1eda35d] [9cc6956df2dc:18879] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f2bd1ede47d] [9cc6956df2dc:18879] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f2bd1ee9926] [9cc6956df2dc:18879] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f2bd1e21c90] [9cc6956df2dc:18879] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f2bd1e2cb5e] [9cc6956df2dc:18879] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x467f2b] [9cc6956df2dc:18879] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cbbc] [9cc6956df2dc:18879] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x43cae8] [9cc6956df2dc:18879] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x4370e2] [9cc6956df2dc:18879] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f2bd1549083] [9cc6956df2dc:18879] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x38966e] [9cc6956df2dc:18879] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 9cc6956df2dc exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------