Regression
Build / HIP-5.6 / projectroot.test.ArborX_Test_DetailsDistributedTreeImpl (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
[1effbede40a4:26719] *** Process received signal *** [1effbede40a4:26719] Signal: Segmentation fault (11) [1effbede40a4:26719] Signal code: Address not mapped (1) [1effbede40a4:26719] Failing at address: 0x18 [1effbede40a4:26719] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f01d3df3420] [1effbede40a4:26719] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f01d264b35d] [1effbede40a4:26719] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f01d264f47d] [1effbede40a4:26719] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f01d265a926] [1effbede40a4:26719] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f01d2592c90] [1effbede40a4:26719] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f01d259db5e] [1effbede40a4:26719] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26719] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26719] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26719] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26719] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f01d1cba083] [1effbede40a4:26719] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26719] *** End of error message *** [1effbede40a4:26716] *** Process received signal *** [1effbede40a4:26716] Signal: Segmentation fault (11) [1effbede40a4:26716] Signal code: Address not mapped (1) [1effbede40a4:26716] Failing at address: 0x18 [1effbede40a4:26716] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f4d7a5d2420] [1effbede40a4:26716] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f4d78e2a35d] [1effbede40a4:26716] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f4d78e2e47d] [1effbede40a4:26716] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f4d78e39926] [1effbede40a4:26716] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f4d78d71c90] [1effbede40a4:26716] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f4d78d7cb5e] [1effbede40a4:26716] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26716] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26716] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26716] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26716] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f4d78499083] [1effbede40a4:26716] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26716] *** End of error message *** [1effbede40a4:26708] *** Process received signal *** [1effbede40a4:26708] Signal: Segmentation fault (11) [1effbede40a4:26708] Signal code: Address not mapped (1) [1effbede40a4:26708] Failing at address: 0x18 [1effbede40a4:26708] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f94db528420] [1effbede40a4:26708] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f94d9d8035d] [1effbede40a4:26708] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f94d9d8447d] [1effbede40a4:26708] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f94d9d8f926] [1effbede40a4:26708] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f94d9cc7c90] [1effbede40a4:26708] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f94d9cd2b5e] [1effbede40a4:26708] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26708] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26708] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26708] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26708] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f94d93ef083] [1effbede40a4:26708] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26708] *** End of error message *** [1effbede40a4:26711] *** Process received signal *** [1effbede40a4:26711] Signal: Segmentation fault (11) [1effbede40a4:26711] Signal code: Address not mapped (1) [1effbede40a4:26711] Failing at address: 0x18 [1effbede40a4:26711] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f72cdfe3420] [1effbede40a4:26711] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f72cc83b35d] [1effbede40a4:26711] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f72cc83f47d] [1effbede40a4:26711] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f72cc84a926] [1effbede40a4:26711] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f72cc782c90] [1effbede40a4:26711] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f72cc78db5e] [1effbede40a4:26711] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26711] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26711] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26711] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26711] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f72cbeaa083] [1effbede40a4:26711] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26711] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 1effbede40a4 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------
Standard Output
[1effbede40a4:26719] *** Process received signal *** [1effbede40a4:26719] Signal: Segmentation fault (11) [1effbede40a4:26719] Signal code: Address not mapped (1) [1effbede40a4:26719] Failing at address: 0x18 [1effbede40a4:26719] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f01d3df3420] [1effbede40a4:26719] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f01d264b35d] [1effbede40a4:26719] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f01d264f47d] [1effbede40a4:26719] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f01d265a926] [1effbede40a4:26719] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f01d2592c90] [1effbede40a4:26719] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f01d259db5e] [1effbede40a4:26719] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26719] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26719] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26719] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26719] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f01d1cba083] [1effbede40a4:26719] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26719] *** End of error message *** [1effbede40a4:26716] *** Process received signal *** [1effbede40a4:26716] Signal: Segmentation fault (11) [1effbede40a4:26716] Signal code: Address not mapped (1) [1effbede40a4:26716] Failing at address: 0x18 [1effbede40a4:26716] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f4d7a5d2420] [1effbede40a4:26716] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f4d78e2a35d] [1effbede40a4:26716] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f4d78e2e47d] [1effbede40a4:26716] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f4d78e39926] [1effbede40a4:26716] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f4d78d71c90] [1effbede40a4:26716] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f4d78d7cb5e] [1effbede40a4:26716] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26716] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26716] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26716] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26716] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f4d78499083] [1effbede40a4:26716] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26716] *** End of error message *** [1effbede40a4:26708] *** Process received signal *** [1effbede40a4:26708] Signal: Segmentation fault (11) [1effbede40a4:26708] Signal code: Address not mapped (1) [1effbede40a4:26708] Failing at address: 0x18 [1effbede40a4:26708] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f94db528420] [1effbede40a4:26708] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f94d9d8035d] [1effbede40a4:26708] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f94d9d8447d] [1effbede40a4:26708] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f94d9d8f926] [1effbede40a4:26708] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f94d9cc7c90] [1effbede40a4:26708] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f94d9cd2b5e] [1effbede40a4:26708] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26708] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26708] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26708] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26708] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f94d93ef083] [1effbede40a4:26708] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26708] *** End of error message *** [1effbede40a4:26711] *** Process received signal *** [1effbede40a4:26711] Signal: Segmentation fault (11) [1effbede40a4:26711] Signal code: Address not mapped (1) [1effbede40a4:26711] Failing at address: 0x18 [1effbede40a4:26711] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f72cdfe3420] [1effbede40a4:26711] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f72cc83b35d] [1effbede40a4:26711] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f72cc83f47d] [1effbede40a4:26711] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f72cc84a926] [1effbede40a4:26711] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f72cc782c90] [1effbede40a4:26711] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f72cc78db5e] [1effbede40a4:26711] [ 6] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x3914ab] [1effbede40a4:26711] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x36613c] [1effbede40a4:26711] [ 8] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x366068] [1effbede40a4:26711] [ 9] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x360662] [1effbede40a4:26711] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f72cbeaa083] [1effbede40a4:26711] [11] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DetailsDistributedTreeImpl.exe[0x31824e] [1effbede40a4:26711] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 1effbede40a4 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------