Skip to content

Regression

Build / HIP-5.6 / projectroot.benchmarks.distributed_tree_driver.ArborX_Benchmark_DistributedTree (from CTest)

Failing for the past 1 build (Since Not built #55 )
Took 13 sec.

Stacktrace

ArborX version: 1.6 (dev)
ArborX hash   : bcea082d
Kokkos version: 4.2.0
[fef06214d65b:19058] *** Process received signal ***
[fef06214d65b:19058] Signal: Segmentation fault (11)
[fef06214d65b:19058] Signal code: Address not mapped (1)
[fef06214d65b:19058] Failing at address: 0x18
[fef06214d65b:19058] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fe312991420]
[fef06214d65b:19058] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fe3111e935d]
[fef06214d65b:19058] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fe3111ed47d]
[fef06214d65b:19058] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fe3111f8926]
[fef06214d65b:19058] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fe311130c90]
[fef06214d65b:19058] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fe31113bb5e]
[fef06214d65b:19058] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19058] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19058] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19058] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19058] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fe310858083]
[fef06214d65b:19058] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19058] *** End of error message ***
[fef06214d65b:19061] *** Process received signal ***
[fef06214d65b:19061] Signal: Segmentation fault (11)
[fef06214d65b:19061] Signal code: Address not mapped (1)
[fef06214d65b:19061] Failing at address: 0x18
[fef06214d65b:19061] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff901e53420]
[fef06214d65b:19061] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff9006ab35d]
[fef06214d65b:19061] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff9006af47d]
[fef06214d65b:19061] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff9006ba926]
[fef06214d65b:19061] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff9005f2c90]
[fef06214d65b:19061] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff9005fdb5e]
[fef06214d65b:19061] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19061] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19061] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19061] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19061] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff8ffd1a083]
[fef06214d65b:19061] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19061] *** End of error message ***
[fef06214d65b:19050] *** Process received signal ***
[fef06214d65b:19050] Signal: Segmentation fault (11)
[fef06214d65b:19050] Signal code: Address not mapped (1)
[fef06214d65b:19050] Failing at address: 0x18
[fef06214d65b:19050] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f4e2958d420]
[fef06214d65b:19050] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f4e27de535d]
[fef06214d65b:19050] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f4e27de947d]
[fef06214d65b:19050] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f4e27df4926]
[fef06214d65b:19050] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f4e27d2cc90]
[fef06214d65b:19050] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f4e27d37b5e]
[fef06214d65b:19050] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19050] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19050] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19050] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19050] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f4e27454083]
[fef06214d65b:19050] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19050] *** End of error message ***
[fef06214d65b:19053] *** Process received signal ***
[fef06214d65b:19053] Signal: Segmentation fault (11)
[fef06214d65b:19053] Signal code: Address not mapped (1)
[fef06214d65b:19053] Failing at address: 0x18
[fef06214d65b:19053] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f35c3c45420]
[fef06214d65b:19053] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f35c249d35d]
[fef06214d65b:19053] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f35c24a147d]
[fef06214d65b:19053] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f35c24ac926]
[fef06214d65b:19053] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f35c23e4c90]
[fef06214d65b:19053] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f35c23efb5e]
[fef06214d65b:19053] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19053] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19053] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19053] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19053] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f35c1b0c083]
[fef06214d65b:19053] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19053] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 2 with PID 0 on node fef06214d65b exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Standard Output

ArborX version: 1.6 (dev)
ArborX hash   : bcea082d
Kokkos version: 4.2.0
[fef06214d65b:19058] *** Process received signal ***
[fef06214d65b:19058] Signal: Segmentation fault (11)
[fef06214d65b:19058] Signal code: Address not mapped (1)
[fef06214d65b:19058] Failing at address: 0x18
[fef06214d65b:19058] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fe312991420]
[fef06214d65b:19058] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7fe3111e935d]
[fef06214d65b:19058] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7fe3111ed47d]
[fef06214d65b:19058] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7fe3111f8926]
[fef06214d65b:19058] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7fe311130c90]
[fef06214d65b:19058] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7fe31113bb5e]
[fef06214d65b:19058] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19058] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19058] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19058] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19058] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fe310858083]
[fef06214d65b:19058] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19058] *** End of error message ***
[fef06214d65b:19061] *** Process received signal ***
[fef06214d65b:19061] Signal: Segmentation fault (11)
[fef06214d65b:19061] Signal code: Address not mapped (1)
[fef06214d65b:19061] Failing at address: 0x18
[fef06214d65b:19061] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7ff901e53420]
[fef06214d65b:19061] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7ff9006ab35d]
[fef06214d65b:19061] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7ff9006af47d]
[fef06214d65b:19061] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7ff9006ba926]
[fef06214d65b:19061] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7ff9005f2c90]
[fef06214d65b:19061] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7ff9005fdb5e]
[fef06214d65b:19061] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19061] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19061] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19061] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19061] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7ff8ffd1a083]
[fef06214d65b:19061] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19061] *** End of error message ***
[fef06214d65b:19050] *** Process received signal ***
[fef06214d65b:19050] Signal: Segmentation fault (11)
[fef06214d65b:19050] Signal code: Address not mapped (1)
[fef06214d65b:19050] Failing at address: 0x18
[fef06214d65b:19050] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f4e2958d420]
[fef06214d65b:19050] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f4e27de535d]
[fef06214d65b:19050] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f4e27de947d]
[fef06214d65b:19050] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f4e27df4926]
[fef06214d65b:19050] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f4e27d2cc90]
[fef06214d65b:19050] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f4e27d37b5e]
[fef06214d65b:19050] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19050] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19050] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19050] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19050] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f4e27454083]
[fef06214d65b:19050] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19050] *** End of error message ***
[fef06214d65b:19053] *** Process received signal ***
[fef06214d65b:19053] Signal: Segmentation fault (11)
[fef06214d65b:19053] Signal code: Address not mapped (1)
[fef06214d65b:19053] Failing at address: 0x18
[fef06214d65b:19053] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f35c3c45420]
[fef06214d65b:19053] [ 1] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33235d)[0x7f35c249d35d]
[fef06214d65b:19053] [ 2] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x33647d)[0x7f35c24a147d]
[fef06214d65b:19053] [ 3] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x341926)[0x7f35c24ac926]
[fef06214d65b:19053] [ 4] /opt/rocm-5.6.0/lib/libamdhip64.so.5(+0x279c90)[0x7f35c23e4c90]
[fef06214d65b:19053] [ 5] /opt/rocm-5.6.0/lib/libamdhip64.so.5(hipStreamCreate+0x14e)[0x7f35c23efb5e]
[fef06214d65b:19053] [ 6] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe4e92b]
[fef06214d65b:19053] [ 7] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe2430c]
[fef06214d65b:19053] [ 8] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xe24238]
[fef06214d65b:19053] [ 9] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb305ac]
[fef06214d65b:19053] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f35c1b0c083]
[fef06214d65b:19053] [11] /var/jenkins/workspace/ArborX_master/build/benchmarks/distributed_tree_driver/ArborX_Benchmark_DistributedTree.exe[0xb301ae]
[fef06214d65b:19053] *** End of error message ***
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpiexec noticed that process rank 2 with PID 0 on node fef06214d65b exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------