![[Jenkins]](/jenkins-ci/static/c866c5a4/images/svgs/logo.svg){kind=logo}
Regression
Build / SYCL / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11652] *** Process received signal *** [4e8f1bfa27f3:11652] Signal: Aborted (6) [4e8f1bfa27f3:11652] Signal code: (-6) [4e8f1bfa27f3:11652] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f9d29579520] [4e8f1bfa27f3:11652] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f9d295cd9fc] [4e8f1bfa27f3:11652] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f9d29579476] [4e8f1bfa27f3:11652] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f9d2955f7f3] [4e8f1bfa27f3:11652] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f9d29bedb9e] [4e8f1bfa27f3:11652] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f9d29bf920c] [4e8f1bfa27f3:11652] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f9d29bf9277] [4e8f1bfa27f3:11652] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11652] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11650] *** Process received signal *** [4e8f1bfa27f3:11650] Signal: Aborted (6) [4e8f1bfa27f3:11650] Signal code: (-6) [4e8f1bfa27f3:11650] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ff74b502520] [4e8f1bfa27f3:11650] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ff74b5569fc] [4e8f1bfa27f3:11650] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ff74b502476] [4e8f1bfa27f3:11650] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ff74b4e87f3] [4e8f1bfa27f3:11650] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ff74bb76b9e] [4e8f1bfa27f3:11650] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ff74bb8220c] [4e8f1bfa27f3:11650] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ff74bb82277] [4e8f1bfa27f3:11650] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11650] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11651] *** Process received signal *** [4e8f1bfa27f3:11651] Signal: Aborted (6) [4e8f1bfa27f3:11651] Signal code: (-6) [4e8f1bfa27f3:11651] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f141abe8520] [4e8f1bfa27f3:11651] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f141ac3c9fc] [4e8f1bfa27f3:11651] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f141abe8476] [4e8f1bfa27f3:11651] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f141abce7f3] [4e8f1bfa27f3:11651] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f141b25cb9e] [4e8f1bfa27f3:11651] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f141b26820c] [4e8f1bfa27f3:11651] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f141b268277] [4e8f1bfa27f3:11651] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11651] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11649] *** Process received signal *** [4e8f1bfa27f3:11649] Signal: Aborted (6) [4e8f1bfa27f3:11649] Signal code: (-6) [4e8f1bfa27f3:11649] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f3e0cee1520] [4e8f1bfa27f3:11649] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f3e0cf359fc] [4e8f1bfa27f3:11649] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f3e0cee1476] [4e8f1bfa27f3:11649] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f3e0cec77f3] [4e8f1bfa27f3:11649] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f3e0d555b9e] [4e8f1bfa27f3:11649] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f3e0d56120c] [4e8f1bfa27f3:11649] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f3e0d561277] [4e8f1bfa27f3:11649] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11649] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 4e8f1bfa27f3 exited on signal 6 (Aborted). --------------------------------------------------------------------------
Standard Output
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11652] *** Process received signal *** [4e8f1bfa27f3:11652] Signal: Aborted (6) [4e8f1bfa27f3:11652] Signal code: (-6) [4e8f1bfa27f3:11652] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f9d29579520] [4e8f1bfa27f3:11652] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f9d295cd9fc] [4e8f1bfa27f3:11652] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f9d29579476] [4e8f1bfa27f3:11652] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f9d2955f7f3] [4e8f1bfa27f3:11652] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f9d29bedb9e] [4e8f1bfa27f3:11652] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f9d29bf920c] [4e8f1bfa27f3:11652] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f9d29bf9277] [4e8f1bfa27f3:11652] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11652] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11650] *** Process received signal *** [4e8f1bfa27f3:11650] Signal: Aborted (6) [4e8f1bfa27f3:11650] Signal code: (-6) [4e8f1bfa27f3:11650] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ff74b502520] [4e8f1bfa27f3:11650] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ff74b5569fc] [4e8f1bfa27f3:11650] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ff74b502476] [4e8f1bfa27f3:11650] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ff74b4e87f3] [4e8f1bfa27f3:11650] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ff74bb76b9e] [4e8f1bfa27f3:11650] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ff74bb8220c] [4e8f1bfa27f3:11650] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ff74bb82277] [4e8f1bfa27f3:11650] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11650] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11651] *** Process received signal *** [4e8f1bfa27f3:11651] Signal: Aborted (6) [4e8f1bfa27f3:11651] Signal code: (-6) [4e8f1bfa27f3:11651] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f141abe8520] [4e8f1bfa27f3:11651] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f141ac3c9fc] [4e8f1bfa27f3:11651] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f141abe8476] [4e8f1bfa27f3:11651] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f141abce7f3] [4e8f1bfa27f3:11651] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f141b25cb9e] [4e8f1bfa27f3:11651] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f141b26820c] [4e8f1bfa27f3:11651] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f141b268277] [4e8f1bfa27f3:11651] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11651] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [4e8f1bfa27f3:11649] *** Process received signal *** [4e8f1bfa27f3:11649] Signal: Aborted (6) [4e8f1bfa27f3:11649] Signal code: (-6) [4e8f1bfa27f3:11649] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f3e0cee1520] [4e8f1bfa27f3:11649] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f3e0cf359fc] [4e8f1bfa27f3:11649] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f3e0cee1476] [4e8f1bfa27f3:11649] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f3e0cec77f3] [4e8f1bfa27f3:11649] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f3e0d555b9e] [4e8f1bfa27f3:11649] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f3e0d56120c] [4e8f1bfa27f3:11649] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f3e0d561277] [4e8f1bfa27f3:11649] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [4e8f1bfa27f3:11649] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 3 with PID 0 on node 4e8f1bfa27f3 exited on signal 6 (Aborted). --------------------------------------------------------------------------