![[Jenkins]](/jenkins-ci/static/92691e45/images/svgs/logo.svg){kind=logo}
Regression
Build / SYCL / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12958] *** Process received signal *** [7062d0bef559:12958] Signal: Aborted (6) [7062d0bef559:12958] Signal code: (-6) [7062d0bef559:12958] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12958] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12958] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12958] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12958] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12958] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12958] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12958] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12958] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12960] *** Process received signal *** [7062d0bef559:12960] Signal: Aborted (6) [7062d0bef559:12960] Signal code: (-6) [7062d0bef559:12960] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12960] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12960] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12960] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12960] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12960] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12960] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12960] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12960] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12961] *** Process received signal *** [7062d0bef559:12961] Signal: Aborted (6) [7062d0bef559:12961] Signal code: (-6) [7062d0bef559:12961] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12961] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12961] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12961] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12961] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12961] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12961] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12961] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12961] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12959] *** Process received signal *** [7062d0bef559:12959] Signal: Aborted (6) [7062d0bef559:12959] Signal code: (-6) [7062d0bef559:12959] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12959] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12959] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12959] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12959] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12959] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12959] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12959] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12959] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 7062d0bef559 exited on signal 6 (Aborted). --------------------------------------------------------------------------
Standard Output
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12958] *** Process received signal *** [7062d0bef559:12958] Signal: Aborted (6) [7062d0bef559:12958] Signal code: (-6) [7062d0bef559:12958] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12958] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12958] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12958] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12958] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12958] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12958] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12958] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12958] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12960] *** Process received signal *** [7062d0bef559:12960] Signal: Aborted (6) [7062d0bef559:12960] Signal code: (-6) [7062d0bef559:12960] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12960] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12960] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12960] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12960] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12960] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12960] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12960] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12960] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12961] *** Process received signal *** [7062d0bef559:12961] Signal: Aborted (6) [7062d0bef559:12961] Signal code: (-6) [7062d0bef559:12961] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12961] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12961] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12961] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12961] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12961] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12961] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12961] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12961] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [7062d0bef559:12959] *** Process received signal *** [7062d0bef559:12959] Signal: Aborted (6) [7062d0bef559:12959] Signal code: (-6) [7062d0bef559:12959] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7ffff75c7520] [7062d0bef559:12959] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7ffff761b9fc] [7062d0bef559:12959] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7ffff75c7476] [7062d0bef559:12959] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7ffff75ad7f3] [7062d0bef559:12959] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7ffff7c3bb9e] [7062d0bef559:12959] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7ffff7c4720c] [7062d0bef559:12959] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7ffff7c47277] [7062d0bef559:12959] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a51b] [7062d0bef559:12959] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 7062d0bef559 exited on signal 6 (Aborted). --------------------------------------------------------------------------