![[Jenkins]](/jenkins-ci/static/53c4440b/images/svgs/logo.svg){kind=logo}
Regression
Build / SYCL / projectroot.test.ArborX_Test_DistributedTree (from CTest)
Failing for the past 1 build
(Since Failed
)
Stacktrace
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11464] *** Process received signal *** [399a25eb3276:11464] Signal: Aborted (6) [399a25eb3276:11464] Signal code: (-6) [399a25eb3276:11464] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fe0fe452520] [399a25eb3276:11464] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fe0fe4a69fc] [399a25eb3276:11464] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fe0fe452476] [399a25eb3276:11464] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fe0fe4387f3] [399a25eb3276:11464] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fe0feac6b9e] [399a25eb3276:11464] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fe0fead220c] [399a25eb3276:11464] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fe0fead2277] [399a25eb3276:11464] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11464] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11466] *** Process received signal *** [399a25eb3276:11466] Signal: Aborted (6) [399a25eb3276:11466] Signal code: (-6) [399a25eb3276:11466] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fc89d762520] [399a25eb3276:11466] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fc89d7b69fc] [399a25eb3276:11466] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fc89d762476] [399a25eb3276:11466] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fc89d7487f3] [399a25eb3276:11466] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fc89ddd6b9e] [399a25eb3276:11466] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fc89dde220c] [399a25eb3276:11466] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fc89dde2277] [399a25eb3276:11466] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11466] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11465] *** Process received signal *** [399a25eb3276:11465] Signal: Aborted (6) [399a25eb3276:11465] Signal code: (-6) [399a25eb3276:11465] [ 0] [ 0 /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fc198aa4520] [399a25eb3276:11465] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fc198af89fc] [399a25eb3276:11465] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fc198aa4476] [399a25eb3276:11465] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fc198a8a7f3] [399a25eb3276:11465] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fc199118b9e] [399a25eb3276:11465] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fc19912420c] [399a25eb3276:11465] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fc199124277] [399a25eb3276:11465] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11465] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11467] *** Process received signal *** [399a25eb3276:11467] Signal: Aborted (6) [399a25eb3276:11467] Signal code: (-6) [399a25eb3276:11467] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f3e2155f520] [399a25eb3276:11467] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f3e215b39fc] [399a25eb3276:11467] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f3e2155f476] [399a25eb3276:11467] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f3e215457f3] [399a25eb3276:11467] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f3e21bd3b9e] [399a25eb3276:11467] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f3e21bdf20c] [399a25eb3276:11467] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f3e21bdf277] [399a25eb3276:11467] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11467] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 399a25eb3276 exited on signal 6 (Aborted). --------------------------------------------------------------------------
Standard Output
Running 30 test cases... Running 30 test cases... Running 30 test cases... Running 30 test cases... PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11464] *** Process received signal *** [399a25eb3276:11464] Signal: Aborted (6) [399a25eb3276:11464] Signal code: (-6) [399a25eb3276:11464] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fe0fe452520] [399a25eb3276:11464] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fe0fe4a69fc] [399a25eb3276:11464] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fe0fe452476] [399a25eb3276:11464] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fe0fe4387f3] [399a25eb3276:11464] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fe0feac6b9e] [399a25eb3276:11464] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fe0fead220c] [399a25eb3276:11464] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fe0fead2277] [399a25eb3276:11464] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11464] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11466] *** Process received signal *** [399a25eb3276:11466] Signal: Aborted (6) [399a25eb3276:11466] Signal code: (-6) [399a25eb3276:11466] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fc89d762520] [399a25eb3276:11466] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fc89d7b69fc] [399a25eb3276:11466] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fc89d762476] [399a25eb3276:11466] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fc89d7487f3] [399a25eb3276:11466] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fc89ddd6b9e] [399a25eb3276:11466] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fc89dde220c] [399a25eb3276:11466] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fc89dde2277] [399a25eb3276:11466] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11466] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11465] *** Process received signal *** [399a25eb3276:11465] Signal: Aborted (6) [399a25eb3276:11465] Signal code: (-6) [399a25eb3276:11465] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fc198aa4520] [399a25eb3276:11465] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fc198af89fc] [399a25eb3276:11465] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fc198aa4476] [399a25eb3276:11465] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fc198a8a7f3] [399a25eb3276:11465] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7fc199118b9e] [399a25eb3276:11465] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7fc19912420c] [399a25eb3276:11465] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7fc199124277] [399a25eb3276:11465] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11465] *** End of error message *** PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: cuda_piextUSMEnqueueMemcpy Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:5023 PI CUDA ERROR: Value: 700 Name: CUDA_ERROR_ILLEGAL_ADDRESS Description: an illegal memory access was encountered Function: operator() Source Location: /root/intel-llvm-mirror/sycl/plugins/cuda/pi_cuda.cpp:2553 terminate called after throwing an instance of 'std::runtime_error' what(): There was a synchronous SYCL error: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) [399a25eb3276:11467] *** Process received signal *** [399a25eb3276:11467] Signal: Aborted (6) [399a25eb3276:11467] Signal code: (-6) [399a25eb3276:11467] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f3e2155f520] [399a25eb3276:11467] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f3e215b39fc] [399a25eb3276:11467] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f3e2155f476] [399a25eb3276:11467] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f3e215457f3] [399a25eb3276:11467] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f3e21bd3b9e] [399a25eb3276:11467] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f3e21bdf20c] [399a25eb3276:11467] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f3e21bdf277] [399a25eb3276:11467] [ 7] /var/jenkins/workspace/ArborX_master/build/test/ArborX_Test_DistributedTree.exe[0x44a5eb] [399a25eb3276:11467] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpiexec noticed that process rank 2 with PID 0 on node 399a25eb3276 exited on signal 6 (Aborted). --------------------------------------------------------------------------