Server environment:
- Ubuntu 16.04.4tensorflow 1.13.1cuda-10.0cudnn 7.4.5
Recently, when I was running demo pointasnl of point cloud classification, when batch_ When the size setting is relatively large, the following errors will appear during the training:
2020-06-12 00:14:01.824110: E tensorflow/stream_executor/cuda/cuda_event.cc:29] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS: an illegal memory access was encountered
2020-06-12 00:14:01.824142: F tensorflow/core/common_runtime/gpu/gpu_event_mgr.cc:273] Unexpected Event status: 1At first, it was thought that there was something wrong with the GPU Programming code, but after repeated checking, it was found that there was no error.
After collecting information from the Internet, I vaguely realized that it should be the environmental version.
After reducing cudnn 7.4.5 to cudnn 7.3.1, this problem seems to be solved. I hope there will be no more problems.
Read More:
- TensorFlow-gpu Error: failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
- [Solved] Tensorflow Error: failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
- [Solved] Event Log Error: Failed to retrieve application JMX service URL
- TensorRT model quantization error: Error Code 1: Cuda Runtime (an illegal memory access was encountered)
- Vue3 Warning: [Vue warn]: Extraneous non-emits event listeners (changeParentProps) were passed to component
- [Solved] RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)`
- [Solved] error: ‘xcb_generic_event_t’ was not declared in this scope
- android mediaplayer went away with unhandled event after the recording stopped
- [Solved] Tensorflow Error: Failed to load the native TensorFlow runtime.
- Node.js Error: throw er; // Unhandled ‘error‘ event [How to Solve]
- Error using tensorflow GPU: could not create cudnn handle: cudnn_STATUS_NOT_INITIALIZED
- FTP 500 Illegal PORT command. ftp: bind: Address already in use [How to Solve]
- Error code: events.js:183 Thrower; //unhandled ‘error’ event – solution
- [Solved] Angular build Error: throw er; // Unhandled ‘error’ eventEmitted ‘error’ event on ChildProcess instance
- Node js events.js:183 throw er; // Unhandled ‘error’ event
- laravel-echo-server Run Error: [ioredis] Unhandled error event: ReplyError: NOAUTH Authentication required.
- CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
- [Solved] CUDA error：-UserWarning: CUDA initialization: CUDA unknown error
- Cuda Runtime error (38) : no CUDA-capable device is detected
- [Solved] Tensorflow-gpu 2.0.0 Run Error: ModuleNotFoundError: No module named ‘tensorflow_core.estimator‘