When using tensorrt for model quantization on A10 graphics card, the following error is reported.
[W] [TRT] Calibration Profile is not defined. Running calibration with Profile 0
[I] calib data processed : 0/4680batch
[E] [TRT] 1: [calibrator.cpp::add::779] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
[E] [TRT] [executionContext.cpp::commonEmitDebugTensor::1258] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
[E] [TRT] [executionContext.cpp::executeInternal::610] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
[F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
[F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
[F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (an illegal memory access was encountered)
terminate called after throwing an instance of 'nvinfer1::CudaRuntimeError'
what(): an illegal memory access was encountered
Aborted
This is because the architecture does not match. Add 86 to a10
Therefore, modify my makefile. Here is my makefile fragment, originally SMS= 60 61 62 70 72 75, I added 86
# Gencode arguments
SMS ?= 60 61 62 70 72 75 86
ifeq ($(GENCODE_FLAGS),)
# Generate SASS code for each SM architecture listed in $(SMS)
$(foreach sm,$(SMS),$(eval GENCODE_FLAGS += -gencode arch=compute_$(sm),code=sm_$(sm)))
Read More:
- Yolox_s.pth Convert to tensorRT Error: AttributeError: ‘tensorrt.tensorrt.Builder‘ object has no attribute ‘max_workspace_size‘
- Onnx to tensorrt model error [How to Solve]
- Cuda Runtime error (38) : no CUDA-capable device is detected
- Tensorflow Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS
- [Solved] RuntimeError: CUDA error: out of memory
- [Solved] tasm Error: illegal memory reference
- [Solved] Illegal access: this web application instance has been stopped already
- PyCharm Error: RuntimeError: CUDA out of memory [How to Solve]
- [Solved] Springboot WARNING: All illegal access operations will be denied in a future release
- [Solved] Windows Nginx Startup Error: bind() to 0.0.0.0:80 failed (10013: An attempt was made to access a socket
- Deep learning model error + 1: CUDA error: device side assert triggered
- [Go] Solve panic: runtime error: invalid memory address or nil pointer dereference in golang
- Error 1 error MSB3721: Command ““C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v9.0\bin\nvcc.exe” -genco
- [Solved] panic: runtime error: invalid memory address or nil pointer dereference
- [Solved] CUDA error:-UserWarning: CUDA initialization: CUDA unknown error
- [Solved] Instantiation of ‘sdram_model_plus‘ failed. The design unit was not found.
- [Solved] Docker Startup Error: panic: runtime error: invalid memory address or nil pointer dereference
- [Solved] leetcode Common Error: :runtime error: member access within misaligned address 0xbebebebebebebebe for type ‘str
- [Solved] UserWarning: CUDA initialization: CUDA unknown error
- [Solved] ERROR A malformed block was encountered while loading a block