Problem phenomenon
Using sftp to load large files reports an error, loading small files is normal.
Cause Analysis
When the number of concurrent loading tasks of the cluster and the maximum number of loading machines of a single task is large, the situation of sftp file loading failure will occur.
Solution
Make sure that the parameter gcluster_loader_max_data_processors is set too large, and no error is reported after the parameter is reduced.
Read More:
- [Solved] GBase 8a MPP Database Loading Error: Unsupported version
- [Solved] JMETER pressure measure with a lot of Ports Error: 504GATEWAY TIMEOUT
- [Solved] VScode sftp Code synchronizate Error: Error: No such file
- Mongodb Crash Error: Too many open files [How to Solve]
- [Solved] Hbase …ERROR: Unable to read .tableinfo from file:/hbaseData/data/default/table1/xxxx
- db2 rollforward bufferpool error [How to Solve]
- ApplicationContext.xml file header error Referenced file contains errors
- [Solved] npm Error: Error: Cannot find module ‘postcss-loader‘
- [Fixed]ERROR: canceling statement due to conflict with recovery
- [USF-XSim-62] ‘elaborate‘ step failed with errors.[Vivado 12-4473] Detected error while running sim
- Vue require Error: node_modules/babel-loader/lib
- [How to Solve] java.lang.IllegalArgumentException: Request header is too large
- SQL Server Error: Arithmetic overflow error converting expression to data type int.
- [Solved] Runtimeerror: CUDA error: device side assert triggered
- Yaml is installed, and the error YAMLLoadWarning is reported as soon as the code runs: calling yaml.load() without Loader=… is deprecated, as the default Loader is unsafe.
- DataTables warning encountered using DataTables: table id = DataTables_Table_0 – Ajax error. For more information ab
- [Webpack Update] vue-loader Error: Compiled with problems : ERRORModule notfound: Error:Can‘ t resolve vue in
- [Solved] Tensorflow-gpu Error: self._traceback = tf_stack.extract_stack()
- [Solved] nodejs Error: request entity too large
- [Solved] OpenCV Train the class Error: Bad argument & Error: Insufficient memory