after terminal input PySpark, the following error occurs:
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable C:\ hadox-3.1.2 \bin\winutils. Exe in the hadoop binaries.
problem analysis: the winutils.exe file is missing in the hadoop/bin folder.
solution:
1. Check the hadoop/bin folder, and find that there is really no winutils.exe file.
my Hadoop version is 3.1.2 binary, downloaded from the website: https://hadoop.apache.org/releases.html.
2, download the file winutils.exe. Download address is https://github.com/steveloughran/winutils.
my Hadoop version is 3.1.2. Select the file winutils. Exe in hadoop-3.0.0/bin in the webpage and download it and put it into the Hadoop /bin folder.
3, re-enter pyspark on the terminal. Success!
Read More:
- Error reported when debugging Hadoop cluster under windows failed to find winutils.exe
- launch failed.Binary Not found in Linux / Ubuntu solution
- Modification scheme of binary files in dot matrix font library
- Typeerror: write() argument must be STR, not bytes and the method of writing binary file in Python 3
- To solve the running error of eclipse for C / C + +: launch failed binary not found
- Typeerror: write() argument must be STR, not bytes and the method of writing binary file in Python 3
- mkdir: Call From hadoop102/192.168.6.102 to hadoop102:8020 failed on connection exception: java.net.
- “Launch” appears when eclipse C + + CDT runs the program failed.binary not found”
- Solve cannot execute binary file: exec format error under Linux
- The list command in HBase shell reported an error org.apache.hadoop . hbase.PleaseHoldException : Master is initializing
- error C2679: binary ‘<<' : no operator found which takes a right-hand operand of type 'std::string'
- Square root of X (implementation of binary search)
- About java “Error: bad binary operator types”
- Response code: Sampler error: unexpected frame type (binary).
- Sublime error: error while loading pyv8 binary:exit code three
- Invalid operands to binary expression (‘double’ and ‘double’)
- Unknown error: cannot find chrome binary when running selenium under Linux
- SQL Error (3621): String or binary data would be truncated The statement has been terminated. */
- [problem solving] target is multiclass but average =’binary ‘. Please choose another average setting
- Warning when using numpy: runtimewarning: numpy.dtype size changed, may indicate binary incompatibility