In starting spark shell –master yarn, we will find an error when spark shell is started
YarnClientSchedulerBackend: Yarn application has already exited with state FAILED
At this point we visit the yarn process to see the history of the start-up time error exception: ERRORorg.apache.hadoop.hdfs.server.namenode.NameNode: RECEIVED SIGNAL 15: SIGTERM (as shown), the general access to the port number is http://Localhost_name+8088 (default)
Solution:
This problem often occurs when the jdk version is 1.8. You can directly modify the configuration of yarn-site.xml in hadoop and distribute it to each cluster, and restart the cluster.
<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>10</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>Read More:
- [Solved] zookeeper Cluster error: Error: JAVA_HOME is not set and java could not be found in PATH.
- U-boot NFS download file error: loading: * * * error: File lookup fail solution
- Git Syntax Error: TypeError: this.getOptions is not a function [How to Solve]
- Nginx Startup Error: Job for nginx.service failed because the control process exited with error code
- [Solved] Ubuntu conda ProxyError: Conda cannot proceed due to an error in your proxy configuration
- [Solved] websocket: the client is not using the websocket protocol: ‘upgrade’ token not found in ‘Connection’ head
- Linux Error: bind error: Address already in use [How to Solve]
- [Solved] Web server failed to start. Port 8080 was already in use.
- /usr/bin/ssh-copy-id: ERROR: No identities found [How to Solve]
- [Solved] ××: error while loading shared libraries: ××.so.19: cannot open shared object file: No such file or directory
- [Solved] error:getaddrinfo ENOTFOUND xxx.xxxx.com xxx.xxxx.com:443
- Failed to Initialize Error: error execution phase preflight: [preflight] Some fatal errors occurred: [ERROR Port-6443]
- How to Fix Oracle listener error Linux error: 111: connection reused
- Es Container Error: too many open files [How to Solve]
- Solve the problem of 404 Not Found error in nginx accessing dynamic interface
- The upgrade of Ubuntu results in an error in the compilation of Android Jack [Two Method to Solve]
- [Solved] xtrabackup Error: “Too many open files” (system error number 24)
- Error: error from slirp4netns while setting up port redirection: map[desc:bad request: add_hostfwd:
- [Solved] Syntax Error: TypeError: Cannot read property ‘parseComponent‘ of undefined （vue报错）
- Hadoop 3.2.0 idea development environment construction and HDFS read write API operation