When using the school HPC cluster, it is found that the batch task written by win10 reports an error, which can be solved with dos2unix.
Bugs and Solutions
This problem is due to the difference between UNIX and DOS blank line format. Just use code conversion
errors are reported as follows:
sbatch: error: Batch script contains DOS line breaks (\r\n)
sbatch: error: instead of expected UNIX line breaks (\n).
Enter dos2unix:
dos2unix yourfilename
Follow the instructions in my last blog to install spacey:
install spacey
install from offline package:
pip install en_core_web_trf-3.1.0.tar.gz
But an error is reported:
the solution is very simple. Put Python 3 Replace 6.0 with any other Python version. The error is 3.6 0 so unique:
1. Problem description
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.aop.config.internalAutoProxyCreator': Initialization of bean failed; nested exception is java.lang.NoClassDefFoundError: org/aspectj/lang/annotation/Around
2. Anomaly analysis
org. springframework. beans. factory. BeanCreationException: Error creating bean with name ‘XXX’
This exception is: bean injection failure exception. If this exception occurs, the corresponding bean cannot be found! The reasons for bean injection failure include but are not limited to the following:
The corresponding bean is not annotated; There is an error adding annotation to the corresponding bean, for example, the @service of spring is incorrectly selected as Dubbo; Select the wrong automatic injection method, etc.
Caused by: java.lang.ClassNotFoundException: org.aspectj.lang.annotation. Around
Missing aspect, Maven coordinate of AOP
<dependency>
<groupId>org.springframework</groupId>
<artifactId>spring-aop</artifactId>
<version>4.3.12.RELEASE</version>
</dependency>
<dependency>
<groupId>org.springframework</groupId>
<artifactId>spring-aspects</artifactId>
<version>4.3.12.RELEASE</version>
</dependency>
After adding dependency, the problem is solved
Resolve artifact spbjh: War expanded: error during artifact deployment See server log for details.
Sometimes, if the project cannot be started, the following error will be reported
1 First, let’s delete this place
2. Delete this
replace this with the configuration in its corresponding directory
sometimes the jar package conflicts, which will also lead to startup failure 
Add
again to start.
ERROR: Cannot uninstall ‘PyYAML’. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
Problem Description.
When installing transformers, an error is reported: “ERROR: Cannot uninstall ‘PyYAML’. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.”
pip install transformers
Solution:
You only need to modify the original installation command to:
pip install transformers --ignore-installed PyYAML
Just.
Similar problems can be solved in this way.
sass-loader！
Failed to compile.
./src/main.js
Module not found: Error: Can't resolve 'sass-loader' in 'E:\study_software\JetBrains\WebStorm2021\WebstormProjects\vue-element-admin-master'
npm install sass-loader sass webpack --save-dev
npm install --save-dev node-sass
or
cnpm install node-sass --save
sass-loader: https://www.npmjs.com/package/sass-loader
Problem Description:
When testing yarn , starting the wordcount test case fails, and the following prompt appears
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
<name>yarn.app.mapreduce.am.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}<alue>
</property>
<property>
<name>mapreduce.map.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}<alue>
</property>
<property>
<name>mapreduce.reduce.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}<alue>
</property>
For more detailed output, check the application tracking page: http://hadoop103:8088/cluster/app/application_1638539388325_0001 Then click on links to logs of each attempt.
. Failing the application.
Cause analysis
Cannot find the main classpath
Solution:
Follow the prompts to add a classpath
At yen site XML and mapred site XML, add the following
<property>
<name>yarn.application.classpath</name>
<value>
${HADOOP_HOME}/etc/*,
${HADOOP_HOME}/etc/hadoop/*,
${HADOOP_HOME}/lib/*,
${HADOOP_HOME}/share/hadoop/common/*,
${HADOOP_HOME}/share/hadoop/common/lib/*,
${HADOOP_HOME}/share/hadoop/mapreduce/*,
${HADOOP_HOME}/share/hadoop/mapreduce/lib-examples/*,
${HADOOP_HOME}/share/hadoop/hdfs/*,
${HADOOP_HOME}/share/hadoop/hdfs/lib/*,
${HADOOP_HOME}/share/hadoop/yarn/*,
${HADOOP_HOME}/share/hadoop/yarn/lib/*,
</value>
</property>
Because ${hadoop_home} is used, you need to inherit environment variables in Yard site XML is added as follows, where Hadoop_Home is what we need. Just put the rest as needed. I put some commonly used ones here
<!--Inheritance of environment variables-->
<property>
<name>yarn.nodemanager.env-whitelist</name>，
<value>JAVA_HOME,HADOOP_HOME,HADOOP_COMMON_HOME, HADOOP_ HDFS_HOME, HADOOP_ CONF_DIR, CLASSPATH_PREPEND_DISTCACHE, HADOOP_YARN_HOME, HADOOP_MAPRED_HOME
</value>
</property>
If the
yarnservice related to multiple servers is enabled, remember to configure each server
1. Problem Description: prepare to execute the following command in Anaconda prompt:
conda install -c stellargraph stellargraphAn HTTP error occurred when trying to retrieve this URL
HTTP errors are often intermittent, and a simple retry will get you on your way.
2. Solution: open “C:\users\your computer name\condarc
Delete all lines in condarc, copy and paste the following code, and then save:
channels:
- https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main/
- https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/
- defaults
show_channel_urls: true
ssl_verify: true(anyway, I can finally succeed in this file with the above code. I don’t know if you can do it.
3. Re run
conda install -c stellargraph stellargraphCreate a new environment ( CONDA env create - n env_name ) and install the software. In this way, the compatibility with the existing software will not be considered. It can also greatly reduce the search space and improve the speed of resolving software dependencies.
Configure custom login page
http.formLogin().loginPage("login.html") //Custom login page The error is caused by this, the page needs to be preceded by a slash
.loginProcessingUrl("/login") // the address of the action in the login form, which is the path of the authentication request
.usernameParameter("username")
.passwordParameter("password")
.defaultSuccessUrl("/home"); //Default jump path after successful login
Change to
http.formLogin().loginPage("/login.html")
.loginProcessingUrl("/login")
.usernameParameter("username")
.passwordParameter("password")
.defaultSuccessUrl("/home");
ERROR: Cannot uninstall ‘wrapt’. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
Problem Description.
When installing tensorflow, an error is reported: “ERROR: Cannot uninstall ‘wrapt’. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.”
pip install tensorflow==1.15.0
Solution:
Change the command to:
pip install tensorflow==1.15.0 --ignore-installed wrapt
<!-- Database connection pooling-->
<dependency>
<groupId>com.alibaba</groupId>
<artifactId>druid</artifactId>
<version>1.1.22</version>
</dependency>
Version issue updated to 1.1 22