Problem reporting error
reason
All sh script files in the project are not transcoded
Solution:
Right-click in the blank space of the computer (make sure Git is installed) to open git bash here, and then CD to the specified path. Enter the following command
find ./ -name "*.sh" | xargs dos2unixMissing required property ‘azkaban.native.lib’
When Azkaban is used to submit a workflow, an error is reported: missing required property ‘Azkaban. Native. Lib’
reason:
The reason for this is that I didn’t switch to the exec directory or web server directory of Azkaban first, and directly use commands like “/ opt/module/Azkaban/azkaban-exec-server-3.84.4/bin/start-exec.sh” to start Azkaban. As a result, some Azkaban libraries cannot be found because of the path, and various problems due to insufficient packages will occur.
Solution:
First stop Azkaban, use the CD command to switch to the parent directory of the bin directory, and then use a command similar to “bin/start-exec.Sh” to start Azkaban’s executor and web service.
Error log:
java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException
at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:304)
at azkaban.execapp.JobRunner.runJob(JobRunner.java:784)
at azkaban.execapp.JobRunner.doRun(JobRunner.java:600)
at azkaban.execapp.JobRunner.run(JobRunner.java:561)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException
at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:130)
at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:296)
... 8 more
27-06-2021 16:47:23 CST ods_nshop2hive ERROR - azkaban.jobExecutor.utils.process.ProcessFailureException cause: azkaban.jobExecutor.utils.process.ProcessFailureException
27-06-2021 16:47:22 CST ods_nshop2hive INFO - at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
27-06-2021 16:47:23 CST ods_nshop2hive INFO - Finishing job ods_nshop2hive at 1624783643048 with status FAILED
The cause of the error is: the content of the job script is not in UNIX format
solution: use nopad + +, change the format to UNIX, and then upload the zip package
