pyspark –master yarn
http://laptop:8042/node/containerlogs/container_1588409304631_0005_01_000001/appleyuchi/stderr/?start=-4096

led to connect to driver at license.sublimehq.com:41651, retrying ...
2020-05-02 16:53:04 ERROR ApplicationMaster:70 - Failed to connect to driver at license.sublimehq.com:41651, retrying ...
2020-05-02 16:53:04 ERROR ApplicationMaster:70 - Failed to connect to driver at license.sublimehq.com:41651, retrying ...
2020-05-02 16:53:04 ERROR ApplicationMaster:70 - Failed to connect to driver at license.sublimehq.com:41651, retrying ...
2020-05-02 16:53:04 ERROR ApplicationMaster:70 - Failed to connect to driver at license.sublimehq.com:41651, retrying ...

Inspection:

①

python test.py

And then access the browser license.sublimehq.com:41651

If the browser returns Hello world, the port is open.

②

After the first step is confirmed,

$SPARK_ HOME/conf/spark- defaults.conf

Add [2]:

spark.driver.port=20002
spark.driver.host=Desktop

#————————————————————

Do not restart spark, directly re-enter:

Pyspark — Master yard