Caused by: java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions: List(1, 200)

Solution:
Close AQE: set spark.sql.adaptive.enabled = false;