How are automatic clean-ups triggered in Spark for handling the accumu

1.	How are automatic clean-ups triggered in Spark for handling the accumulated metadata?
Answer» The clean-up TASKS can be triggered automatically either by setting spark.cleaner.ttl PARAMETER or by doing the batch-wise division of the long-running jobs and then writing the intermediary RESULTS on the DISK.

Discussion