InterviewSolution
Saved Bookmarks
| 1. |
What happens when a Spark Job is submitted? |
|
Answer» Below is the step which spark job follows once job GET submitted:
Spark automatically deals with failed or slow machines by re-executing failed or slow tasks. For example, if the node running a PARTITION of a map () operation crashes, Spark will rerun it on another node; and even if the node does not crash but is simply much slower than other nodes, Spark can preemptively launch a “speculative” copy of the task on another node and take its result if that finishes. |
|