InterviewSolution
Saved Bookmarks
| 1. |
What is executor memory in spark? |
|
Answer» For a spark executor, EVERY spark application has the same fixed heap size and fixed number of CORES. The heap size is regulated by the spark.executor.memory attribute of the –executor-memory flag, which is ALSO known as the Spark executor memory. Each WORKER node will have one executor for each Spark application. The executor memory is a measure of how much memory the application will USE from the worker node. |
|