| 1. |
What Do You Understand By Executor Memory In A Spark Application? |
|
Answer» Every spark application has same fixed heap SIZE and fixed number of cores for a spark executor. The heap size is what REFERRED to as the Spark executor memory which is CONTROLLED with the spark.executor.memory property of the –executor-memory flag. Every spark application will have one executor on each worker node. The executor memory is basically a measure on how MUCH memory of the worker node will the application utilize. Every spark application has same fixed heap size and fixed number of cores for a spark executor. The heap size is what referred to as the Spark executor memory which is controlled with the spark.executor.memory property of the –executor-memory flag. Every spark application will have one executor on each worker node. The executor memory is basically a measure on how much memory of the worker node will the application utilize. |
|