Explain About The Core Components Of A Distributed Spark Application.

1.	Explain About The Core Components Of A Distributed Spark Application.?
Answer» DRIVER: The process that runs the main () method of the program to create RDDs and perform TRANSFORMATIONS and actions on them. Executor: The worker processes that run the INDIVIDUAL tasks of a SPARK job. Cluster Manager: A pluggable component in Spark, to launch Executors and Drivers. The cluster manager allows Spark to run on top of other EXTERNAL managers like Apache Mesos or YARN. Driver: The process that runs the main () method of the program to create RDDs and perform transformations and actions on them. Executor: The worker processes that run the individual tasks of a Spark job. Cluster Manager: A pluggable component in Spark, to launch Executors and Drivers. The cluster manager allows Spark to run on top of other external managers like Apache Mesos or YARN.

Explain About The Core Components Of A Distributed Spark Application.?

Answer»

DRIVER: The process that runs the main () method of the program to create RDDs and perform TRANSFORMATIONS and actions on them.

Executor: The worker processes that run the INDIVIDUAL tasks of a SPARK job.

Cluster Manager: A pluggable component in Spark, to launch Executors and Drivers. The cluster manager allows Spark to run on top of other EXTERNAL managers like Apache Mesos or YARN.

Driver: The process that runs the main () method of the program to create RDDs and perform transformations and actions on them.

Executor: The worker processes that run the individual tasks of a Spark job.

Cluster Manager: A pluggable component in Spark, to launch Executors and Drivers. The cluster manager allows Spark to run on top of other external managers like Apache Mesos or YARN.

Discussion

No Comment Found

Related InterviewSolutions

What Makes Apache Spark Good At Low-latency Workloads Like Graph Processing And Machine Learning?
What Does The Spark Engine Do?
What Do You Understand By Executor Memory In A Spark Application?
Is It Necessary To Install Spark On All The Nodes Of A Yarn Cluster While Running Apache Spark On Yarn ?
What Are The Disadvantages Of Using Apache Spark Over Hadoop Mapreduce?
What Do You Understand By Schemardd?
Define A Worker Node.?
What Do You Understand By Lazy Evaluation?
Explain About The Core Components Of A Distributed Spark Application.?
Hadoop Uses Replication To Achieve Fault Tolerance. How Is This Achieved In Apache Spark?