1.

What are the functions of SparkCore?

Answer»

SparkCore is the main engine that is meant for large-scale distributed and parallel data processing. The Spark CORE CONSISTS of the distributed execution engine that offers various APIs in Java, PYTHON, and Scala for developing distributed ETL applications.
Spark Core does important functions such as memory management, job monitoring, fault-tolerance, storage SYSTEM interactions, job scheduling, and providing support for all the basic I/O functionalities. There are various additional libraries built on top of Spark Core which allows diverse workloads for SQL, streaming, and machine learning. They are responsible for:

  • Fault recovery
  • Memory management and Storage system interactions
  • Job monitoring, scheduling, and distribution
  • Basic I/O functions


Discussion

No Comment Found

Related InterviewSolutions