32 + Interview Questions in PySpark in API Page 1 InterviewSolution

1.	In case of External Tables, data needs to remain in the underlying location even after the user drops the table.
Answer» In case of EXTERNAL Tables, data NEEDS to remain in the underlying location even after the USER drops the table. Please choose the COORECT OPTION from below list (1)False (2)True Answer:-(2)True

Discussion

2.	Spark SQL brings native support for SQL to Spark.
Answer» Spark SQL brings NATIVE support for SQL to Spark. Please choose the CORRECT option from below list (1)TRUE (2)False Answer:-(1)True

Discussion

3.	Which of the following is not a function of Spark Context in Apache Spark?
Answer» Which of the following is not a function of Spark Context in APACHE Spark? Please choose the coorect option from below LIST (1)Entry POINT to Spark SQL (2)To Access various SERVICES (3)To set the configuration (4)To get the current status of Spark Application Answer:-(1)Entry point to Spark SQL

Discussion

4.	DataFrame is data organized into ______ columns.
Answer» DATAFRAME is data organized into ______ columns. Please choose the correct OPTION from below LIST (1)NAMED (2)random Answer:-(1)named

Discussion

5.	Which among the following is an example of Transformation?
Answer» Which among the FOLLOWING is an example of Transformation? PLEASE choose the correct option from below LIST (1)groupByKey([numPartitions]) (2)count() (3)collect() (4)take(n) ANSWER:-(1)groupByKey([numPartitions])

Discussion

6.	SparkContext uses Py4J to launch a JVM and create a __________
Answer» SparkContext uses Py4J to launch a JVM and create a __________ Please CHOOSE the coorect option from below list (1)JavaSparkContext (2)SQLContext (3)HiveContext Answer:-(1)JavaSparkContext

Discussion

7.	If the schema of the table does not match with the data types present in the file containing the table, then Hive ________
Answer» If the schema of the table does not match with the DATA TYPES present in the file containing the table, then Hive ________ Please choose the COORECT option from below list (1)Automatically drops the file (2)REPORTS Null values for mismatched data (3)Automatically corrects the file Answer:-(2)Reports Null values for mismatched data

Discussion

8.	In how many ways RDD can be created?
Answer» In how many ways RDD can be CREATED? PLEASE choose the coorect OPTION from below list (1)4 (2)3 (3)2 (4)1 Answer:-(2)3

Discussion

9.	Which among the following is an example of Action?
Answer» Which among the following is an EXAMPLE of Action? Please choose the coorect option from below list (1)UNION() (2)map(func) (3)foreach(func) (4)CARTESIAN() Answer:-(3)foreach(func)

Discussion

10.	Dataframes are immutable in nature implies it is fault tolerant and highly available data structure.
Answer» Dataframes are immutable in nature implies it is fault TOLERANT and highly AVAILABLE data structure. Please choose the correct option from below list (1)TRUE (2)False Answer:-(1)True

Discussion

11.	Spark was first coded as a C project.
Answer» Spark was FIRST coded as a C project. Please choose the CORRECT OPTION from below list (1)False (2)True Answer:-(1)False

Discussion

12.	Which of the following provide the Spark Core s fast scheduling capability to perform streaming analytics.
Answer» Which of the following provide the SPARK Core s FAST scheduling capability to perform streaming analytics. Please choose the correct option from below list (1)RDD (2)GraphX (3)Spark Streaming (4)Spark R Answer:-(3)Spark Streaming

Discussion

13.	On can invoke PySpark shell by running the _________ command in Shell.
Answer» On can invoke PySpark shell by RUNNING the _________ command in Shell. Please CHOOSE the coorect option from below list (1)./bin/spark-shell (2)./bin/pyspark Answer:-(2)./bin/pyspark

Discussion

14.	Which of the following can be used to launch Spark jobs inside MapReduce ?
Answer» Which of the following can be used to launch Spark jobs INSIDE MAPREDUCE ? Please choose the coorect OPTION from below LIST (1)SIM (2)SIR (3)RIS (4)SIMR Answer:-(4)SIMR

Discussion

15.	External tables are used to store data outside the ____
Answer» External tables are used to STORE data outside the ____ Please CHOOSE the coorect option from below LIST (1)Hive (2)HDFS (3)Spark Answer:-(1)Hive

Discussion

16.	Spark SQL does not provide support for both reading and writing Parquet files.
Answer» Spark SQL does not provide support for both reading and writing Parquet files. Please CHOOSE the correct option from below LIST (1)True (2)FALSE Answer:-(2)False

Discussion

17.	Parquet stores nested data structures in a flat ________ format.
Answer» Parquet stores NESTED data structures in a flat ________ format. Please choose the correct option from below LIST (1)Binary (2)COLUMNAR Answer:-(2)Columnar

Discussion

18.	Which among the following programming languages does Spark support?
Answer» Which AMONG the FOLLOWING programming languages does Spark SUPPORT? Please choose the coorect OPTION from below list (1)Scala (2)Java (3)All the options (4)R (5)Python Answer:-(3)All the options

Discussion

19.	According to Spark advocates, how faster can Apache Spark potentially run batch-processing programs when processed in memory than MapReduce can?
Answer» According to Spark ADVOCATES, how faster can Apache Spark potentially run batch-processing programs when processed in memory than MapReduce can? PLEASE choose the coorect option from below list (1)50 times (2)10 times (3)20 times (4)100 times Answer:-(4)100 times

Discussion

20.	Spark SQL can read and write data from Hive Tables.
Answer» SPARK SQL can read and write DATA from Hive Tables. Please choose the correct option from below LIST (1)True (2)False Answer:-(1)True

Discussion

21.	Can we edit the data of RDD, for example, the case conversion?
Answer» Can we edit the DATA of RDD, for example, the CASE conversion? PLEASE CHOOSE the correct option from below list (1)Yes (2)No Answer:-(2)No

Discussion

22.	For any Spark functionality, the entry point is SparkContext.
Answer» For any SPARK functionality, the entry point is SparkContext. Please CHOOSE the correct OPTION from below list (1)False (2)True Answer:-(1)False

Discussion

23.	We cannot pass SQL queries directly to any DataFrame.
Answer» We cannot pass SQL QUERIES directly to any DataFrame. Please CHOOSE the COORECT option from below list (1)TRUE (2)False Answer:-(2)False

Discussion

24.	What are the features of Spark RDD?
Answer» What are the features of Spark RDD? Please choose the coorect option from below list (1)In-memory COMPUTATION (2)LAZY evaluations (3)Fault Tolerance (4)All of the above Answer:-(4)All of the above

Discussion

25.	How many Spark Context can be active per JVM?
Answer» How many Spark Context can be active per JVM? Please CHOOSE the coorect option from below LIST (1)More than one (2)Only one (3)Not SPECIFIC (4)None of the above Answer:-(2)Only one

Discussion

26.	How many tasks does Spark run on each partition?
Answer» How many tasks does SPARK run on each partition? Please CHOOSE the COORECT OPTION from below list (1)Any number of task (2)One (3)More than one LESS than five Answer:-(2)One

Discussion

27.	Which of the following is true for RDD?
Answer» Which of the following is true for RDD? PLEASE choose the correct option from below LIST (1)RDD is programming PARADIGM (2)RDD in Apache Spark is an immutable COLLECTION of objects (3)It is database (4)None of the above Answer:-(2)RDD in Apache Spark is an immutable collection of objects

Discussion

28.	Can you combine the libraries of Apache Spark into the same Application, for example,MLlib, GraphX, SQL and DataFrames e
Answer» Can you COMBINE the libraries of Apache Spark into the same APPLICATION, for example,MLlib, GraphX, SQL and DataFrames etc. Please choose the correct OPTION from below list (1)Yes (2)No Answer:-(1)Yes

Discussion

29.	Which of the following is not a transformation?
Answer» Which of the following is not a transformation? PLEASE choose the COORECT option from below list (1)Flatmap (2)Map (3)Reduce (4)Filter Answer:-(3)Reduce

Discussion

30.	You can connect R program to a Spark cluster from
Answer» You can CONNECT R program to a Spark cluster from Please choose the coorect option from below LIST (1)RStudio (2)R SHELL (3)Rscript (4)All of the above Answer:-(4)All of the above

Discussion

31.	Which of the following is not an action?
Answer» Which of the following is not an action? Please choose the COORECT option from below list (1)collect() (2)take(n) (3)TOP() (4)map Answer:-(4)map

Discussion

32.	Does Spark R make use of MLlib in any aspect?
Answer» Does Spark R MAKE use of MLLIB in any aspect? Please choose the coorect option from below list (1)YES (2)No ANswer:-(1)Yes

Discussion

Explore topic-wise InterviewSolutions in .

In case of External Tables, data needs to remain in the underlying location even after the user drops the table.

Spark SQL brings native support for SQL to Spark.

Which of the following is not a function of Spark Context in Apache Spark?

DataFrame is data organized into ______ columns.

Which among the following is an example of Transformation?

SparkContext uses Py4J to launch a JVM and create a __________

If the schema of the table does not match with the data types present in the file containing the table, then Hive ________

In how many ways RDD can be created?

Which among the following is an example of Action?

Dataframes are immutable in nature implies it is fault tolerant and highly available data structure.

Spark was first coded as a C project.

Which of the following provide the Spark Core s fast scheduling capability to perform streaming analytics.

On can invoke PySpark shell by running the _________ command in Shell.

Which of the following can be used to launch Spark jobs inside MapReduce ?

External tables are used to store data outside the ____

Spark SQL does not provide support for both reading and writing Parquet files.

Parquet stores nested data structures in a flat ________ format.

Which among the following programming languages does Spark support?

According to Spark advocates, how faster can Apache Spark potentially run batch-processing programs when processed in memory than MapReduce can?

Spark SQL can read and write data from Hive Tables.

Can we edit the data of RDD, for example, the case conversion?

For any Spark functionality, the entry point is SparkContext.

We cannot pass SQL queries directly to any DataFrame.

What are the features of Spark RDD?

How many Spark Context can be active per JVM?

How many tasks does Spark run on each partition?

Which of the following is true for RDD?

Can you combine the libraries of Apache Spark into the same Application, for example,MLlib, GraphX, SQL and DataFrames e

Which of the following is not a transformation?

You can connect R program to a Spark cluster from

Which of the following is not an action?

Does Spark R make use of MLlib in any aspect?