What is HDFS- Hadoop Distributed File System?

1.	What is HDFS- Hadoop Distributed File System?
Answer» Hadoop distributed file system (HDFS) is the primary storage system of Hadoop. HDFS STORES very large files running on a cluster of commodity hardware. It WORKS on the principle of storage of less number of large files rather than the huge number of small files. HDFS stores data reliably even in the case of hardware failure. It provides high throughput access to the application by accessing in parallel. Components of HDFS: NameNode – It is also known as Master node. Namenode stores meta-data i.e. number of blocks, their replicas and other details. DATANODE – It is also known as Slave. In Hadoop HDFS, DataNode is responsible for storing actual data. DataNode PERFORMS read and write operation as PER request for the clients in HDFS.

Answer»

Hadoop distributed file system (HDFS) is the primary storage system of Hadoop. HDFS STORES very large files running on a cluster of commodity hardware. It WORKS on the principle of storage of less number of large files rather than the huge number of small files.

HDFS stores data reliably even in the case of hardware failure. It provides high throughput access to the application by accessing in parallel. Components of HDFS:

NameNode – It is also known as Master node. Namenode stores meta-data i.e. number of blocks, their replicas and other details.
DATANODE – It is also known as Slave. In Hadoop HDFS, DataNode is responsible for storing actual data. DataNode PERFORMS read and write operation as PER request for the clients in HDFS.

Discussion

No Comment Found

Related InterviewSolutions

How sentry Architecture is helping Hadoop services to get secure? How Hive, Impala, HDFS and search activities are working with Sentry.
How LDAP, Active Directory and Kerberos will help the Hadoop environment to get secure?
Brief about the few optimizing techniques for the Hive performance.
How HIVE Database and IMPALA are working together in CLOUDERA?
In your MapReduce job you consistently see that MapReduce map tasks on your cluster are running slowly because of excessive garbage collection of JVM. How do you increase JVM heap size property to 3GB to optimize performance?
You have installed a cluster HDFS and Map Reduce version 2 on YARN. You have no dfs.hosts entries in your hdfs-site.xml configuration file. You configure a new worker node by setting fs.default.name in its configuration files to point to the Name Node on your cluster, and you start the Data Node daemon on that worker node. What do you have to do on the cluster to allow the worker node to join, and start sorting HDFS blocks?
You observed that the number of spilled records from Map tasks far exceeds the number of map output records. Your child heap size is 1gb and your io.sort.mb value is set to 1000mb. How would you tune your io.sort? Mb value to achieve maximum memory to I/O ratio.
<property> <name>yarn.nodemanager.resource.memory-mb</name> <value>102400</value> </property> <property> <name>yarn.nodemanager.resource.cpu-vcores</name> <value>48</value> </property> <name>yarn.scheduler.minimum-allocation-mb</name> <value> what is the correct value here</value>
Each node in your Hadoop cluster with running YARN and has 140GB memory and 40 cores .your yarn-site.xml has the configuration as shown below. you want YARN to launch a maximum of 100 containers per node. Enter the property value that would restrict YARN from launching more than 100 containers per node.
What is HDFS Snapshot how it helps you to recover

What is HDFS- Hadoop Distributed File System?

Discussion

No Comment Found

Related InterviewSolutions

Reply to Comment