Saved Bookmarks
| 1. |
Where The Shuffle And Sort Process Does? |
|
Answer» After Mapper generate the output temporary store the intermediate data on the LOCAL File SYSTEM. Usually this temporary file configured at coresite.xml in the Hadoop file. Hadoop Framework aggregate and sort this intermediate data, then UPDATE into Hadoop to be processed by the Reduce function. The Framework deletes this temporary data in the local system after Hadoop completes the job. After Mapper generate the output temporary store the intermediate data on the local File System. Usually this temporary file configured at coresite.xml in the Hadoop file. Hadoop Framework aggregate and sort this intermediate data, then update into Hadoop to be processed by the Reduce function. The Framework deletes this temporary data in the local system after Hadoop completes the job. |
|