MapReduce : Simplified Data Processing on Large Cluster

International Journal of Research and Engineering

View Publication Info
Field Value
Title MapReduce : Simplified Data Processing on Large Cluster
Creator Dayalan, Muthu
Description MapReduce is a data processing approach, where a single machine acts as a master, assigning map/reduce tasks to all the other machines attached in the cluster. Technically, it could be considered as a programming model, which is applied in generating, implementation and generating large data sets. The key concept behind MapReduce is that the programmer is required to state the current problem in two basic functions, map and reduce. The scalability is handles within the system, rather than being handled by the concerned programmer. By applying various restrictions on the applied programming style, MapReduce performs several moderated functions such fault tolerance, locality optimization, load balancing as well as massive parallelization. Intermediate k/v pairs are generated by the Map, and then fed o the reduce workers by the use of the incorporated file system. The data received by the reduce workers is then merged using the same key, to produce multiple output file to the concerned user (Dean & Ghemawat, 2008). Additionally, the programmer is only required to master and write the codes regarding the easy to understand functionality.
Publisher IJRE Publisher
Date 2018-06-04
Type info:eu-repo/semantics/article
Peer-reviewed Article
Format application/pdf
Source International Journal of Research and Engineering; Vol 5 No 5 (2018): May 2018 Edition; 399-403
Language eng
Rights Copyright (c) 2018 Muthu Dayalan

Contact Us

The PKP Index is an initiative of the Public Knowledge Project.

For PKP Publishing Services please use the PKP|PS contact form.

For support with PKP software we encourage users to consult our wiki for documentation and search our support forums.

For any other correspondence feel free to contact us using the PKP contact form.

Find Us


Copyright © 2015-2018 Simon Fraser University Library