Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

Variations in Outcome for the Same Map Reduce Transitive Closure Algorithm Implemented on Different Hadoop Platforms

google+
Views: 19                 

Author :  Purvi Parmar, MaryEtta Morris, John R. Talburt and Huzaifa F. Syed

Affiliation :  Center for Advanced Research in Entity Resolution and Information Quality University of Arkansas at Little Rock Little Rock, Arkansas, USA

Country :  USA

Category :  Computer Science & Information Technology

Volume, Issue, Month, Year :  12, 4, April, 2020

Abstract :


This paper describes the outcome of an attempt to implement the same transitive closure (TC) algorithm for Apache MapReduce running on different Apache Hadoop distributions. Apache MapReduce is a software framework used with Apache Hadoop, which has become the de facto standard platform for processing and storing large amounts of data in a distributed computing environment. The research presented here focuses on the variations observed among the results of an efficient iterative transitive closure algorithm when run against different distributed environments. The results from these comparisons were validated against the benchmark results from OYSTER, an open source Entity Resolution system. The experiment results highlighted the inconsistencies that can occur when using the same codebase with different implementations of Map Reduce.

Keyword :  Entity Resolution, Hadoop, MapReduce, Transitive Closure, HDFS, Cloudera, Talend.

Journal/ Proceedings Name :  International Journal of Computer Science & Information Technology (IJCSIT)

URL :  https://aircconline.com/ijcsit/V12N4/12420ijcsit03.pdf

User Name : Selina
Posted 15-10-2026 on 10:45:35 AEDT



Related Research Work

  • Classification Of Lungs Images For Detecting Nodules Using Machine Learning
  • An Integer-linear Algorithm For Optimizing Energy Efficiency In Data Centers
  • Wireless Biometric Fingerprint Attendance System Using Arduino And Mysql Database
  • An Optimized Disk Scheduling Algorithm With Bad-sector Management

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals