HOW DOES SPECULATIVE EXECUTION WORK IN HADOOP?

jayprakash sharma

Total Post:11

Points:55
Posted by  jayprakash sharma
Hadoop 
 850  View(s)
Ratings:
Rate this:
  1. jayprakash sharma

    Post:11

    Points:55
    How does speculative execution work in Hadoop?

    JobTracker makes different TaskTrackers process same input. When tasks complete, they announce this fact to the JobTracker. Whichever copy of a task finishes first becomes the definitive copy. If other copies were executing speculatively, Hadoop tells the TaskTrackers to abandon the tasks and discard their outputs. The Reducers then receive their inputs from whichever Mapper completed successfully, first.When data is injected for map reduce job in Hadoop, the Job tracker takes care of the job and distributes the task to task tracker

      Modified On Apr-20-2016 01:22:00 AM

Answer

NEWSLETTER

Enter your email address here always to be updated. We promise not to spam!