Home > DeveloperSection > Interviews > How does speculative execution work in Hadoop?

Posted on    January-20-2015 10:30 PM

 .NET Hadoop 
Ratings:
 1 Answer(s)
  571  View(s)
Rate this:

jayprakash sharma
jayprakash sharma

Total Post:11

Points:55
Posted on    January-20-2015 11:30 PM

JobTracker makes different TaskTrackers process same input. When tasks complete, they announce this fact to the JobTracker. Whichever copy of a task finishes first becomes the definitive copy. If other copies were executing speculatively, Hadoop tells the TaskTrackers to abandon the tasks and discard their outputs. The Reducers then receive their inputs from whichever Mapper completed successfully, first.When data is injected for map reduce job in Hadoop, the Job tracker takes care of the job and distributes the task to task tracker

Modified On Apr-20-2016 01:22:00 AM

Don't want to miss updates? Please click the below button!

Follow MindStick