Wednesday, November 7, 2012

Configure eclipse map reduce plugin for hadoop

Hadoop Eclipse Plug-in can be downloaded from this link .

The Hadoop Eclipse Plug-in provides tools to ease the experience of Map/Reduce on Hadoop. Among other things, the plug-in provides support to:
  1. create Mapper, Reducer, Driver classes;
  2. browse and interact with distributed file systems;
  3. submit jobs and monitor their execution.
Now to configure the plugin you need to follow these steps

  1. Move  the jar file you have downloaded in the plugins folder of your eclipse installation.
  2. Restart the Eclipse and switch to  map-reduce perspective from Window-> open perspective ->other 
  3. Now set your DFS location by selecting create new location in Map/Reduce locations area.
  4. Enter the name of your location and specify the ports.
  5. Add the port numbers of JobTracker and DFS as specified in conf/mapred-site.xml and  conf/core-site.xml files.


  6.  Now create new map-reduce project and configure your Hadoop installation directory. 
  7. Now you can start off by creating mapper and reducer classes.
  8. To run your project select run on Hadoop in the run configuration.

No comments:

Post a Comment