2012-10-14

Writing An Hadoop MapReduce Program In Python

Great article: Writing An Hadoop MapReduce Program In Python


My bash history (replace "const" with your username):
  543  cd /usr/local/Cellar/hadoop/1.0.3/libexec
  544  hadoop dfs -copyFromLocal /Users/const/Dev/PrjGit/mrpy/tmp/ /user/const/mrpy
  545  hadoop dfs -la
  546  hadoop dfs -ls
  547  hadoop dfs -ls /user/const/mrpy/
  550  jar /usr/local/Cellar/hadoop/1.0.3/libexec/contrib/streaming/hadoop-*streaming*.jar -file /Users/const/Dev/PrjGit/mrpy/mapper.py -mapper /Users/const/Dev/PrjGit/mrpy/mapper.py -file /Users/const/Dev/PrjGit/mrpy/reducer.py -reducer /Users/const/Dev/PrjGit/mrpy/reducer.py -input /user/const/mrpy/* -output /user/const/mrpy-output
  551  hadoop dfs -ls /user/const/mrpy-output
  552  hadoop dfs -cat /user/const/mrpy-output/part-00000

Комментариев нет:

Отправить комментарий