- https://github.com/erikfrey/bashreduce/tree/master
- Author blog: http://blog.last.fm/2009/04/06/mapreduce-bash-script
- I think the script can be further optimized for concurrent applications. There should be more efficient ways than TCP/IP for mappers and reducers to communicate on a single node.
- Multiple choices available. Need more comparison details.
- https://www.npmjs.com/package/mapred
- https://github.com/dominictarr/map-reduce
- https://github.com/chriso/node.io (popular but no longer maintained)
- http://www.mapjs.org (obsolete)
- https://github.com/twitter/scalding
- Use Spark if possible.
No comments:
Post a Comment