Elly is a Hadoop HDFS and Yarn client. It provides:
- A familiar Julia
ClusterManagerinterface, making it possible to use the familiar Julia parallel constructs on any Hadoop/Yarn cluster:addprocs,@parallel,spawn,pmap, etc. - Lower level APIs to write native Yarn applications.
- A familiar Julia IO API for accessing HDFS files. It is a pure Julia
implementation with no dependencies on
libhdfs.
- Since Elly uses the newer Protobuf interface, it requires a Hadoop 2.2+ distribution.
