|[eclipse-incubator-e4-dev][resources] hadoop DFS|
Hi Folks,I've mentioned replication for distributed file systems in several previous notes, but I haven't said much about it. Rather than talk a lot about it myself, I thought I would point to an apache project called 'Hadoop Distributed FS' (HDFS) as it's based upon replication at the file block level...and is similar in approach to the Google File System (GFS).
One thought I've had (but not persued yet), is that perhaps an EFS implementation (with synchronous API) could be written that uses Hadoop DFS to implement EFS above. Although I'm not sure whether Hadoop can/could support all the operations that EFS has currently (e.g. notification)...not to mention other EFS API additions that are being considered for e4.
Scott Hadoop Home Page: http://hadoop.apache.org/core/ Hadoop File System: http://wiki.apache.org/hadoop/DFSHDFS arch and design: http://hadoop.apache.org/core/docs/current/hdfs_design.html
Back to the top