BOOM-FS Extensibility: Scalability

  • NameNode is heavy loaded in this system.

  • The solution for this is to scale-out NameNode across many nodes.

  • Having exposed the system state in tables this feature can be implement by partitioning these tables across nodes (NameNodes).

  • Partitioning based on hash of fully qualified pathname of a file.

  • The implementation took only 8 person-hours.