HDFS overall operating mechanism

hdfs: Distributed File System

Hdfs common features with the file system:

  1. There directory structure, the top-level directory is: /
  2. The system is stored in file
  3. The system can provide file: create, delete, modify, view, movement and other functions

hdfs a difference with the ordinary stand-alone file system:

  1. Single file stored in the file system, is the operating system of a machine
  2. hdfs file system across many machines as N
  3. Single file stored in the file system is on a machine disk
  4. Hdfs file stored in the file system, a multi-machine n falls single local file system (hdfs linux is a local file system on the file system)

hdfs working mechanism:

  1. Customers put a file into hdfs, in fact, after hdfs will cut this document, distributed storage in N linux machine system (role is responsible for the storage of file blocks: the Data the Node ) <precisely: diced behavior by the customer the decision to end >
  2. Once the file is stored into cubes, then, hdfs in there must be a mechanism to record the user's cut information for each file, and each piece of machine-specific storage (responsible role block information is recorded: name the Node )
  3. To ensure data security, hdfs can block each file in a cluster to store multiple copies ( in the end keep a few copies, it is specified by the time the file is stored in the client)

Summary: hdfs a system, a server running a namenode, N, and running of the servers datanode! 

 Working mechanism Figure

Published 18 original articles · won praise 0 · Views 344

Guess you like

Origin blog.csdn.net/Mr_ye931/article/details/105320380