A, IT knowledge framework
--- Big Data Cloud Computing
(A) big data cloud computing ---
1, operation and maintenance
|
Linux operating system (Windows-- Desktop Engineer)
------------------------- -------------------------------
| | |
Linux operation and maintenance of virtualization KVM \ XEN Hadoop + JAVA = large data storage direction
(web framework) | |
(build your own personal website) openstack ------------------------------------ -----------------
| | | | | | |
Docker (K8S) HDFS mr Hive ZooKeeper ...... the Spark
SQL (Scala)
2, --- develop computer language
BASIC early machine language
C C ++: systems development, driver development, embedded development (writing board)
(driver: set of instructions need to convert between the various equipment manufacturers, so the manufacturers interoperability between devices)
front-end: JS PHP HTML CSS JAVA
tools: Scripting languages --- shell \ perl \ python
(B) algorithm
clients
(result)
refrigerator + milk + Mold = (ice cream)
Data storage: disk (shared) --- | --- SAN, NAS, DAS
| (specifically the data stored on disk arrays)
| --- distributed storage architecture (HDFS) --- cluster (application)
refrigerator
system --- Linux (mainframe)
mold
1, mapreduces data processing cluster: it is the vast amounts of data modification is the key relationship (key in a certain way -value)
the HDFS + = Map-of reduces [the Hadoop cluster (running on a high-performance cluster of Linux)
algorithm: 2, mathematically (statistically) + Python = algorithm
3, data visualization
Second, the operating system Introduction
1. The operating system is doing?
Platform - - - - - nexus
on: Application of
the: a hardware device (Resource)
three member hardware platforms: CPU, memory, I / O devices
of the five components of the computer: computing, controller, memory, input devices, output equipment
CPU: All operations memory: providing data (data required) (CPU can only read data to the memory) to restart the system memory to the designated CPU, a process we call addressing. (Physical address and logical address)
I / O devices: network card (adapter adapter): Ethernet (Ethernet)
disk (IDE mechanical disk, SAS mechanical disk, SSD solid state disk)
knowledge expansion:
| osi seven layer model |
TCP / IP four-layer model |
| Application Layer --- QQ |
Application layer |
| The presentation layer --- instruction converter |
|
| Session Layer --- session to establish a session |
|
| Transport Layer --- by discriminating the application port |
Transport Layer |
| Network Layer --- IP |
Network layer |
| Data link layer --- the MAC address |
Host-to-host layer |
| The physical layer --- specific physical device (a hardware device) |
[Serve] for the upper lower
The operating system itself is a software program, but it does not directly provide customers with the application, but to provide hardware resources for other applications;
the operating system is divided into user space and kernel space