Recommended books: the Light of mathematical beauty, civilization] - Wu Jun, the
Cloud computing - Big Data
Operation and maintenance
|
Linux operating system (Windows-- Desktop Engineer)
|
------------------------------------ -------------------------------------------------- ---
| | |
Linux operation and maintenance of virtualized Hadoop + JAVA = large data storage direction
(web framework) | |
(with their own personal website) operstack ----------------- -------------------------------------------------- -----------------
| | | | | | ....
docker(k8s) HDFS map-reduces spark zookeeper HIve
(scala) （mysql）
Development - computer language
BASIC: early machine language
c c ++: systems development, driver development, embedded development (writing board)
(driver: the need to convert between the various manufacturers instruction set, allowing interoperability between equipment manufacturers)
Front: JS phs css html
JAVA
Tools: shell \ perl \ python
Database: MySQL, nosql
Data storage: Disk (shared) {SAS, NHDFSAS, DAS (specifically the data stored in the disk array)
{Distributed storage architecture (HDFS) - Cluster (application)
System: Linux
Algorithm:
1.map of reduces [-cluster data processing: it is huge amounts of data in a certain way, to modify the relationship between the key (Key-value)
2. mathematically (statistically) + python = Algorithm
3. Data Visualization
Introduction of the operating system
1, the operating system is doing?
----- nexus internet
on: Application of
the: a hardware device (Resource)
three member hardware platform: the CPU memory I / O (input and output devices)
or five component --- operator input device controller memory output device)
the CPU : handle all of computing
memory : providing data (CPU can only read data to the memory), reboot the new system, data in memory will be lost to the CPU;
the CPU reads the memory specified (required data), this process, addressing :( we call physical address, logical address)
IO device : network card (adapter adapater); Ethernet (Ethernet)
disk (IDE, SAS, SSD) --- mechanical drive, mechanical drive, solid state disk
knowledge expansion:
of the OSI seven model four layer model ----------------------------------- tcp / IP is
application layer --- QQ | application layer
Presentation layer --- instruction conversion |
session layer --- session to establish a session |
--- transport layer port distinguished by the application | transport layer,
network layer, the IP --- | network layer
a data link layer address of the MAC --- | host-to-host layer,
a physical layer --- specific physical device (a hardware device) |
[ lower for the upper layer to provide services]
The operating system itself is a software program, but it does not directly provide customers with the application, but to provide hardware resources for other applications;
the operating system is divided into - user space and kernel space