2019/07/30
Teacher Recommended reading: mathematical beauty
light of civilization
IT knowledge infrastructure
cloud computing - Big Data
1.
Customer
(result)
refrigerator + raw material (milk) = + touch with the (ice cream)
raw material (milk):
Data storage: disk - | --SAN NAS DAS (specifically the data stored on disk arrays)
(main) | - Distribution storage architecture (HDFS) - cluster (applications)
store massive amounts of data
Refrigerator:
System: -linux (big data applications)
Mold:
1.map data-processing clusters of reduces [(into numeric data: :) and character: he is the data in a certain way, to modify the relationship between the value (Key-value)
the HDFS + = the Hadoop Cluster Map-of reduces [ (running on Linux, a high-performance cluster)
algorithms:
2. mathematics (statistics) + Python (tools, call different modules, in order to achieve the desired function)
3. Data Visualization
2. The
operation and maintenance
|
Linux operating system (windows- Desktop Engineer)
|
----------------------------------- -------------------------------------------------- ---------------------------------------
| | |
Linux operation and maintenance of virtualization KVM \ XEN hadoop + JAVA = large data storage direction
(web framework) | |
(build your own personal website) openstack ---------------------------- ----------------------------------------------
| | | | | | | | | | |
docker（k8s） HDFS mr Hive/SQL zookeeper ... spark
（scala）
Development - computer language
first language basic, mechanical language.
C language is the closest compilation of high-level language, C ++: systems development, drive (which means a program of high-end computer software and hardware interaction permission.) Development, embedded development (writing board)
(driver: the need to convert various equipment manufacturers between a set of instructions, allowing interoperability between equipment manufacturers)
front end: JS php css html
JAVA
Tools: scripting language --shell \ perl \ python
database; MySQL, nosql
3. Operating System Introduction
(1) operating system doing?
Platform - nexus
on: Application of
the: a hardware device (Resource)
three member hardware platforms: CPU memory, I / O devices
(operator input device controller memory output apparatus)
CPU: all operations of the
memory: providing data to the CPU (cpu can only read data to the memory), reboot the system will be lost (hard disk :)
the CPU reads the memory specified (required data), a process we call addressing; (a physical address, logical address)
IO device: NIC (adapter adapter): Ethernet (Ethernet)
disk (IDE, SAS, SSD) mechanical disks, solid-state disk
Extended knowledge:
of the OSI seven-layer model ------------------------------------------- --------- TCP / IP four-layer model
The application layer - QQ | application layer
presentation layer - transfer instruction |
Session layer - establishes a session (the session) |
transport layer - distinguished by the application port | transport layer,
network layer the PE - IP | network layer
a data link layer - MAC address (ipconfig / all view physical address) | host-to-host layer,
a physical layer - specific physical device (a hardware device) |
[Serve] for the upper lower
The operating system itself is a software program, but it does not directly provide customers with the application, but to provide hardware resources for other applications,
the operating system is divided: user space and kernel space
