Wisdom map
1) Draw the business architecture and technical architecture that you mainly participate in your work and mark the parts you implement
Requirement: write out the version number of the big data-related system
2) There are 500,000 non-repeating integers, from which 100,000 non-repeating integers are randomly selected.
To: The execution time is as short as possible, and the code is realized (the development language is not limited, and the MR method is not required to solve it)
3) Give an example of a business scenario at work and describe the process of MR
4) Kafka or flume operating mechanism and design implementation description
5) Count the logs for a month, and count uv and newly added uv according to the user id in the log. The newly added uv on the first day of each month is equal to the uv of the day; the new uv on the second day is equal to the uv on two days and the uv on the first day is excluded; the uv added on the third day is equal to the uv on the third day. Uv.
Requirement: The uv with the id of the whole month cannot be stored in the memory for re-removal processing, resulting in frequent io calls. How to optimize? Draw a picture to describe the process of optimizing this business.
6) Commands and parameters commonly used in Linux. (Exclude the command cd ls vi)
Requirements: no less than 3 commands, at least 2 parameter descriptions for each command