Blogger introduction : Currently engaged in data warehouse development, big data development, and report development in the manufacturing industry. Personally, I am a continuous learner and a self-defeating person. Focus on technology sharing, the main group is college students, because it is very painful when I get started, and I don’t want to make others suffer, so I will write some articles to make everyone’s entry easier and more convenient. Of course, many people also privately message me. I am sometimes very tired, and I really don't have the energy to do so many things. Maybe some messages will not be answered one by one. I will update the video of station B from time to time, and then respond to your questions. Hope to help you all.
Learning method : I just started learning technology in college, and I always want to eat a fat man in one go, which is not desirable. Because knowledge is systematic, learning knowledge has to be done step by step. After I learned it before, I always thought that I would be able to know everything. As a result, when I graduated, I knew a little bit of everything, but I didn’t know much about everything. Now I also have this problem, but since I chose the full stack, I basically don’t learn all the knowledge. People can’t do anything in the face of boundless knowledge, and can only learn a certain part. So it is very important to build your own knowledge system. At present, I have roughly established this knowledge system from the data warehouse, including index confirmation, data warehouse construction, data entry into the lake, report development, and index reporting.
Recently, I met some people and chatted a bit, and I felt that I was lacking in many aspects. If you don't know enough, you can improve it by changing it.
Being able to recognize yourself is not yourself, but the feedback from others, and then you use the feedback from others to fully understand yourself, revise your weaknesses, and then develop your strengths. Your behaviors and actions give others an impression, and then the other party can summarize what kind of person you are through your behavior, how you need to get along, give you a user portrait, and finally find out how to treat you.
The manager is to use the character, and then treat different people in different ways. What kind of people do what kind of things, extroverts can do sales, introverts can do technology.
First of all, you need to know what you like, whether you like pure development or dealing with users to make demands. Many students do not know what kind of person they are, what kind of career they like, and then work in a daze, not getting the grades they want, and it is still very hard. I suggest you go to more interviews and talk to other people more so that you can know your own shortcomings. In fact, during the four years I graduated from university, I was constantly thinking about what I liked and what I wanted to do. I've been thinking about what I'm going to do until now, and I've probably found a direction, and I'm very happy.
I came into contact with CSDN in my sophomore year. I am a person who likes to share very much. I have learned something, and I especially like to tell others. In the process of speaking, you will understand it again, and it will be more profound. I can’t do my homework in junior high school, but I will give other classmates to give questions, and then the teacher always tells me that I don’t do homework. In fact, I have written a question several times by myself. So later I summed up the process of your sharing knowledge, which is the process of your understanding.
Recently, when I was interviewing for a big data development position, I found that I had been working for nearly four years. It seemed that the breadth of knowledge was ok, but the depth of knowledge was insufficient. Java, Python, Oracle, Hadoop, Impala, Hive, Kudu, Sqoop, Kettle have all been exposed, but they are just floating on the surface without going deep. The interviewer said that I should not only list the nouns in the interview, but also master each one. Therefore, I will outline the directions that we will learn and deepen in the future, and we will all walk together.
Technology stack: Java+Python+Hadoop+Hive+Kudu+Kettle+Impala
Java: Self-taught JSP, SSM, SSH, Springboot, should be more than enough to deal with course design. The front-end is also in touch again. Like Bootstrap and Layui, I have not studied systematically. This needs to be strengthened.
Python: I just wrote a crawler and a program to restart Tomcat. The basic knowledge has been learned, but after learning it, it is forgotten if it is not applied.
For Oracle: Proficiency in SQL statements and familiarity with SQL optimization. Of course, theoretical knowledge needs to be strengthened, such as partition type, index invalidation, and so on. Theoretical knowledge needs to be strengthened.
Hadoop: Master the common commands of Hadoop, but lack of specific theoretical knowledge.
Hive: This is used a lot in work, so basically everyone knows this knowledge. For example, the common commands of Hive, the writing of HiveSQL, the design of tables, etc.
Kudu: There are more contacts in this area, so there is no need to make up for this.
Sqoop: Recently, Sqoop is used to draw numbers. This is faster to draw numbers directly. I think it is faster than Kettle. There was a Job that ran for about 3000s before, and it stabilized at about 300s after using Sqoop.
Kettle: Be able to use Kettle for ETL development, import Oracle tables to big data, and convert between big data tables.
Summary : I found out that I have the potential to become a full-stack engineer, to be a full-stack engineer, to continue to learn, to continue to love life, and to enjoy life. If you have any confusion, you can leave a message to me, and I will post a video after I collect it, and then answer it. Thank you for reading this time, don't forget to give a like, I wish you a happy, healthy and happy!
Note : The above pictures are from Baidu