foreword
Every year around the Spring Festival, there will be a small climax of Python part-time orders. During this time, the demand for reptiles and data classification in various industries will skyrocket! Many friends in the circle are not idle, and there are not a few who earn tens of thousands in two days.
Recently, I found that there are many problems with technology realization and part-time orders. I summed it up and found that most people have the same confusion.
- I heard that Python is very profitable to do part-time jobs, I want to do it, but I don't know how to start with 0 basics
- I want to take up private work, I am not familiar with mainstream technologies, and have little actual combat experience. I am worried that the project will not be completed.
- I have never taken over private work, and I am not familiar with project pricing. I am inexperienced and worried about stepping on the pit.
What kind of private life can I take?
When I first learned Python, a friend introduced me to take orders for private work, to crawl data for a company, and I earned 5.5K for that order. Since then, I have gradually become proficient. In my spare time, I have successively received many orders for data collection and processing. Later, I can earn about 20,000 per month by part-time work .
Python technology receives more orders and earns more money, and it is generally reptiles.
It mainly crawls the data of websites, small programs or APPs, analyzes and processes the data, or directly provides crawler programs and technical support to customers.
What skills do you need to master?
Reptiles, as the most used technology for receiving orders, are a must-have skill for part-time jobs. But many people say that reptiles are a bit complicated, and they haven't mastered it for a long time. In fact, after mastering the correct implementation ideas , reptiles learn quickly.
First of all, let's understand how the crawler works. The crawler usually consists of four steps: target information website , page crawling , page analysis , and data storage .
The detailed process of crawling website resources is as follows:
- Import the corresponding library for request and web page parsing
- Then request the web page to get the source code
- Initialize the Soup object
- Open the landing page with a browser
- Locate the location of the required resources
- Then analyze the source code at that location
- Find tags and attributes for targeting
- Finally, write the parsing code to get the desired resource
Common technical issues
After being familiar with the principles and processes, the data of general websites can be easily crawled. Of course, this does not mean that this is enough. The real valuable resources are often in large sites with perfect anti-crawling measures.
At this time, it is the key link of Python crawler learning - website anti-crawling strategy and its countermeasures . Here are some common mainstream anti-climbing measures:
- The target detects that the crawler has blocked the IP
- The target returned encrypted data
- Target returned dirty data, unrecognizable
- Target website must be logged in to access
- Javascript dynamic rendering, crawler can not read
- The target website has a verification code and cannot be accessed
- Ajax asynchronous transmission, crawler grabs empty information
- Image camouflage and obfuscation + CSS offset + SVG mapping
If these problems are not solved, valuable resources will not be climbed.
With zero experience and zero foundation, how to learn technology to make money?
For friends who want to use Python to develop a side business to make money, but lack part-time experience and are not familiar with mainstream technologies. I recommend a complete set of Python learning materials, and I hope to give some help to those who want to learn Python! (There is a free way to get it at the end of the article)
1. Learning routes in all directions of Python
It is good to learn Python whether it is employment or a side business to make money, but to learn Python, you must have a learning plan; all directions of Python are to sort out the technical points commonly used in Python and form a summary of knowledge points in various fields. Its usefulness lies in , you can find the corresponding learning resources according to the above knowledge points to ensure that you can learn more comprehensively.
2. Python development tools
As the saying goes: If a worker wants to do a good job, he must first sharpen his tool, and the learning of Python is the same.
3. Python learning books
Four, Python video collection
Watching zero-based learning videos is the quickest and most effective way to learn. Following the teacher's ideas in the video, from basic to in-depth, it is still very easy to get started.
It is suitable for watching with absolutely zero-based friends. Every knowledge point is explained very delicately, from shallow to deep. The fineness of the content is unprecedented, and each knowledge point is explained in the way of "breaking apart and smashing it into pieces".
Although the video is specially tailored for Xiaobai, the course greatly extends each knowledge point.
It is suitable for non-computer majors, friends who want to switch to Python, or students who want to have a solid Python foundation to lay a solid foundation for future development.
This full version of Python's full set of learning materials has been uploaded to the official CSDN. If you need it, you can scan the official CSDN official certification QR code below on WeChat to get it for free [ guaranteed 100% free ].
5. Practical cases
Optical theory is useless. You have to learn to follow along, and you have to do practical exercises before you can apply what you have learned to practice. At this time, you can learn from actual combat cases.
Six, Python practice questions
Check the learning results.
Seven, interview questions
We must learn Python in order to find a high-paying job. The following interview questions are the latest interview materials from first-tier Internet companies such as Ali, Tencent, and Byte, and some Ali bosses have given authoritative answers. After finishing this set The interview materials believe that everyone can find a satisfactory job.
This full version of Python's full set of learning materials has been uploaded to the official CSDN. If you need it, you can scan the official CSDN official certification QR code below on WeChat to get it for free [ guaranteed 100% free ].
