foreword
Today is the 3rd day after the holiday, do friends with "post-holiday syndrome" feel better? <(￣︶￣)>
After the Spring Festival every year, there will be a climax of Python part-time orders. Recently, the demand for reptiles and digital classification in various industries has skyrocketed, and many friends also need to take orders to "return blood" after the New Year.
In previous years, after the Spring Festival started, there were not a few people who made tens of thousands of orders in two days. As early as the fifth day of the new year, CSDN has more than 99+ messages asking about technology realization & part-time orders
- The New Year is too expensive, I want to take orders and return blood, but I have no experience and I am afraid of stepping on the pit
- I heard that part-time Python is very profitable, and I want to do it. How to start with 0 basics?
- I want to take up private work, but I have little technical experience and worry about not being able to handle the project
What orders can I take part-time jobs?
The first time I earned 2.8K part-time, it was to crawl data for a company. At that time, I just learned Python and took orders with the introduction and help of my friends. Since then, I have become more proficient, and often receive orders for data collection and processing. My monthly part-time income is not less than 10,000.
To sum up, Python requires many orders, almost all of which are reptiles. It mainly crawls the data of websites, small programs or APPs, analyzes and processes the data, or directly provides crawler programs to customers.
Where can I take orders?
Yuanjisong: https://www.yuanjisong.com
Outsourcing Master: http://www.waibaodashi.com
Renren Development: http://www.rrkf.com
Code Easy Crowdsourcing Platform: https://www.mayigeek .com
Open Source Crowdsourcing: https://zb.oschina.net
I Love Solution Network: http://www.52solution.com
British Choice: https://www.yingxuan.io Zhichou
: http://zhichou. com
Development State: https://www.kaifabang.com
Code Market: https://codemart.com Freelancer
: http://www.freekeer.com
Zhu Bajie: https://luoyang.zbj.com
…
What technologies are required to take orders?
Python crawler, as the most used technology for receiving orders, is a must-have skill for part-time jobs. Many people say that crawlers are complicated and hard to learn, but in fact, after mastering the correct implementation ideas, it is very fast to get started with crawlers.
Here is how the crawler works. The crawler usually consists of four steps: target information website, page crawling, page analysis, and data storage. The detailed process of crawling website resources is as follows:
-
Import the corresponding library for request and web page parsing
-
Then request the web page to get the source code
-
Initialize the Soup object
-
Open the landing page with a browser
-
Locate the location of the required resources
-
Then analyze the source code at that location
-
Find tags and attributes for targeting
-
Finally, write the parsing code to get the desired resource
Summary of key technologies
After understanding the principles and processes, you can crawl the data of ordinary websites at will. But this is far from enough! Because the really valuable data is often in large sites with perfect anti-crawling measures!
Here, what I want to introduce is the key link of crawler learning - website anti-crawling strategy and its countermeasures. Common mainstream anti-climbing measures:
-
The target detects that the crawler has blocked the IP
-
The target returned encrypted data
-
Target returned dirty data, unrecognizable
-
Target website must be logged in to access
-
Javascript dynamic rendering, crawler can not read
-
The target website has a verification code and cannot be accessed
-
Ajax asynchronous transmission, crawler grabs empty information
-
Image camouflage and obfuscation + CSS offset + SVG mapping
If these anti-climbing measures cannot be solved, valuable resources will not be climbed.
0 experience 0 foundation, how to learn technology to make money?
For those who spend too much in the New Year and want to use Python to start a side business to make more money after the new year, but lack part-time experience, and are not familiar with crawler and anti-crawler technology , the complete set of Python learning materials shared below hope to help you.
1. Learning routes in all directions of Python
All directions of Python are to organize the technical points commonly used in Python to form a summary of knowledge points in various fields. Its usefulness is that you can find corresponding learning resources according to the above knowledge points to ensure that you can learn more comprehensively.
2. Python development tools
As the saying goes: If a worker wants to do a good job, he must first sharpen his tool, and the learning of Python is the same.
3. Python learning books
Four, Python video collection
Watching zero-based learning videos is the quickest and most effective way to learn. Following the teacher's ideas in the video, from basic to in-depth, it is still very easy to get started.
It is suitable for watching with absolutely zero-based friends. Every knowledge point is explained very delicately, from shallow to deep. The fineness of the content is unprecedented, and each knowledge point is explained in the way of "breaking apart and smashing it into pieces".
Although the video is specially tailored for Xiaobai, the course greatly extends each knowledge point.
It is suitable for non-computer majors, friends who want to switch to Python, or students who want to have a solid Python foundation to lay a solid foundation for future development.
5. Practical cases
Optical theory is useless. You have to learn to follow along, and you have to do practical exercises before you can apply what you have learned to practice. At this time, you can learn from actual combat cases.
Six, Python practice questions
Check the learning results.
Seven, interview questions
We must learn Python in order to find a high-paying job. The following interview questions are the latest interview materials from first-tier Internet companies such as Ali, Tencent, and Byte, and some Ali bosses have given authoritative answers. After finishing this set The interview materials believe that everyone can find a satisfactory job.
This full version of Python's full set of learning materials has been uploaded to the package folder. If you need it, you can scan the QR code below on WeChat to ensure 100% free collection !
