Article directory
Preface
Wrote 5,. I have been working in Python for 6 years. During this period, I wrote all kinds of weird crawlers and made all kinds of weird money. I wrote this article to summarize several ways to make money with crawlers.
1. The most typical one is to outsource crawler work.
This is the most common way for web crawlers to make money. Through outsourcing websites, acquaintances and acquaintances are connected to small and medium-sized crawler projects, usually providing data capture, data structuring, data cleaning and other services to Party A.
Most of the newcomers to the industry will try this direction first and directly rely on technical means to make money. This is the way we technicians are best at, but the competition is also the most fierce. The crawler project on the outsourced order-taking website has been cut down. The price is cabbage because there are too many people bidding on the project. Places that accept outsourcing include Zhubajie.com, a5 Outsourcing, etc. in China, and freelancers abroad. You can earn US dollars on freelancers. If you want to outsource, you can try it, but you have to compete with Asan from India. American students are also lazy. When Lao Yuan came into contact with Freelancer in 2009, there were still American students who had not completed their Python homework. They spent $60 on Freelancer to find someone to help with their homework.
Outsourcing is becoming more and more difficult, and there are too many people doing it. The people who can accept crawler outsourcing on the Internet range from college students, old apes with gray hair at the temples, to several people working in teams, all of whom are competing for projects worth several thousand yuan each, and the delivery time is It’s also very tight. If you don’t have customer resources, ready-made solutions, and stable and efficient crawler technology to support it, you won’t be able to get good orders.
However, there is one direction that I have known about many years ago, and from my observations now, it still has a promising future, which is to write a posting machine. The reason why Lao Yuan still remembers the posting machine is because when he first started working, he learned on freelancer that a foreigner earned 500,000 a year by writing a posting machine.
What is a posting machine? It means automatically posting posts and comments to forums and social media. Party A usually uses posting machines to fill a large number of accounts on a large number of websites to achieve Party A's business purposes. This is a physical job. You have to study the login process and posting process of a large number of websites. Once the website is revised, you have to rewrite the process. Now there is still a market for posting machines, but now there are anti-climbing restrictions on login restrictions, posting restrictions, etc. The measures are much more advanced than before, and it is difficult to write a good and stable posting machine.
2: Integrate information and data to make products
To put it simply, it is to capture the information scattered in every corner, integrate it and present it on the website or WeChat or APP, and then monetize it through network alliance advertising, e-commerce commissions, direct sales of e-commerce products or knowledge payment.
3. Create a public account/self-media/independent blog
More and more people are learning Python and writing crawlers, and many of them are from non-computer science majors. Therefore, the demand for writing crawlers in Python has been greatly increased. As long as you have more practical experience at work, there are actually a lot of experience summaries that can be written.
Don't think that you have to output some profound content before you can write a public account or blog. In fact, the writing is too technical and no one will read it. As I said just now, most of the audience is from non-computer science classes. What they need is that you can explain how to get started and how to get started in a relatively simple and easy-to-understand manner. There are some small programs and demonstration examples. Practice. Therefore, the content you write must be down-to-earth. It is relatively easy to promote the official account. If several official account owners promote each other and do book distribution activities, they will have a basic amount of attention. The rest depends on how diligently you write the article and whether the content is attractive.
4. Go and play in the stock market
It will not be described in detail here. . I am a senior python development engineer. Here is a set of the latest python system learning tutorials that I have compiled, including basic python scripts to web development, crawlers, data analysis, data visualization, machine learning, etc.
1. Introduction to Python
The following content is the basic knowledge necessary for all application directions of Python. If you want to do crawlers, data analysis or artificial intelligence, you must first learn them. Anything high-end is built on a primitive foundation. By laying a good foundation, the road ahead will be more stable.All information is available for free at the end of the article！！！
Include:
Computer Basics
python basics
Python introductory video episode 600:
Watch zero-based learning videos. Watching videos is the fastest and most effective way to learn. It is easy to get started by following the teacher's ideas in the video, from basic to in-depth.
2. Python crawler
As a popular direction, crawlers are a good choice whether you use them part-time or as an auxiliary skill to improve work efficiency.
Through crawler technology, relevant content can be collected, analyzed and selected to get the information we really need.
This information collection, analysis and integration work can be applied to a very wide range of areas. Whether it is life services, travel, financial investment, product market demand of various manufacturing industries, etc., crawler technology can be used to obtain more accurate and effective information. use.
Python crawler video information
3. Data analysis
The "Digital Transformation of China's Economy: Talent and Employment" report released by Tsinghua University School of Economics and Management shows that the data analysis talent gap is expected to reach 2.3 million in 2025.
With such a huge talent gap, data analysis is like a vast blue ocean! Starting salary of 10K is really commonplace.
4. Database and ETL data warehouse
Enterprises need to regularly transfer cold data from the business database and store it in a warehouse dedicated to storing historical data. Each department can provide unified data services based on its own business characteristics. This warehouse is a data warehouse.
The traditional data warehouse integrated processing architecture is ETL. Using the capabilities of the ETL platform, E = extract data from the source database, L = clean the data (data that does not comply with the rules) and transform the table (perform different dimensions and granularity on the table according to business needs) degree, different business rules calculation and statistics), T=load the processed table to the data warehouse in increments, full quantities, and different times.
5. Machine Learning
Machine learning is to learn from a part of the computer data, and then predict and judge other data.
The core of machine learning is "using algorithms to parse data, learn from it, and then make decisions or predictions about new data." That is to say, the computer uses the data obtained to derive a certain model, and then uses this model to make predictions. This process is somewhat similar to the human learning process. For example, after a person acquires certain experience, he or she can predict new problems.
Machine learning materials:
6. Advanced Python
From basic syntax content to many in-depth advanced knowledge points and understanding of programming language design, after studying here, you will basically understand all the knowledge points from entry to advanced python.
At this point, you can basically meet the company's employment requirements. If you still don't know where to find interview materials and resume templates, I have compiled one here for you. It can really be said to be a systematic learning route for nannies and caregivers. .
But learning programming does not happen overnight, but requires long-term persistence and training. In organizing this learning route, I hope to make progress together with everyone, and I can also review some technical points myself. Whether you are a newbie in programming or an experienced programmer who needs to advance, I believe everyone can gain something from it.
It doesn’t happen overnight, but requires long-term persistence and training. In organizing this learning route, I hope to make progress together with everyone, and I can also review some technical points myself. Whether you are a newbie in programming or an experienced programmer who needs to advance, I believe everyone can gain something from it.
Data collection
This complete version of Python learning materials has been uploaded to CSDN official. If you need it, you can click on the CSDN official certification WeChat card below to get it for free ↓↓↓ [Guaranteed 100% free]
