16 questions we are most concerned reptiles, 7 minutes Python reptile eliminating Daquan teach entry!
I gathered everyone's attention 16 questions reptiles are most concerned about, here I will share to you the next finishing, and answered their questions, but also welcome to add!
1. Now reptile Haozhaogongzuo it?
If a year ago I would say the work is still very good looking reptiles, but is now hard to find a market saturated, the second is the ability to reptiles requirements are also increasing. Now you need to find a reptile more than one year practical work experience, and also requires a certain anti-climb capability.
2. reptile salary generally how?
In the first-tier cities, probably about a year salary reptile 1W or more, if you are relatively strong 15K ~ 18K are not the problem. For students who have just graduated, between 7K ~ 9K.
3. reptiles in general how to solve the problem of encryption
For the web client is usually encryption algorithm is written in js code, so first you have to understand the js language, at least to know what js-based. Second, find the corresponding js encryption code, and then identify the key functions. The js node.js code debugging environment. Finally, execjs library in Python debugging environment to perform good code.
The second is to simulate browser environment direct access to data rendering, the most common means is to use the Selenium framework. This is very convenient, of course, the corresponding disadvantage is very low efficiency. But now there is a new framework to replace the Selenium, namely Puppeteer, you can see that this framework is the asynchronous version of Selenium.
4. Learn reptiles have knowledge of what is required
Three parts of contents: 1 Python base; crawler base 2; 3 anti-climb learning;
The contents of these three parts is to do the necessary knowledge reptile, reptiles do use mainstream language is Python, because Python has a very rich reptile library, you can directly use very convenient.
Getting to the whole stack, you do not understand the learning process can join my python zero-based systems Learning Exchange Qiuqiu qun: 784758,214, Share Python current business needs and how people learn Python from a zero base with you, and learn what content. Related video learning materials, development tools have to share
For crawlers I concluded a universal formula:
= + Crawlers request data analyzing network data storage +
These three parts corresponding to these reptiles on the basis that any crawler will save the contents of these three parts. Some reptiles complex is nothing more than add some other content on this basis.
A reptile engineer how strong anti-climbing ability, his strength reptiles have tall. Anti-climb the learning is the most difficult part of learning reptile collection, this part of the study mainly to combat oriented. I have the opportunity in a special article to talk about.
5. Verify that the code of how to solve the general problem
There are two general ideas:
- Forward crack
Such as the common CAPTCHA, you can hold down the first picture, and then use some graphic identification chart to identify the appropriate content. The slider codes, you can use to calculate the distance Selenium frame gap, and then simulate a mouse drag the slider.
- Reverse break
This involves the realization of logic verification code, you need to understand the other side validation logic code implemented, to see which parameters to send a verification code request when needed, and how these parameters is generated, simulated request. Reverse saving practices fall short break type, but the corresponding difficulty is very large.
- Directly coding platform
It says two methods are very time-consuming part of the behavior, and once the other site anti-climb policy updates, your code will fail. They are able to spend money to solve the matter, we chose to use the direct coding platform like.
6. Dry reptiles, will enter the sub-office thing?
Involving sensitive personal information, grab more than 1K in respect of acts constituting crimes. Many reptile belonging to the gray area, high-profile and as long as you do not so much as what the other will not pursue. So generally speaking quasi observe the principle, lay low, not to game the child.
7. where to find reptiles small list, I want to make a phone call charges
Private reptile suggest that you do not live, low income, but also very own energy consumption. And pay is not proportional to income.
8. No reptile experience, how to find their first job
No reptiles are unable to find work experience, experience reptiles are not saying that we must actually be considered to be a reptile of work. As long as you have experienced any climb a website, you have reptiles. So you want to find a job reptiles, be sure to find some sites actually crawling. Imitate someone else's project, try to write some code for reptiles, summary pit encountered. After climbing more than a few sites, you will have your own reptile experience, this time in the brush face some questions, it is easy to find a job.
9. Now how Python prospects in various fields
Python is the most promising areas of AI Artificial Intelligence direction, followed by Python background, web front-end, data analysis, and finally is reptiles.
10. How to use Python to create a high-Star project
For everyone to provide two ideas:
- Resource Integration
For the technology is not very good students, you can organize all relevant Python dry areas, such as Python classic books, Python algorithm Daquan, Python classic articles and more. Most comprehensive collection of resources to do the project.
- The development of practical projects
If your technical ability is very strong, then you pay more attention to the pain points encountered in real life, to develop a practical project for this pain point.
11. The self-study to what degree can find a job
When I first learned of reptiles, I need to learn the contents of reptiles have made a mind map, if you put the contents of the following mind map of all finished school, find a job.
12. Interview data reptiles
The back will give you updated with the latest Python Python reptile reptilian face questions and tutorials
13. How to create income after sleeping with Python
This topic alone can open a flash in the group, I work for so long, that did not spend a minute wages. Not here in swing, waiting for me in the next issue of Flash activity to share.
14. The crawling process requires the data to re-do a simple, it is determined whether the data meets the requirements
Some standardized data deduplication and formats are based on your specific business needs to set. Generally reptiles climb down the data to be processed to the weight, and then converted to other groups defined data format for others to use.
15. The main task of reptiles at work
Daily work is crawling reptiles data, addition is to maintain the existing reptiles code to run properly.
16. learned late reptile is going to turn the machine learning or data analysis or back-end development?
Reptile is a suitable skill, not suitable for the direction of career development. If you want to learn all reptiles and reptiles rely on the future to eat a bowl of rice, you must take the reverse, js break, distributed, asynchronous and thoroughly. Later if you do not want to learn reptiles, then you're in the line of crawler and finding good, what direction you want to go next. Data analysis, back-end development, or machine learning, we must continue to choose the premise of your own interest.
For the latest Python reptile interview subject, I would have taken a devoted update with you!