51job (51job official website) crawling of 10,000 recruitment information

Taking 10,000 pieces of e-commerce recruitment information crawled online by 51job as a sample, analyze the employment prospect, working location, average salary and job requirements of this industry in detail

This article mainly displays and describes the data through word cloud diagrams and visual charts

1. Upload the sample infographic first (because there are too many, only a part is cut off)

The first picture includes job title, company name, work location, salary, release time (the company’s release time, when I crawled it was 2020.6.24) and the url link of the details page; The content describes the job information and job requirements of the position.

The following data visualizations are all based on the sample information crawled above.

2. Word cloud display

(1) jobs

Through the observation and analysis of the job title map, it is found that among the 10,000 pieces of sample information collected, the demand for management posts is relatively high, such as operations, managers, supervisors, directors, customer service, etc. all rank in the top; technical posts The demand is relatively small, such as art, design, graphic, etc. appearing less frequently; at the same time, with the development of social e-commerce and the impact of the epidemic, e-commerce live broadcasts, e-commerce anchors and other forms are gradually enriched, and there are more live broadcast jobs than before. significantly increased;

At the same time, e-commerce jobs are often combined with e-commerce platforms, such as Amazon, Taobao, Tmall, JD.com, AliExpress, etc.;

With the development of globalization, the flow of goods at home and abroad has become more frequent, and the prospect of cross-border e-commerce is quite good.

(2) Work place

Through observation and analysis, it is found that the most popular cities for e-commerce are Beijing, Shanghai, Guangzhou, Shenzhen and the economically developed cities in the southeast coast. In contrast, some inland cities, such as Wuhan, Changsha, Kunming, Xi'an, etc. provide jobs The quantity is small, and the development of e-commerce is limited;

In addition, some new first-tier cities in Southwest China, such as Chengdu and Chongqing, have a good policy environment, and the demand for e-commerce jobs has increased, which is highly attractive to talents and has great potential for e-commerce development.

(3) Job Requirements

After observation and analysis, it is found that e-commerce companies favor operation and management talents, who require certain practical experience, can combine with well-known domestic e-commerce platforms, be familiar with the operating rules and activity promotion of e-commerce platforms, and understand the new maintenance of stores. Be customer-oriented and provide high-quality service experience.

In terms of the quality of job seekers, e-commerce companies pay more attention to the ability of job seekers, who do not require high academic qualifications, have a sense of responsibility, teamwork spirit, and good communication skills.

3. Visualization chart

(1) Distribution of average salary and number of positions

The purpose of the Excel data analysis is to obtain the current average salary in the e-commerce industry, and to make a specific analysis of Beijing, Shanghai, Guangzhou, Shenzhen and Hangzhou—the cities most graduates who intend to work in the e-commerce industry may choose.

Beijing



Guangzhou



Shanghai



Shenzhen



Hangzhou

(2) Comparison of Beijing, Shanghai, Guangzhou, Shenzhen and Hangzhou with the national average salary level

Among the 10,000 sample data, the calculated average salary in Guangzhou is 8,140 yuan/month, which is lower than the national average salary of 8,600 yuan/month, and it is also the only city among the five cities whose salary level is lower than the national average;

The average salary in Beijing is as high as 10,560 yuan per month, leading the country, followed by Shanghai, and the average salary in Hangzhou and Shenzhen is also close to 10,000 yuan, with great potential for development.

4. Crawler code

Mainly use the requests and BeautifulSoup libraries to crawl the 51job recruitment website , enter e-commerce in the search box, and get the jump page. The first 10,000 e-commerce job data is the sample data collected in this article.

Some code information blocks crawled (mainly job title, company name, location, release time, salary, details page link)

def getjoblist(lf,joburl,lst):  #定义工作的（每一页的，后面会随着for循环不断到第二页）列表，里面存放职位名等信息和每个详情页的url链接,lst表示每一大页的链接
    la=[]  #定义空列表存放职位名
    lb=[]  #存放公司名
    lc=[]  #存放地点
    ld=[]  #存放薪资
    le=[]  #存放发布时间
        
    for joburl in lst:
        html=gethtml(joburl)
        soup=BeautifulSoup(html,'html.parser')        
        #lf=[]  #存放每个页面中对应的工作列表详情页的链接   
        #应该还要有下一页
        la.append('职位名')
        lf.append('详情页链接')
        for i in soup.find_all('p',class_='t1'):
            la.append(i.text.split(' ')[20])
            lf.append(i.a['href'])
                   
        for i in soup.find_all('span',class_='t2'):
            lb.append(i.string)
              
        for i in soup.find_all('span',class_='t3'):
            lc.append(i.string)
                
        for i in soup.find_all('span',class_='t4'):
            ld.append(i.string)
                
        for i in soup.find_all('span',class_='t5'):
            le.append(i.string)

Students who need a complete code block can private message me

data visualization is learning

Welcome brothers and sisters to come and guide