taobao crawler solution

1. taobao, tmall store data
     On the official website, we can obtain the first 1020 pages of data through the search interface ( https://shopsearch.taobao.com/search?app=shopsearch&q=iphone  ). The interface displays 100 pages of data with 20 pieces of data per page, or 2,000 pieces. Now pass through
     
 
 
   2. item interface (also known as commodity interface json) 
     This interface can quickly obtain store product information. Obtaining the store is the first step, and the second step is to obtain all store product information through this interface. The following two interfaces are shown
     
    The above two interfaces can easily return all the product data of the store, which is very important for collecting store data. It lays a key foundation for further acquisition of sku data. It is a one-to-many interface (one interface has multiple pairs of data)
 
      
 
   3. sku data (json data)
     The sku data is the detail data. Here you can get all the information about the price, inventory, sales, shipping and other information of the product. Let's look at a PC-side interface first.
     1. pc (  https://mdskip.taobao.com/core/initItemDetail.htm?tmallBuySupport=true&itemId= itemId ) // itemId is all data of store items obtained above 
        This interface cannot be accessed directly, you need to add certain HTTP header messages such as Referer, UpgradeInsecureRequests, CacheControl and other information, and enable TLS request to return json data
              
       This is a very efficient interface cache interface, and the number is directly fetched without any verification as follows 
    
           
       This interface can directly request to obtain detailed json data, including commodity price, sku information, sales volume, shipping fee, payment method, store, promotion information, etc.        
 
     3. mobile 2 (tmall:  https://detail.m.tmall.com/item.htm?id=39783398037    ) 
       This interface returns the page data normally. In the page data, the complete SKU information is included, which can be parsed and processed directly. If you visit a mobile page without any verification, you can directly obtain the suggestion to add user information, check and Encryption Algorithm
              
   
   4. app client 
   In the early taobao app, someone had cracked the charging app key 
     appKey = "12278902";
    secret = "744e7d7e7028b817bd9f8f3c6f28a8d3";  
 
通过这个 appkey 我们可以大方的使用 open.api 了如获取以下信息
 
 

Guess you like

Origin http://10.200.1.11:23101/article/api/json?id=327041395&siteId=291194637