Recently I want to develop a small tool for information gathering, inconsistent view the page source code F12 and content problems when crawling the web, check the information to find out.
View page source: the server is to send someone to the browser intact code, the code is obtained reptiles.
F12: Code (element) can not be found in the source code, is dynamically generated when the browser execute js, through F12 to see is the ultimate browser-treated html code.
Solution:
1. JavaScript collected directly from the data loaded, json processing module;
2. Direct Acquisition browser already loaded good data, using tools PhantomJS.
Reference: https: //www.cnblogs.com/yuantup/p/9761534.html