main problem
Dynamic loading
iframe nesting
0. The window is also a frame
1. Get the frame
2. Determine whether the url of the frame has been searched
3. Determine whether the frame is the same domain name
4. Directly search the same domain name normally
5. Different domain names directly load the url of the frame separately, and treat it as a new Page processing
6. Keep searching until a video tag is found
Iframe link opened separately is detected problem
Secondary issue
Remove Chrome anti-debugging
Unlimited breakpoint anti-debug
Reference: https://blog.csdn.net/zzgzzg00/article/details/79504827
end
Programming is really easy to go wrong. I know that the most fundamental purpose is to get the video link of the website, and then I found that the source code of some websites is incomplete, and then the purpose is to get the source code, and then tossing for a few days Still did not solve the problem of obtaining the source code, and then suddenly remembered that I had studied the same problem before, and also wrote an article about obtaining a video link. This is the real wheel, I have already studied it once, the same The problem has obviously been encountered once, why did it fall into the pit again this time? And I’ve been in the pit for a few days, but I didn’t realize it. Alas, stupid, I don’t have a long memory. At the end, I found out that the purpose of obtaining the source code was to get the video link. In other words, it’s the article I wrote before. Effect: Web reverse to obtain the real link of website video through WebView in Android
reference
1. Break through iframe siege
2. Python crawler's solution to multi-layer nested iframe
3. Crawler acquisition: solve the problem of dynamic loading data and frame frame
4. Advanced java crawler-use of ip pool, nested iframe, asynchronous access cracking