7/10
https://bbs.pediy.com/thread-259906.htm Douyin short video x-gorgon algorithm entry location search (2020-06-02)
After testing, the information obtained is as follows: Method 1: Use the Charles tool to capture packets and find that the data can be returned normally, but we see that his header is good except for x-gorgon and x-tt-trace-id Understand, we will find that if we change the URL parameters, but the header content cannot be modified accordingly, no data will be returned (return as follows
{"status_code":2154,"aweme_list": [],"has_more": 1,"min_cursor": 0,"max_cursor": 0}）
01 analysis, it is believed that the x-gorgon in the header has signed it once, jadx searches for gorgon, and k-khronos has just reached the currentTimeMillis timestamp. We found that because om.ss.sys.ces.a.leviathan was in the so layer to the libcms.so file, and there was a lot of confusion in it, we did not analyze it again. We can call the method through xposed or unidbg.
02Confirm parameters and hook key points
https://bbs.pediy.com/thread-259862.htm Douyin crack-flask+frida-rpc (2020-5-31)
https://www.louislivi.com/archives/149 Douyin APP login analysis, cookie acquisition
Find forums
SegmentFault, V2EX, Open Source China, W3School, 51CTO, ChinaUnix, Bole Online, ITEye
, Nuggets, Developer Headlines, GitChat
https://mp.weixin.qq.com/s/KS59Fl-f16mU11SFXh9yhw Douyin crawler principle revealed (automatic like)
https://juejin.im/post/5d2440c7f265da1b84670bb2 How to use python to crawl the list of vibrato videos (capture selenuim dynamically load js)
"The Douyin share page has fonts to crawl""
https://blog.csdn.net/jerry3747/article/details/100543430?utm_medium=distribute.pc_relevant_t0.none-task-blog-BlogCommendFromMachineLearnPai2-1.edu_weight&depth_1-utm_source=distribute.pc_relevant_t0From.none-Commend2-blog-MachineLearn 1. edu_weight mitmproxy+appium realizes automatic acquisition of Douyin keyword search results, Douyin crawler
https://www.cnblogs.com/xbjss/p/12110083.html Unidbg introductory tutorial for crawler engineers