Use etree and xpath crawling Discuz forum

The introduction module

Download pycharm in lxml library
by from lxml import etreeintroducing modules

test

import requests
from lxml import etree
url = "https://www.discuz.net/forum-developer-1.html"
text = requests.get(url).text
html = etree.HTML(text)
context = etree.tostring(html).decode()
print(html.xpath('//div[@id="threadlist"]/div[2]/form/table/*'))
print(html.xpath('//*[@id="threadlisttableid"]/*'))

Here are all the forum by xpath syntax of tbodynotes

print(html.xpath('//tbody/tr/th/a[@class="s xst"]/text()'))