selenium使用
- 介绍
- selenium本是一个web测试工具,也已可以应用在爬虫中,在一些找不到接口的网页,或者需要登录的网页使用selenium进行模拟登录。模拟登录以后所有的内容都在HTML中,直接爬取HTML就好。
- 使用selenium
from selenium import webdriver
url = 'xxx'
driver = webdriver.Chrome()
driver.get(url)
click_xxx = driver.find_element_by_xpath()
click_xxx.click()
'''
driver.find_elements_by_xpath()
driver.find_element()
driver.find_elements()
driver.find_element_by_id()
driver.find_element_by_css_selector()
driver.find_element_by_class_name()
'''
driver.close()
input_driver = driver.find_elements_by_xpath()
input_driver.send_keys('xxx')
from selenium import webdriver
import time
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_argument('--headless')
chrome_options.add_argument('disable-gpu')
driver = webdriver.Chrome(chrome_options=chrome_options)
url = 'xxx'
driver.get(url)
time.sleep(url)
driver.save_screenshot('xxx.png')
driver.quit()