Generate headers with my_fake_useragent
import random
from my_fake_useragent import UserAgent
def gererateUserAgent():
headers = {}
headers_list = ua.get_useragent_list()
headers['User-Agent'] = random.choice(headers_list)
headers = {'User-Agent': headers['User-Agent'] }
With headers generated to request a web page will always be on the error
requests.exceptions.InvalidHeader: Invalid return character or leading space in header: user-agent
Because the query is generated headers will appear blank, examples are as follows
# Wrong headers
request header headers = {#
"user-agent":" Mozilla/5.0(Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.92 Safari/537.36"
}
# Correct headers
request header headers = {#
"user-agent":"Mozilla/5.0(Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.92 Safari/537.36"
}
To avoid subsequent errors by headers_list content, headers manually generate a dictionary, for later use as requested
headers_list = [
Opera / 7.10 (Windows NT 5.1) [en] ',
'Opera/9.80 (X11; Linux i686; U; it) Presto/2.5.24 Version/10.54',
Opera / 9.64 (X11; Linux i686; U; ru) Presto / 2.1.1 "
'Mozilla/5.0 (Windows NT 5.2; U; ru; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6 Opera 10.70',
'Mozilla/5.0 (Windows; U; Windows NT 6.1; fr; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2 GTB7.0',
'Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-gb) AppleWebKit/85.8.5 (KHTML, like Gecko) Safari/85.8.1',
]