Python3 ＋ selenium 撷取网站状态快照

系统更新与软件服务预装

$ sudo apt-get update

安装 Python3 pip

$ sudo apt-get install python3 python3-dev python3-pip

安装 selenium

$ pip3 install selenium

安装 chromium browser / driver

安装 chromium browser

$ sudo apt-get install chromium-browser

安装 chromium driver

下载 chromium driver Release

Ubuntu 16.04 / 18.04

$ wget http://launchpadlibrarian.net/469641508/chromium-chromedriver_80.0.3987.149-0ubuntu0.18.04.1_amd64.deb

Raspberry Pi

$ wget http://launchpadlibrarian.net/469843212/chromium-chromedriver_80.0.3987.149-0ubuntu0.18.04.1_arm64.deb

安装 chromium driver 的 deb 包

Ubuntu 16.04 / 18.04 安装

$ sudo dpkg -i chromium-chromedriver_80.0.3987.149-0ubuntu0.18.04.1_amd64.deb

Raspberry Pi 安装

$ sudo dpkg -i chromium-chromedriver_80.0.3987.149-0ubuntu0.18.04.1_arm64.deb

测试网站抓取

程序码区块

Server 无萤幕显示版本

from selenium import webdriver

option = webdriver.ChromeOptions()
option.add_argument('window-size=1920x1080')
option.add_argument("--start-maximized")
option.add_argument('--headless') 
driver = webdriver.Chrome('/usr/lib/chromium-browser/chromedriver', options=option)
driver.get('https://www.spotify.com')
screenshot = driver.save_screenshot('my_screenshot.png')
driver.quit()

有萤幕版本

from selenium import webdriver

option = webdriver.ChromeOptions()
option.add_argument("--start-maximized")
driver = webdriver.Chrome('/usr/lib/chromium-browser/chromedriver', options=option)
driver.get('https://www.spotify.com')
screenshot = driver.save_screenshot('my_screenshot.png')
driver.quit()