美国高尔夫球车生产商和经销商抓取代码 - Python BeautifulSoup
要抓取美国地图上的高尔夫球车生产商和经销商,可以使用 Python 的 web scraping 工具 BeautifulSoup 和 requests 来实现。以下是一个示例代码:
import requests
from bs4 import BeautifulSoup
def get_golf_cart_manufacturers():
url = 'https://www.mapquest.com/search/results?query=golf%20cart%20manufacturers'
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36'
}
response = requests.get(url, headers=headers)
soup = BeautifulSoup(response.content, 'html.parser')
manufacturers = []
results = soup.find_all('div', class_='mq-card-content')
for result in results:
manufacturer = result.find('h2').text.strip()
manufacturers.append(manufacturer)
return manufacturers
def get_golf_cart_dealers():
url = 'https://www.mapquest.com/search/results?query=golf%20cart%20dealers'
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36'
}
response = requests.get(url, headers=headers)
soup = BeautifulSoup(response.content, 'html.parser')
dealers = []
results = soup.find_all('div', class_='mq-card-content')
for result in results:
dealer = result.find('h2').text.strip()
dealers.append(dealer)
return dealers
manufacturers = get_golf_cart_manufacturers()
print('Golf Cart Manufacturers:')
for manufacturer in manufacturers:
print(manufacturer)
dealers = get_golf_cart_dealers()
print('Golf Cart Dealers:')
for dealer in dealers:
print(dealer)
在上述代码中,我们定义了两个函数get_golf_cart_manufacturers()和get_golf_cart_dealers()分别用于抓取高尔夫球车生产商和经销商的信息。我们使用 requests 库发送 HTTP 请求,利用 BeautifulSoup 库解析 HTML 内容。通过查看网页结构,我们找到了包含生产商和经销商信息的div标签,并使用相应的 CSS 类选择器来提取信息。最后,我们将提取的信息打印出来。请注意,为了避免被网站封禁,我们设置了一个 User-Agent 头部字段来模拟浏览器访问。
原文地址: http://www.cveoy.top/t/topic/pMlZ 著作权归作者所有。请勿转载和采集!