是的，Python的BeautifulSoup庫可以與其他庫和工具結合使用，以擴展其爬蟲功能。以下是一些建議的擴展方法：
示例代碼：
import requests
from bs4 import BeautifulSoup
url = 'https://example.com'
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
示例代碼：
import re
from bs4 import BeautifulSoup
html = '''<html><body><p class="example">Hello, world!</p></body></html>'''
soup = BeautifulSoup(html, 'html.parser')
pattern = re.compile(r'example')
result = pattern.search(soup.prettify())
示例代碼（多線程）：
import threading
from bs4 import BeautifulSoup
import requests
def process_url(url):
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
# 處理soup對象
urls = ['https://example.com', 'https://example.org']
threads = []
for url in urls:
t = threading.Thread(target=process_url, args=(url,))
t.start()
threads.append(t)
for t in threads:
t.join()
示例代碼（多進程）：
import multiprocessing
from bs4 import BeautifulSoup
import requests
def process_url(url):
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
# 處理soup對象
urls = ['https://example.com', 'https://example.org']
processes = []
for url in urls:
p = multiprocessing.Process(target=process_url, args=(url,))
p.start()
processes.append(p)
for p in processes:
p.join()
示例代碼：
import requests
from bs4 import BeautifulSoup
proxies = {
'http': 'http://proxy.example.com:8080',
'https': 'http://proxy.example.com:8080',
}
url = 'https://example.com'
response = requests.get(url, proxies=proxies)
soup = BeautifulSoup(response.text, 'html.parser')
這些方法可以幫助您擴展BeautifulSoup爬蟲的功能，以滿足不同的需求。
