Scrapy 2.5.0 启动错误 - OpenSSL 版本不兼容

2023-05-16 16:16:28 [scrapy.utils.log] INFO: Scrapy 2.5.0 started (bot: heima_video) 2023-05-16 16:16:28 [scrapy.utils.log] INFO: Versions: lxml 4.9.2.0, libxml2 2.9.12, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.1, Twisted 22.10.0, Python 3.8.5 (tags/v3.8.5:580fbb0, Jul 20 2020, 15:57:54) [MSC v.1924 64 bit (AMD64)], pyOpenSSL 23.1.1 (OpenSSL 3.1.0 14 Mar 2023), cryptography 40.0.2, Platform Windows-7-6.1.7601-SP1 2023-05-16 16:16:28 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.selectreactor.SelectReactor 2023-05-16 16:16:28 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'heima_video', 'NEWSPIDER_MODULE': 'heima_video.spiders', 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['heima_video.spiders']} 2023-05-16 16:16:28 [scrapy.extensions.telnet] INFO: Telnet Password: 5bef758a7eb1b2dc 2023-05-16 16:16:28 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.logstats.LogStats'] 2023-05-16 16:16:28 [scrapy.core.downloader.handlers] ERROR: Loading 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler' for scheme 'http' Traceback (most recent call last): File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers_init_.py', line 49, in load_handler dhcls = load_object(path) File 'c:\python3\lib\site-packages\scrapy\utils\misc.py', line 61, in load_object mod = import_module(module) File 'c:\python3\lib\importlib_init.py', line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File '', line 1014, in _gcd_import File '', line 991, in _find_and_load File '', line 975, in _find_and_load_unlocked File '', line 671, in _load_unlocked File '', line 783, in exec_module File '', line 219, in call_with_frames_removed File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http.py', line 2, in from scrapy.core.downloader.handlers.http11 import ( File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http11.py', line 23, in from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File 'c:\python3\lib\site-packages\scrapy\core\downloader\contextfactory.py', line 11, in from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File 'c:\python3\lib\site-packages\scrapy\core\downloader\tls.py', line 23, in METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD' 2023-05-16 16:16:28 [scrapy.core.downloader.handlers] ERROR: Loading 'scrapy.core.downloader.handlers.http.HTTPDownloadHandler' for scheme 'https' Traceback (most recent call last): File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers_init.py', line 49, in load_handler dhcls = load_object(path) File 'c:\python3\lib\site-packages\scrapy\utils\misc.py', line 61, in load_object mod = import_module(module) File 'c:\python3\lib\importlib_init.py', line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File '', line 1014, in _gcd_import File '', line 991, in _find_and_load File '', line 975, in _find_and_load_unlocked File '', line 671, in _load_unlocked File '', line 783, in exec_module File '', line 219, in call_with_frames_removed File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http.py', line 2, in from scrapy.core.downloader.handlers.http11 import ( File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http11.py', line 23, in from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File 'c:\python3\lib\site-packages\scrapy\core\downloader\contextfactory.py', line 11, in from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File 'c:\python3\lib\site-packages\scrapy\core\downloader\tls.py', line 23, in METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD' 2023-05-16 16:16:28 [scrapy.core.downloader.handlers] ERROR: Loading 'scrapy.core.downloader.handlers.s3.S3DownloadHandler' for scheme 's3' Traceback (most recent call last): File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers_init.py', line 49, in load_handler dhcls = load_object(path) File 'c:\python3\lib\site-packages\scrapy\utils\misc.py', line 61, in load_object mod = import_module(module) File 'c:\python3\lib\importlib_init.py', line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File '', line 1014, in _gcd_import File '', line 991, in _find_and_load File '', line 975, in _find_and_load_unlocked File '', line 671, in _load_unlocked File '', line 783, in exec_module File '', line 219, in _call_with_frames_removed File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\s3.py', line 3, in from scrapy.core.downloader.handlers.http import HTTPDownloadHandler File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http.py', line 2, in from scrapy.core.downloader.handlers.http11 import ( File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http11.py', line 23, in from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File 'c:\python3\lib\site-packages\scrapy\core\downloader\contextfactory.py', line 11, in from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File 'c:\python3\lib\site-packages\scrapy\core\downloader\tls.py', line 23, in METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD' Unhandled error in Deferred: 2023-05-16 16:16:29 [twisted] CRITICAL: Unhandled error in Deferred:

Traceback (most recent call last): File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 192, in crawl return self._crawl(crawler, *args, **kwargs) File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 196, in _crawl d = crawler.crawl(*args, **kwargs) File 'c:\python3\lib\site-packages\twisted\internet\defer.py', line 1947, in unwindGenerator return _cancellableInlineCallbacks(gen) File 'c:\python3\lib\site-packages\twisted\internet\defer.py', line 1857, in _cancellableInlineCallbacks _inlineCallbacks(None, gen, status, _copy_context()) --- --- File 'c:\python3\lib\site-packages\twisted\internet\defer.py', line 1697, in _inlineCallbacks result = context.run(gen.send, result) File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 87, in crawl self.engine = self._create_engine() File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 101, in create_engine return ExecutionEngine(self, lambda : self.stop()) File 'c:\python3\lib\site-packages\scrapy\core\engine.py', line 69, in init self.downloader = downloader_cls(crawler) File 'c:\python3\lib\site-packages\scrapy\core\downloader_init.py', line 83, in init self.middleware = DownloaderMiddlewareManager.from_crawler(crawler) File 'c:\python3\lib\site-packages\scrapy\middleware.py', line 53, in from_crawler return cls.from_settings(crawler.settings, crawler) File 'c:\python3\lib\site-packages\scrapy\middleware.py', line 34, in from_settings mwcls = load_object(clspath) File 'c:\python3\lib\site-packages\scrapy\utils\misc.py', line 61, in load_object mod = import_module(module) File 'c:\python3\lib\importlib_init.py', line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File '', line 1014, in _gcd_import

File '', line 991, in _find_and_load

File '', line 975, in _find_and_load_unlocked

File '', line 671, in _load_unlocked

File '', line 783, in exec_module

File '', line 219, in _call_with_frames_removed

File 'c:\python3\lib\site-packages\scrapy\downloadermiddlewares\retry.py', line 27, in from scrapy.core.downloader.handlers.http11 import TunnelError File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http11.py', line 23, in from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File 'c:\python3\lib\site-packages\scrapy\core\downloader\contextfactory.py', line 11, in from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File 'c:\python3\lib\site-packages\scrapy\core\downloader\tls.py', line 23, in METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) builtins.AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'

2023-05-16 16:16:29 [twisted] CRITICAL: Traceback (most recent call last): File 'c:\python3\lib\site-packages\twisted\internet\defer.py', line 1697, in _inlineCallbacks result = context.run(gen.send, result) File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 87, in crawl self.engine = self._create_engine() File 'c:\python3\lib\site-packages\scrapy\crawler.py', line 101, in create_engine return ExecutionEngine(self, lambda : self.stop()) File 'c:\python3\lib\site-packages\scrapy\core\engine.py', line 69, in init self.downloader = downloader_cls(crawler) File 'c:\python3\lib\site-packages\scrapy\core\downloader_init.py', line 83, in init self.middleware = DownloaderMiddlewareManager.from_crawler(crawler) File 'c:\python3\lib\site-packages\scrapy\middleware.py', line 53, in from_crawler return cls.from_settings(crawler.settings, crawler) File 'c:\python3\lib\site-packages\scrapy\middleware.py', line 34, in from_settings mwcls = load_object(clspath) File 'c:\python3\lib\site-packages\scrapy\utils\misc.py', line 61, in load_object mod = import_module(module) File 'c:\python3\lib\importlib_init.py', line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File '', line 1014, in _gcd_import File '', line 991, in _find_and_load File '', line 975, in _find_and_load_unlocked File '', line 671, in _load_unlocked File '', line 783, in exec_module File '', line 219, in _call_with_frames_removed File 'c:\python3\lib\site-packages\scrapy\downloadermiddlewares\retry.py', line 27, in from scrapy.core.downloader.handlers.http11 import TunnelError File 'c:\python3\lib\site-packages\scrapy\core\downloader\handlers\http11.py', line 23, in from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File 'c:\python3\lib\site-packages\scrapy\core\downloader\contextfactory.py', line 11, in from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File 'c:\python3\lib\site-packages\scrapy\core\downloader\tls.py', line 23, in METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'

用中文指出错误内容：Scrapy启动时出现了多个错误。其中一个错误是'AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD''，这可能是由于OpenSSL版本不兼容而导致的。建议更新OpenSSL版本或降级Scrapy版本以解决此错误。