Spark 任务执行失败: 找不到文件 xasecure-audit.xml

这段日志报错信息为'java.io.FileNotFoundException: /usr/semr/1.0.0.0-13/spark2/conf/xasecure-audit.xml (No such file or directory)',即找不到指定的文件或目录。该错误通常是由于程序需要读取该文件或目录,但实际上该文件或目录并不存在或路径不正确导致的。

需要检查以下内容:

  1. 路径是否正确: 仔细核对报错信息中提供的文件路径 '/usr/semr/1.0.0.0-13/spark2/conf/xasecure-audit.xml' 是否正确。
  2. 文件或目录是否存在: 确认该路径下是否存在文件 'xasecure-audit.xml',可以使用命令行工具(如 ls 或 dir)查看。
  3. 权限问题: 检查用户是否拥有读取该文件或目录的权限。

解决方法:

  • 修正路径: 如果路径错误,请修改程序代码或配置文件中的路径,确保指向正确的文件或目录。
  • 创建文件: 如果文件不存在,请根据需要创建该文件,并确保文件内容符合程序预期。
  • 调整权限: 如果权限不足,请修改文件或目录的权限,赋予用户读取权限。

以下是报错日志的完整信息:

Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /usr/semr/1.0.0.0-13/spark2/conf/xasecure-audit.xml (No such file or directory)
	 at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3001)
	 at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2932)
	 at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2807)
	 at org.apache.hadoop.conf.Configuration.get(Configuration.java:1201)
	 at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1255)
	 at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1533)
	 at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:191)
	 at com.startdt.datablack.authorizer.spark.authorizer.RangerSparkPlugin.init(RangerSparkPlugin.scala:22)
	 at com.startdt.datablack.authorizer.spark.authorizer.RangerSparkPlugin$Builder.getOrCreate(RangerSparkPlugin.scala:64)
	 at com.startdt.datablack.authorizer.spark.authorizer.RangerSparkAuthorizer$.<init>(RangerSparkAuthorizer.scala:26)
	 at com.startdt.datablack.authorizer.spark.authorizer.RangerSparkAuthorizer$.<clinit>(RangerSparkAuthorizer.scala)
	 ... 31 more
Caused by: java.io.FileNotFoundException: /usr/semr/1.0.0.0-13/spark2/conf/xasecure-audit.xml (No such file or directory)
	 at java.io.FileInputStream.open0(Native Method)
	 at java.io.FileInputStream.open(FileInputStream.java:195)
	 at java.io.FileInputStream.<init>(FileInputStream.java:138)
	 at java.io.FileInputStream.<init>(FileInputStream.java:93)
	 at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
	 at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
	 at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2902)
	 at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2951)
	 ... 41 more
23/05/30 16:02:26 INFO SparkContext: Invoking stop() from shutdown hook
23/05/30 16:02:26 INFO AbstractConnector: Stopped Spark@23e44287{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
23/05/30 16:02:26 INFO SparkUI: Stopped Spark web UI at http://datakun-11:4040
23/05/30 16:02:26 INFO YarnClientSchedulerBackend: Interrupting monitor thread
23/05/30 16:02:26 INFO YarnClientSchedulerBackend: Shutting down all executors
23/05/30 16:02:26 INFO YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
23/05/30 16:02:26 INFO SchedulerExtensionServices: Stopping SchedulerExtensionServices
(serviceOption=None,
 services=List(),
 started=false)
23/05/30 16:02:26 INFO YarnClientSchedulerBackend: Stopped
23/05/30 16:02:26 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
23/05/30 16:02:26 INFO MemoryStore: MemoryStore cleared
23/05/30 16:02:26 INFO BlockManager: BlockManager stopped
23/05/30 16:02:26 INFO BlockManagerMaster: BlockManagerMaster stopped
23/05/30 16:02:26 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
23/05/30 16:02:26 INFO SparkContext: Successfully stopped SparkContext
23/05/30 16:02:26 INFO ShutdownHookManager: Shutdown hook called
23/05/30 16:02:26 INFO ShutdownHookManager: Deleting directory /tmp/spark-b0c322a1-6745-4e0c-8f15-7509160fb5ca
23/05/30 16:02:26 INFO ShutdownHookManager: Deleting directory /tmp/spark-82d19991-f0c8-43ec-a73b-67a8aa608c41

希望以上信息能够帮助您解决问题。如果您还有其他问题,请随时提出。

Spark 任务执行失败: 找不到文件 xasecure-audit.xml

原文地址: https://www.cveoy.top/t/topic/ol9f 著作权归作者所有。请勿转载和采集!

免费AI点我,无需注册和登录