Caused by javaniofileAccessDeniedException s3awarehouse-230715userhivewarehousehudi_spark_flinkdbhudi_cow_nonpcf_tbl648a2904-9a9b-41bd-a991-68e163bd4d44-0_0-18-16_20230717092657486parquet orgapachehad

The error message indicates that there is a problem with accessing an S3 file due to missing or incorrect AWS credentials. Specifically, the error states that no AWS credentials were provided by the TemporaryAWSCredentialsProvider, SimpleAWSCredentialsProvider, EnvironmentVariableCredentialsProvider, and IAMInstanceCredentialsProvider.

The error stack trace suggests that the AWS credentials could not be loaded from environment variables (AWS_ACCESS_KEY_ID and AWS_SECRET_KEY) or environment variables (AWS_ACCESS_KEY and AWS_SECRET_ACCESS_KEY) are not set correctly.

To resolve this issue, you need to ensure that the AWS credentials are correctly set in the environment variables. Make sure to set the AWS_ACCESS_KEY_ID (or AWS_ACCESS_KEY) and AWS_SECRET_KEY (or AWS_SECRET_ACCESS_KEY) environment variables with the appropriate values.

If you are running your code on an EC2 instance with an IAM role, make sure that the IAMInstanceCredentialsProvider is able to fetch the credentials.

Additionally, double-check that the user or role associated with the credentials has the necessary permissions to access the S3 bucket and the specific file mentioned in the error message.

By providing the correct AWS credentials and ensuring the appropriate permissions are set, you should be able to resolve this issue