You might be missing secret key in s3 datastore.config
Try to add the key value pair (secret="somerandomvalue") in org.apache.jackrabbit.oak.plugins.blob.datastore.SharedS3DataStore.config
This file should be same across all the aem connecting to the S3 bucket. It should resolve your issue.