cloudtrail-logging
Logging Amazon S3 API Calls Using AWS CloudTrail
Amazon S3 is integrated with AWS CloudTrail, a service that provides a record of actions taken by a user, role, or an AWS service in Amazon S3. CloudTrail captures a subset of API calls for Amazon S3 as events, including calls from the Amazon S3 console and from code calls to the Amazon S3 APIs. If you create a trail, you can enable continuous delivery of CloudTrail events to an Amazon S3 bucket, including events for Amazon S3. If you don't configure a trail, you can still view the most recent events in the CloudTrail console in Event history. Using the information collected by CloudTrail, you can determine the request that was made to Amazon S3, the IP address from which the request was made, who made the request, when it was made, and additional details.
To learn more about CloudTrail, including how to configure and enable it, see the AWS CloudTrail User Guide.
Amazon S3 Information in CloudTrail
CloudTrail is enabled on your AWS account when you create the account. When supported event activity occurs in Amazon S3, that activity is recorded in a CloudTrail event along with other AWS service events in Event history. You can view, search, and download recent events in your AWS account. For more information, see Viewing Events with CloudTrail Event History.
For an ongoing record of events in your AWS account, including events for Amazon S3, create a trail. A trail enables CloudTrail to deliver log files to an Amazon S3 bucket. By default, when you create a trail in the console, the trail applies to all Regions. The trail logs events from all Regions in the AWS partition and delivers the log files to the Amazon S3 bucket that you specify. Additionally, you can configure other AWS services to further analyze and act upon the event data collected in CloudTrail logs. For more information, see the following:
- Overview for Creating a Trail
- CloudTrail Supported Services and Integrations
- Configuring Amazon SNS Notifications for CloudTrail
- Receiving CloudTrail Log Files from Multiple Regions and Receiving CloudTrail Log Files from Multiple Accounts
Every event or log entry contains information about who generated the request. The identity information helps you determine the following:
- Whether the request was made with root or IAM user credentials.
- Whether the request was made with temporary security credentials for a role or federated user.
- Whether the request was made by another AWS service.
For more information, see the CloudTrail userIdentity Element.
You can store your log files in your bucket for as long as you want, but you can also define Amazon S3 lifecycle rules to archive or delete log files automatically. By default, your log files are encrypted by using Amazon S3 server-side encryption (SSE).
Amazon S3 Bucket-Level Actions Tracked by CloudTrail Logging
By default, CloudTrail logs bucket-level actions. Amazon S3 records are written together with other AWS service records in a log file. CloudTrail determines when to create and write to a new file based on a time period and file size.
The tables in this section list the Amazon S3 bucket-level actions that are supported for logging by CloudTrail.
Amazon S3 Bucket-Level Actions Tracked by CloudTrail Logging
In addition to these API operations, you can also use the OPTIONS object object-level action. This action is treated like a bucket-level action in CloudTrail logging because the action checks the cors configuration of a bucket.
Amazon S3 Object-Level Actions Tracked by CloudTrail Logging
You can also get CloudTrail logs for object-level Amazon S3 actions. To do this, specify the Amazon S3 object for your trail. When an object-level action occurs in your account, CloudTrail evaluates your trail settings. If the event matches the object that you specified in a trail, the event is logged. For more information, see How Do I Enable Object-Level Logging for an S3 Bucket with AWS CloudTrail Data Events? in the Amazon Simple Storage Service Console User Guide and Logging Data Events for Trails in the AWS CloudTrail User Guide.
The following table lists the object-level actions that CloudTrail can log:
REST API Name | API Event Name Used in CloudTrail Log |
---|---|
Abort Multipart Upload | AbortMultipartUpload |
Complete Multipart Upload | CompleteMultipartUpload |
Delete Multiple Objects | DeleteObjects |
DELETE Object | DeleteObject |
GET Object | GetObject |
GET Object ACL | GetObjectAcl |
GET Object tagging | GetObjectTagging |
GET Object torrent | GetObjectTorrent |
HEAD Object | HeadObject |
Initiate Multipart Upload | CreateMultipartUpload |
List Parts | ListParts |
POST Object | PostObject |
POST Object restore | RestoreObject |
PUT Object | PutObject |
PUT Object acl | PutObjectAcl |
PUT Object tagging | PutObjectTagging |
PUT Object - Copy | CopyObject |
SELECT Object Content | SelectObjectContent |
Upload Part | UploadPart |
Upload Part - Copy | UploadPartCopy |
In addition to these operations, you can use the following bucket-level operations to get CloudTrail logs as object-level Amazon S3 actions under certain conditions:
- GET Bucket (List Objects) Version 2 – Select a prefix specified in the trail.
- GET Bucket Object versions – Select a prefix specified in the trail.
- HEAD Bucket – Specify a bucket and an empty prefix.
- Delete Multiple Objects – Specify a bucket and an empty prefix.Note
CloudTrail does not log key names for the keys that are deleted using the Delete Multiple Objects operation.
Object-Level Actions in Cross-Account Scenarios
The following are special use cases involving the object-level API calls in cross-account scenarios and how CloudTrail logs are reported. CloudTrail always delivers logs to the requester (who made the API call). When setting up cross-account access, consider the examples in this section.
Note
The examples assume that CloudTrail logs are appropriately configured.
Example 1: CloudTrail Delivers Access Logs to the Bucket Owner
CloudTrail delivers access logs to the bucket owner only if the bucket owner has permissions for the same object API. Consider the following cross-account scenario:
- Account-A owns the bucket.
- Account-B (the requester) tries to access an object in that bucket.
CloudTrail always delivers object-level API access logs to the requester. In addition, CloudTrail also delivers the same logs to the bucket owner only if the bucket owner has permissions for the same API actions on that object.
Note
If the bucket owner is also the object owner, the bucket owner gets the object access logs. Otherwise, the bucket owner must get permissions, through the object ACL, for the same object API to get the same object-access API logs.
Example 2: CloudTrail Does Not Proliferate Email Addresses Used in Setting Object ACLs
Consider the following cross-account scenario:
- Account-A owns the bucket.
- Account-B (the requester) sends a request to set an object ACL grant using an email address. For information about ACLs, see Access Control List (ACL) Overview.
The request gets the logs along with the email information. However, the bucket owner—if they are eligible to receive logs, as in example 1—gets the CloudTrail log reporting the event. However, the bucket owner doesn't get the ACL configuration information, specifically the grantee email and the grant. The only information that the log tells the bucket owner is that an ACL API call was made by Account-B.
CloudTrail Tracking with Amazon S3 SOAP API Calls
CloudTrail tracks Amazon S3 SOAP API calls. Amazon S3 SOAP support over HTTP is deprecated, but it is still available over HTTPS. For more information about Amazon S3 SOAP support, see Appendix A: Using the SOAP API.
Important
Newer Amazon S3 features are not supported for SOAP. We recommend that you use either the REST API or the AWS SDKs.
Amazon S3 SOAP Actions Tracked by CloudTrail Logging
SOAP API Name | API Event Name Used in CloudTrail Log |
---|---|
ListAllMyBuckets | ListBuckets |
CreateBucket | CreateBucket |
DeleteBucket | DeleteBucket |
GetBucketAccessControlPolicy | GetBucketAcl |
SetBucketAccessControlPolicy | PutBucketAcl |
GetBucketLoggingStatus | GetBucketLogging |
SetBucketLoggingStatus | PutBucketLogging |
Using CloudTrail Logs with Amazon S3 Server Access Logs and CloudWatch Logs
AWS CloudTrail logs provide a record of actions taken by a user, role, or an AWS service in Amazon S3, while Amazon S3 server access logs provide detailed records for the requests that are made to an S3 bucket. For more information about how the different logs work, and their properties, performance and costs, see Logging with Amazon S3.
You can use AWS CloudTrail logs together with server access logs for Amazon S3. CloudTrail logs provide you with detailed API tracking for Amazon S3 bucket-level and object-level operations. Server access logs for Amazon S3 provide you visibility into object-level operations on your data in Amazon S3. For more information about server access logs, see Amazon S3 Server Access Logging.
You can also use CloudTrail logs together with CloudWatch for Amazon S3. CloudTrail integration with CloudWatch Logs delivers S3 bucket-level API activity captured by CloudTrail to a CloudWatch log stream in the CloudWatch log group that you specify. You can create CloudWatch alarms for monitoring specific API activity and receive email notifications when the specific API activity occurs. For more information about CloudWatch alarms for monitoring specific API activity, see the AWS CloudTrail User Guide. For more information about using CloudWatch with Amazon S3, see Monitoring Metrics with Amazon CloudWatch.
Example: Amazon S3 Log File Entries
A trail is a configuration that enables delivery of events as log files to an Amazon S3 bucket that you specify. CloudTrail log files contain one or more log entries. An event represents a single request from any source. It includes information about the requested action, the date and time of the action, request parameters, and so on. CloudTrail log files are not an ordered stack trace of the public API calls, so they do not appear in any specific order.
The following example shows a CloudTrail log entry that demonstrates the GET Service, PUT Bucket acl, and GET Bucket versioning actions.