- Cloud Collectors Overview
- Administration
- Administrative Access
- Shareable Service Accounts
- Add Accounts for AWS Cloud Collectors
- Add Accounts for Cisco Duo Cloud Collector
- Add Accounts for Google Cloud Collectors
- Add Accounts for Microsoft Cloud Collectors
- Add Accounts for Okta Cloud Collectors
- Add Accounts for Salesforce Cloud Collectors
- Add Accounts for Splunk Cloud Collectors
- Add Accounts for Trend Micro Cloud Collectors
- Define a Unique Site Name
- Sign Up for the Early Access Program
- Onboard Cloud Collectors
- AWS CloudTrail Cloud Collectors
- AWS CloudWatch Cloud Collector
- AWS S3 Cloud Collector
- AWS SQS Cloud Collector
- Azure Activity Logs Cloud Collector
- Azure Log Analytics Cloud Collector
- Azure Event Hub Cloud Collector
- Azure Storage Analytics Cloud Collector
- Cisco Duo Cloud Collector
- Cisco Umbrella Cloud Collector
- Cribl Cloud Collector
- CrowdStrike Cloud Collectors
- GCP Pub/Sub Cloud Collector
- Microsoft Defender XDR (via Azure Event Hub) Cloud Collector
- Microsoft Entra ID Context Cloud Collector
- Microsoft Entra ID Logs Cloud Collector
- Microsoft 365 Exchange Admin Reports Cloud Collector
- Supported Sources from Microsoft 365 Exchange Admin Reports
- Migrate to the Microsoft 365 Exchange Admin Reports Cloud Collector
- Prerequisites to Configure the Microsoft 365 Exchange Admin Reports Cloud Collector
- Configure the Microsoft 365 Exchange Admin Reports Cloud Collector
- Troubleshooting the Microsoft 365 Exchange Admin Reports Cloud Collector
- Microsoft 365 Management Activity Cloud Collector
- Microsoft Security Alerts Cloud Collector
- Microsoft Sentinel (via Event Hub) Cloud Collector
- Netskope Alerts Cloud Collector
- Netskope Events Cloud Collector
- Okta Cloud Collector
- Okta Context Cloud Collector
- Palo Alto Networks Cortex Data Lake Cloud Collector
- Proofpoint On-Demand Cloud Collector
- Proofpoint Targeted Attack Protection Cloud Collector
- Salesforce Cloud Collector
- SentinelOne Alerts Cloud Collector
- SentinelOne Cloud Funnel Cloud Collector
- SentinelOne Threats Cloud Collector
- Splunk Cloud Collector
- Symantec Endpoint Security Cloud Collector
- Trend Vision One Cloud Collector
- Zscaler ZIA Cloud Collector
- Webhook Cloud Collectors
- Troubleshooting Cloud Collectors
Configure the AWS S3 Cloud Collector
Set up the AWS S3 Cloud Collector to continuously ingest events from AWS S3 buckets.
Before you configure the AWS S3 Cloud Collector, ensure that you complete the Prerequisites to Configure the AWS S3 Cloud Collector.
Log in to the Exabeam Security Operations Platform with your registered credentials as an administrator.
Navigate to Collectors > Cloud Collectors.
Click New Collector.
Click AWS S3.
Enter the following information for the cloud collector:
Name – Specify a name for the Cloud Collector instance.
Account – Select the AWS account you want to use with this Cloud Collector.
If you have not yet created an AWS account, in the Account list, select Create Account. For instructions, see Add Accounts for AWS Cloud Collectors.
SQS-URL – Enter the SQS URL that you obtained while completing prerequisites.
SQS-Region – Select the SQS region. For example,
us-east-1
.S3-Region – Select the S3 region. For example,
us-west-1
.SQS Message-Origin – Based on the integration you are configuring; messages are put in the queue in two different ways:
S3_TO_SNS_TO_SQS – Select this option to place messages in the queue to send messages from S3 to SNS, and then to configure them in SNS to be sent to SQS.
S3_TO_SQS – Select this option to place messages in the queue so that S3 notifies the SQS directly.
File Processing – By default, the cloud collector processes Events per Line, however you can change the file processing to process events embedded in a JSON Array or Object. If you choose JSON Array or Object, you can optionally specify the JSON Path To Events (Period Delimited).
Additionally, the AWS S3 Cloud Collector supports extraction of events from JSON Objects or JSON Arrays from any level by specifying period delimited path to the specific event object or event array.
Refer to the following examples with multiple JSON formats.
Example 1: In this example,
k3.k3_2
is the JSON path to the following embedded JSON array.{ "k1": "v1", "k2": [ "v2_1", "v2_2" ], "k3": { "k3_1": "v3_1", "k3_2": [ { "obj1Key": "obj1Val" }, { "obj2Key": "obj2Val" } ] } }
Example 2: In this example,
k3.k3_2
is the JSON path to the embedded JSON array that contains multiple JSON objects each with k3.k3_2 JSON array. The collector ingests contents of eachk3.k3_2
JSON array as an individual log event.[{ "k1": "v1", "k2": [ "v2_1", "v2_2"], "k3": { "k3_1": "v3_1", "k3_2": [ { "obj1Key": "obj1Val"}, { "obj2Key": "obj2Val"} ] } }, { "k1": "v1", "k2": [ "v2_1", "v2_2"], "k3": { "k3_1": "v3_1", "k3_2": [ { "obj1Key": "obj1Val"}, { "obj2Key": "obj2Val"} ] } }, { "k1": "v1", "k2": [ "v2_1", "v2_2"], "k3": { "k3_1": "v3_1", "k3_2": [ { "obj1Key": "obj1Val"}, { "obj2Key": "obj2Val"} ] } }]
Example 3: In the following example, if JSON PATH TO EVENTS is specified as events.payload, the cloud collector extracts payload (JSON Object) from each element of the events (JSON Array) and ingests it as an event.
{ "cursor": { "partition": "0", }, "events": [ { "metadata": { "occurred_at": "2024-02-05T19:30:27.517754Z" }, "payload": { "cluster_alias": "bi-kub-test", "event": { "verb": "get" } } }, { "metadata": { "occurred_at": "2024-02-05T19:30:27.515269Z", }, "payload": { "cluster_alias": "bi-kub-test", "event": { "verb": "update" } } } ], "info": { "debug": "Stream started" } }
If you do not specify a path for the JSON Array, the cloud collector assumes the events are elements of the array.
[ { "obj1Key": "obj1Val" }, { "obj2Key": "obj2Val" } ]
(Optional) SITE – Select an existing site or to create a new site with a unique ID, click manage your sites. Adding a site name helps you to ensure efficient management of environments with overlapping IP addresses.
By entering a site name, you associate the logs with a specific independent site. A sitename metadata field is automatically added to all the events that are going to be ingested via this collector. For more information about Site Management, see Define a Unique Site Name.
(Optional) TIMEZONE – Select a time zone applicable to you for accurate detections and event monitoring.
By entering a time zone, you override the default log time zone. A timezone metadata field is automatically added to all the events that are going to be ingested via this collector.
To verify that the cloud collector communicates with the AWS service, click Test Connection.
Note
You can start the cloud collector via the user interface only if the test connection during cloud collector configuration is successful.
Click Install.
A confirmation message informs you that the new Cloud Collector is created.