Data ingestion to Chronicle overview
The following diagram illustrates how your security data can flow to Chronicle and how Chronicle handles that data and prepares it for analysis using the Chronicle user interface.
Flow and Processing of Customer Security Data to Chronicle
Chronicle processes customer security data as follows:
- An internal data forwarding service (such as Chronicle Forwarder) or a standard secure protocol (such as SFTP) sends raw security data directly to Chronicle. The security data is encrypted while in transit to Chronicle.
- Chronicle retrieves security data stored in a cloud service (such as Amazon S3 or Google Cloud). The data is encrypted while in transit to Chronicle.
- Chronicle logically segregates and stores your security data into your account in an encrypted form. Data is accessed by the customer only, plus a limited number of Google personnel as necessary to support, develop, and maintain the product.
- Chronicle parses and validates the raw security data, making data easier to process and display.
- Chronicle indexes the data to make it easier to search.
- After it is validated and parsed, Chronicle checks the security data against third-party feeds (such as the DHS threat feed) and Chronicle's internal threat analytics tools and systems.
- Chronicle stores parsed and indexed data in an encrypted form within each account.
- You log into your account to search and review your security data.
- Chronicle searches for matches between your security data and the VirusTotal malware database. Chronicle displays matches in the VirusTotal Insight block in the Chronicle UI. Your security data is never shared with VirusTotal.