EcommCo’s Data Lake leverages Amazon Elasticsearch Service for data governance over Data Providers' submissions, Curated Datasets and Published Data. All metadata pertaining to data in Data Lake are indexed and available in the Elasticsearch Service dashboard.
The diagram below illustrates how the availability of new data in S3 triggers events, which get published to SNS, which trigger Lambda functions to index data in the Elasticsearch Service.
When you click this button, the following steps will be performed within your AWS account: