Migration AWS data platform to Google Cloud

All Success Stories

Success stories

Consumer Goods & Retail - Migration AWS data platform to Google Cloud

Go back to success stories

About

Consumer Goods & Retail

With the expertise of synvert, a leading retail and e‑commerce company migrated its existing data platform from AWS and Cloudera to Google Cloud to optimize costs and leverage modern cloud-native technologies. By developing a data lake in Google Cloud and implementing best practices in software and data development, synvert achieved faster data access and more efficient data aggregation for analysis. This led to significant time savings and an increased frequency of regular business reports, enabling timely business decisions.

Initial situation

The infrastructure and several existing data products need to be shifted from AWS and Cloudera to Google Cloud.

Solution

The goal is to shift a data platform from AWS to Google Cloud. Infrastructure is built up via Infrastructure as Code by terraform / terragrunt. Several data products have been shifted to Google Cloud native services: Data Pipelines based on Apache Spark, SQL-Workloads, Cloudera Pipelines which now are available within Google BigQuery.

Architecture

The architecture is built on Google Cloud using technologies such as Google BigQuery, Google Cloud Composer, Google Cloud IAM, Google Cloud SQL, Google Cloud Storage, Google Compute Engine, Google DataProc, git, GitLab, CI / CD, Scala, Python, Docker, SQL, and IaC (Terraform, Terragrunt).

Generated benefits

The AWS solution could be decomissioned after 1 year.

Communications, Media & Telecom

Refactoring, shift and new development of Data Services in Google Cloud

Establishment of a Master Data Management Foundation

Industrials

Central Data Lake

Replacement of a complex IBM Datastage structure

CRM analytics and lead management

Standardization of evaluation processes

Development of an ERP data hub

Establishment and further development of a DWH

Development of a group-wide BI platform

Establishment of a new sales reporting system

Source data migration with automation of the source data connection

Cloud self-service BI for data-driven corporate management

Development of various ML use cases with AWS

Replacement of an in-house software development

Company-wide data integration

Implementation of real-time data links

Consumer Goods & Retail

Accept
Name	YouTube
Provider	Google LLC
Purpose	This website uses Youtube for marketing purposes. The data is transferred to a server in the USA and stored there. The personal data is transmitted on the basis of Art. 46 and/or Art. 49 para. 1 lit. a) GDPR.
Duration	Data is deleted as soon as it is no longer required for processing.
Further information	https://policies.google.com/privacy

Accept
Name	hellotrust
Provider	Keyed GmbH
Purpose	hellotrust stores the user's consent status for cookies on the current domain.
Duration	Data is deleted as soon as it is no longer needed for processing.
Further information	https://hellotrust.de/datenschutz

Accept
Name	Google Analytics
Provider	Google LLC
Purpose	This website uses Google Analytics to analyse website usage by users. The data is transferred to a Google server in the USA and stored there. The personal data is transmitted on the basis of Art. 46 and/or Art. 49 para. 1 lit. a) GDPR.
Duration	Data is deleted as soon as it is no longer needed for processing. As a rule, the cookies are stored by Google for a period of 2 years.
Further information	https://policies.google.com/privacy

About

Ini­tial situation

Solu­tion

Archi­tec­ture

Gen­er­ated bene­fits

Con­sol­id­at­ing Big Data & BI at a Major Media Powerhouse

Vehicle Data Store

Soft­ware­Fact­ory at a Lead­ing Auto­mot­ive Soft­ware Company

DevX Impact at a Fin­ance Company

Driv­ing Inter­na­tional Expan­sion for a Lead­ing Online Car Seller

Accel­er­at­ing Cloud-Nat­ive Devel­op­ment for a Car Manufacturer

Retail Com­mis­sion Dia­gnostics Anom­aly Detection

Set­ting up a Reli­able and Power­ful Platform

Pre­dic­tion of cus­tomer prob­ab­il­ity to churn

Early Detec­tion of Mech­an­ical Issues

NLP​ in Auto­mot­ive Reporting

Oper­a­tional Data Lake

Real-Time Mar­ket­ing

Auto­matic clas­si­fic­a­tion of cars by their model

Data plat­form and cata­log for com­pens­a­tion claims

Data Recon­cili­ation

Cent­ral­ized Data Warehouse

Data as a Ser­vice – BI & Big Data CC

Oper­a­tional Work/Support in Data Warehousing

Erosion Detec­tion with Com­puter Vision

Devel­op­ment and Imple­ment­a­tion of a Fully Auto­mated MLOps Platform

Pre­dic­tion and Alloc­a­tion Optim­iz­a­tion for sta­tion­ary Channels

Build­ing a Near Real-Time Recom­mend­a­tion System