
Consumer Goods & Retail - Refactoring, shift and new development of Data Services in Google Cloud
Consumer Goods & Retail
The project addressed data and knowledge silos by enabling teams to develop transparent data products in a Google Cloud-based environment.
Initial situation
The customer’s challenge was to solve data and knowledge silos which have been built up over time.
The original data products were deployed in several technologies like SAS, SQL-Server stored procedures, Java /Python-Applications or Apache Spark.
Architecture
The architecture is built on Google Cloud using technologies such as Google BigQuery, Google Cloud Composer, Google Cloud SQL, Google Cloud Storage, Google Compute Engine, Google DataProc, Google DataFlow, GDPR, SQL, and Python. Furthermore, synvert’s knowledge in Data Mesh, Data Governance, and CI / CD played an important role.
Generated benefits
In a data mesh-like environment, synvert replaced opaque black boxes with transparent data products, successfully launching around 20 operational data products.
Services accomplished by synvert
While reverse engineering the data and knowledge silos, synvert enabled the customer’s team in developing their own data products and taking responsbility at ease, while implementing entreprise-ready data products in parallel. Basis was a standardized data platform with automated processes that provided a data mesh like environment with a high degree of guidance for developing data products by business-biased data team.