
Industrials
synvert developed an open-source solution for a German car manufacturer to make data from over 10,000 sources available to any requester, focusing on data availability, business understanding, technical metadata, and decentralization.
Initial situation
The client, a German car manufacturer, had a lot of different data sources from different departments and locations (10000+).
The vision has been to design a method through which this data could be made available to any requester by considering the following points:
- availability of data
- business understanding of data
- technical metadata understanding/availability
- decentralization
The goal was to create a high-level solution of the “Data As a Service” concept, defining the next steps to accomplish the below mission statement.
Architecture
The entire design has been developed using Apache projects/technologies.
- Monitoring: Elasticsearch, Solr, Zabbix, Nagios, Sensu.
- Data Catalog: Elasticsearch, Neo4j, OrientDB, MarkLogic.
- Cache: Apache Ignite, Memcached, GemFire, Hazelcast.
- Deployment management: Kubernetes, Docker, Apache Mesos.
- Data Services: API, JDBC, RESTful, JBoss, Spring.
- Federation: Oracle Big Data SQL.
- Messaging: Kafka, IBM MQ, RabbitMQ.
- Security: Hashicorp Vault, Custom made
Generated benefits
The customer achieved its vision through making all cc in order to get faster, better, and optimized predictions for all data-related products.
It was estimated that manual effort to build data-related products was reduced by 50%. This was accomplished by making it possible to access useful data simply by subscribing to “Data as a Service”.
Services accomplished by synvert
synvert designed a solution using open-source software through which the relevant data can be made available to any requester by considering the following points:
- availability of data
- business understanding of data
- technical metadata understanding/availability
- decentralization