VRT is the Flemish public radio and television broadcaster. VRT wants to strengthen the Flemish society by informing, inspiring, and connecting. As a radio and television broadcaster, they focus on informative and cultural programs, as well as sports, drama and entertainment.
Some of VRT’s well-known brands are:
VRT requested support for the development of a data warehouse solution to make analytics more performant, transparent, actionable and user-friendly.
VRT had been experimenting with dbt, a transformation framework that enables analysts and engineers collaborate with their shared knowledge of SQL to deploy analytics code. They were looking for Business Intelligence experts to strengthen VRT’s Data & Intelligence team. Their focus was to set up a datawarehouse solution with dbt and to develop dashboards in Metabase to translate data into insights.
Main goals of Business Intelligence experts:
Our BI experts created data transformation pipelines to make data stored in data lakes more accessible for analytical purposes. In addition, as part of VRT’s data-driven team, insights were extracted from this data and communicated to relevant stakeholders.
To implement the solution, our BI experts followed best practices as recommended by the dbt Labs team. These best practices were adjusted to the context, data landscape and requirements of VRT resulting in the following four-layer architecture:
Thanks to dbt’s data lineage capabilities, all data transformations and data flows are made insightful. The resulting data structure allows for more simplified and robust dashboard design in Metabase.
See below for an example data lineage
Different technologies are used to successfully deliver this data analysis solution: dbt for data transformations, Bitbucket for version control, Airflow for data orchestration, Cloudwatch for monitoring the data transformation flow, AWS Athena as underlying query serverless service, and Metabase for dashboarding.
All these tools and technologies required further development from Cloubis’ team in order to offer actionable insights from data.
Cloubis was able to offer an end-to-end data solution to VRT by setting up dbt models in a layered structure that can be easily queried by front-end tools and other data consumers. VRT can now rely on a robust and performant data warehouse solution, as well as documented best practices, templates and guidelines.
This solution results in a lower cost and better performance by aligning data partitioning and data modelling in a way that data is queried for business use cases.
In addition, by setting up different dashboards in Metabase, the customer VRT is now able to deliver automated answers for common use cases. Furthermore, multiple insights were also distributed actively throughout the organization, stimulating an action-oriented data-driven mindset.