Serverless data pipelines: ETL workflow with Step Functions and Athena
This blog is Part 3 of a multi-part series around analyzing Flanders’ traffic whilst leveraging the power of cloud components! This miniseries was written in collaboration with Nick Van Hoof of TransIT. Goal This blog aims to explore the use of the AWS Glue service in conjunction with the AWS Athena service to repartition raw streaming data […]
Level up your data and analytics with Alteryx & Snowflake
Are you tired of being frustrated, and not having the answers your business users’ needs? It is a widely recognized truth that data is an increasingly valuable asset for organizations. Data is being generated and captured across systems in greater volumes and at increasing levels of granularity. At the same time, more users are demanding […]
Alteryx and Snowflake, the end-to-end platform for the data lifecycle
In our previous blog we addressed some of the key data management problems that immobilize organizations. The biggest issue is a data architecture problem. Data silos exist within different departments because organizations use many different apps and storage systems that don’t communicate or share data. This makes it almost impossible to perform data analysis or make global […]
Real-time Data Processing with Kinesis Data Analytics
This blog is part 1 in our miniseries on real-time data analytics using Flanders’ traffic data. This miniseries was written in collaboration with Nick Van Hoof of TransIT. Why real-time data and analytics? Traditionally, batch-processing analytics was considered adequate as most BI users could meet their business goals by looking at weekly or monthly business numbers. Then […]
Serverless data transform with Kinesis
This blog is part 2 in our miniseries about processing real-time data. This miniseries was written in collaboration with Nick Van Hoof of TransIT. Creating a data lake in Amazon Kinesis The goal of this blog is to explore the use of the Amazon Kinesis Data Firehose service to load raw streaming data events on an Amazon […]