As a Data Engineer at Cloubis, you build reliable, scalable, and AI-ready data platforms on Microsoft Fabric and Azure Databricks. You form the backbone of the Cloubis Managed Data Platform (MDP) and ensure that data, semantics (Fabric IQ), and grounding (Foundry IQ) evolve hand in hand. You apply modern DevOps and Dev IQ practices and help customers move towards predictable cost models.
What will you do?
Stakeholder & Collaboration
Collaborates with Data Analysts, AI Engineers, and AI Architects in cross-functional teams.
Aligns with customer stakeholders on data scope, SLAs, and operational requirements.
Translates architectural principles into concrete implementation choices and backlog items.
Core Focus — Data Engineering
Builds and maintains data pipelines on Microsoft Fabric (Pipelines, Notebooks, Dataflows Gen2) and Azure Databricks.
Models data in medallion layers (bronze/silver/gold) with a strong focus on reusability and cost efficiency.
Implements data contracts, schema validation, and quality testing as part of CI/CD processes.
Optimizes performance, capacity, and cost management on OneLake and Fabric capacities.
Cross-Role Data & AI Chain
Contributes to semantic models further refined by Data Analysts (Fabric IQ).
Delivers AI-ready datasets to AI Engineers for grounding and agent-based solutions (Foundry IQ).
Works closely with Dev IQ practices, including GitHub Copilot, code reviews, and automated testing.
Operationalization & Responsible AI
Implements observability, alerting, and incident response for the Cloubis Managed Data Platform.
Builds Data Quality Monitoring as a Service controls within pipelines (completeness, freshness, drift detection).
Ensures governance and compliance through Purview, Entra ID, and Defender (GDPR, NIS2).
Applies predictable-cost principles through capacity planning, FinOps, and autoscaling strategies.
Customer-Zero & Industry Specialization
Applies new Fabric and Databricks features internally before introducing them to customers.
Specializes in a specific industry vertical and develops sector-focused templates for common data models.
Creates reusable building blocks for the Cloubis portfolio (data contracts, ingestion patterns).
Process Improvement & Knowledge Sharing
Maintains and versions MDP accelerators and infrastructure-as-code modules.
Provides technical trainings and demos and shares knowledge within Microsoft and Databricks communities.
Coaches junior colleagues in modern data engineering practices and code quality.
Technology & Tooling
Microsoft Fabric (OneLake, Lakehouse, Warehouse, Pipelines, Notebooks, Dataflows Gen2).
Azure Databricks, Delta Lake, Spark, Unity Catalog.
