Responsibilities

  • Design, develop, and maintain data ingestion pipelines using Microsoft Fabric, Azure Data Factory, and API-based integrations.
  • Ingest data from enterprise source systems, including ERP, CRM, WMS, TMS, eCommerce, HR, and legacy platforms into the Bronze-layer.
  • Implement incremental data loads, audit controls, reconciliation processes, and validation checks to ensure accuracy and traceability.
  • Develop standardized Silver-layer transformations aligned with defined business rules and conformed dimensions.
  • Build curated Gold-layer data marts to support finance, sales, and operations analytics requirements.
  • Enable batch and near real-time data processing with a focus on availability, performance, and reliability for enterprise workloads.
  • Optimize SQL queries, transformations, and pipeline performance to support enterprise-scale workloads.
  • Collaborate with cloud data architects and BI engineers to align data models with reporting, semantic, and analytics needs.
  • Support foundational data governance by enabling data lineage, metadata capture, and ownership definitions.
  • Participate in agile sprint planning, technical design discussions, and sprint reviews.
  • Apply data quality frameworks, governance practices, and AI-ready data preparation techniques as part of platform design.