Responsibilities

  • Design and develop ETL pipelines to extract, transform, and load data from SQL Server into Azure and Microsoft Fabric (Lakehouse/Warehouse).
  • Build adaptable pipelines for supporting full load, incremental, and CDC loads using Azure Data Factory (ADF) or PySpark.
  • Implement Medallion Architecture and structured data models aligned with enterprise BI needs.
  • Develop reusable and parameterized pipelines using a metadata-driven approach in ADF. 
  • Configure dynamic datasets and linked services to support flexible integration scenarios.
  • ADF with Azure DevOps for CI/CD, version control, and automated release pipelines.
  • Ability to design data warehouses and models using star and Snowflake schemas for enterprise-scale reporting.
  • Ensure data quality and reliability with alerts, monitoring tools, and complete technical documentation.
  • Collaborate with cross-functional teams, support junior engineers, and conduct technical reviews.