Senior Consultant Data Engineer

  1. Home
  2. Open Positions
India-Miracle City
 
Exp 12-15 Years

Key Skills

Python ProgrammingGoogle BigQueryGCSSQL and Data TransformationApache Airflow and AstronomerIncremental and Batch Data ProcessingData Modeling and Canonical Data ArchitectureEntity Resolution and Identity ManagementHistorical Data Management and VersioningInformatica data qualitySchema ValidationSchema EvolutionData Lineage and ProvenanceElastic Search Indexing and Data Projections
Apply Now

Responsibilities

  • Develop and maintain BigQuery datasets and Google Cloud Storage structures for enterprise data processing.
  • Build and manage Apache Airflow workflows using Astronomer for incremental data acquisition, backfills, validation, and data replay.
  • Implement canonical identities and data models to maintain consistency across enterprise sources.
  • Manage historical records through effective dating, recorded-time tracking, and versioning.
  • Establish source provenance and version-linked data projections for Elasticsearch indexing.
  • Maintain data contracts, schema validation, completeness tests, and data quality controls.
  • Implement access controls, monitoring, and deployment automation in coordination with Ford source owners.
  • Support data governance, technical documentation, automated testing, and secure engineering practices while using Spec Kit and approved AI-assisted tools.

Relevant Jobs

We are an Equal Opportunity Employer

Applicants are considered for employment without attention to or discrimination against race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. All employment is decided on the basis of qualifications, merit and business need.