Role: Senior Azure Data Engineer
Shift Timings: 2-11 pm
Experience: 5+ years

Job Description:

We are looking for a Senior Azure Data Engineer with substantial experience in migration projects, including both historical data migration and pipeline migration. The ideal candidate will possess strong technical skills in Azure Databricks, ADLS Gen2, and Python coding. Knowledge of Unity Catalog and experience in developing ELT data pipelines and DevOps practices are highly desirable.

Key Responsibilities:

    Lead and manage data migration projects, including historical data migration and pipeline migration.
    Develop and maintain data pipelines (ELT) using Azure Databricks and ADLS Gen2.
    Write efficient and robust Python code for data processing and transformation.
    Implement and manage data cataloging with Unity Catalog (preferred).
    Ensure seamless integration of data pipelines with existing systems and processes.
    Collaborate with cross-functional teams to ensure data quality, integrity, and security.
    Apply DevOps practices to automate and streamline data engineering workflows.

Requirements:

    5+ years of experience in data engineering, with a focus on migration projects.
    Proficiency in Azure Databricks and ADLS Gen2.
    Strong Python coding skills.
    Experience in developing ELT data pipelines.
    Knowledge of Unity Catalog (preferred).
    Familiarity with DevOps practices.
    Excellent problem-solving skills and attention to detail.
    Strong communication and collaboration skills.

If you meet the above requirements and are ready to take on a challenging and rewarding role, we would love to hear from you.