Data Engineer - Azure Fabric Job at Ashra Technologies Private Limited, Remote

ZHpXbFRIUGhnbEJ1Rk1kcFhyQ05RQm91SGc9PQ==
  • Ashra Technologies Private Limited
  • Remote

Job Description

We are seeking a hands-on Data Engineer (5 7 years) to build and support a modern, governed data platform for a leading US-based insurance organization. The role focuses on implementation and delivery under defined architecture, with strong emphasis on PySpark, SQL, Azure Fabric Dataflows Gen2, and knowledge of CI/CD .

Responsibilities

  • Build and maintain Azure Fabric data pipelines using Pipelines, Dataflows Gen2, and Notebooks (PySpark) .
  • Implement Lakehouse-first / Medallion (ODS, Bronze Silver Gold) data patterns, including Type-2 SCD and golden records.
  • Develop PySpark transformations ; use SQL extensively for validation, reconciliation, and performance tuning.
  • Create Lakehouse SQL views and materialized views , enabling DirectLake consumption.
  • Ingest data from on-prem SQL Server DWHs and API-based sources (via Azure API Management/connectors).
  • Support on-prem Azure Fabric migrations , including historical data loads and data quality validation.
  • Implement event-driven ingestion where required using Fabric Event Streams and KQL .
  • Operate within governed Fabric environments (OneLake layout, RBAC, standards).
  • Monitor pipelines, handle failures, and optimize performance using logs and diagnstics.
  • Contribute to CI/CD pipelines using Azure DevOps or Bitbucket .

Required Experience

  • 5 7 years in data engineering / ETL / DWH development .
  • Strong hands-on skills in PySpark and SQL .
  • Practical experience with Azure Fabric (Lakehouse, OneLake, Dataflows Gen2, Pipelines) for 3 to 5 years
  • Solid understanding of Medallion architecture, SCD Type-2 , and cloud data migrations.
  • Experience with API-based ingestion and CI/CD for data platforms .
  • Familiarity with data governance and security in regulated environments.

Job Tags

Full time

Similar Jobs

Penn State Health

Operating Room Aide - Operating Room Job at Penn State Health

 ...supervision of nursing staff to perform the essential duties to assist patient care providers in the care of Perioperative patients....  ...that is challenging, dynamic and state-of-the-art. Our operating room suites consist of 34 operating rooms and four procedure rooms.... 

Kreyco

High School Italian Teacher (Online) Job at Kreyco

 ...a comprehensive curriculum, coaching and mentorship, and professional development at no cost. We have an online, high school Italian teaching opportunity available for the 2025-2026 school year. Payment varies based on your teaching project and ranges from $400 to... 

U.S. Army

Police Officer Job at U.S. Army

 ...Military Police (U.S. Army). Job Type: Full-time or Part-time. Salary: $40,000 $80,000 per year. Enlistment is required for this position. Job Summary: As a Military Police Soldier, youll protect peoples lives and property on Army installations by enforcing... 

Clean Chemistry, Inc.

Quality Assurance Coordinator Job at Clean Chemistry, Inc.

 ...Job Title: Quality Assurance Coordinator Location: Midland, Texas Job Type: Full-Time Department: Quality Assurance Job Overview...  ...in Midland, TX. The ideal candidate will be responsible for remotely monitoring water treatment units, reviewing performance data... 

The State of Kansas

Resource Protection Officer Job at The State of Kansas

 ...Vacation leave Work-Life Balance programs: parental leave, military leave, jury leave, funeral leave Paid State Holidays (designated...  ...background check. Never have been convicted of a felony by a civilian or military court except for minor traffic violations and...