Role: Azure BI Engineer
Contract: 12 Months
Candidate must have at least 5-8 years experience in design and development of ETL solutions in Azure stack
Strong understanding of Azure service components like ADF, Data Bricks, SQL DB / SQL Server, Azure Blob storage, AAS and Power BI. Should be able to show working experience across all these technologies.
Should be experienced in migrating on-prem and legacy DWH to Azure stack
Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle. All project management and test coordination will happen through DevOps and should be able to manage and drive deliverables and report status through DevOps.
Candidate must be familiar with Azure security model and Storage accounts
Candidate must have Azure Databrick expertise with Python / Spark (Scala would be great). Strong understanding of Data Bricks background architecture, and advanced concepts like Security and productionalization.
Should be able to develop end to end automations in Azure stack – for ETL workflows, data quality validations and reporting, SIT automations through DevOps etc,
Must have good understanding of understanding of provisioning of Databricks and Azure resources
Good understanding of coding standards (code modularization, refactoring), testing automation
Familiarity with Airflow will be an added advantage.
Candidate must have at least 5+ years experience in productionized applications.
The detailed daily tasks are to be defined, however, at the high level, the following tasks should be considered:
Working closely with business users to gather data requirements and convert them to techno-functional specs.
Develop data solutions in Azure stack including identifying data sources, data modelling, designing and building data pipelines to ingest data to SQL Server using Azure Data bricks, development of AAS cubes for business reporting.
Develop pragmatic and strategic automations for driving better data governance and operations excellence.
Work with upstream and peer teams to setup the correct architecture to ingest data into
Executing test cases to unit test the development. Provide support through SIT and UAT cycles.
Participate in daily scrum calls and demonstrate daily progress on planned activities. Provide technical help and guidance across other modules, if required.
|Job Category||Azure BI Engineer|