Data Integration Engineer
Location: Prefer local to Coral Gables, but flexible on it
Length: contract to hire
Visa sponsorship is not available for this position.
Notes *We are looking for a candidate with Data engineering and ETL development background. The candidate must have a handson experience on azure SQL database, Azure Synpase, Azure Data factory, Azure Databricks , PowerBI and fundamental knowledge on core azure services like key vault , storage account etc. The candidate will be working on Microsoft Fabric once they join the team.*
Please find the updated job description for Azure Data integration Engineer that mostly primarily focuses on Microsoft Fabric[strongly preferred] and AI[good to have]:
- Design , implement and manage data solutions within Microsoft fabric analytics platform
- Hands-on experience in developing end to end data solutions using Microsoft components such as data engineering , data integration, real-time analytics
- Hands-on experience managing data lakes, Lakehouses, delta lake tables within Microsoft fabric
- Expert in data transformation and processing using SQL ,python or any related programming language
- Azure DevOps and managing CI/CD solutions with especial emphasis on fabric pipelines
- Optimize data models., queries and ETL processes to ensure high performance and scalability
- Implement and manage data connectors to bring data into Microsoft fabric’s unified platform
- Provide support for data visualization , reporting and advanced analytics capabilities
- Hands-on experience on Designing and developing data pipelines using Azure data factory , Azure Synapse , ADLS, DataBricks and other ETL solutions
- Automate infrastructure deployment using IAC- knowledge on terraform, biceps, ARM, ansible and other tools
- Hands on experience on docker , Kubernetes, ACR, ACI ,container apps
- Proficient in CLI and PowerShell
- Provision, configure, manage and monitor storage accounts, key vaults, function apps, logic apps , app services ,, databases , and messaging services
Preferable(good to have) Skills:
- Knowledge of machine learning workflows and ability to integrate data science capabilities within Microsoft fabric
- Knowledge in leveraging copilot integration with azure data services and OpenAI services
- Design ,Create and deploy AI and Machine Learning solutions using Microsoft azure AI services and resources
- Knowledge on cleaning and preparing data from various azure data sources for training and deploying AI models
- Develop end to end AI solutions such as real-time data processing pipelines , Rest Apis and user-facing applications