Sr. Azure Data Engineer
Mozaic
Data Science
Nashville, TN, USA
Posted on Thursday, May 9, 2024
We are looking for an experienced and detail-oriented Senior Data/SQL Engineer to join our dynamic team. As a Senior Azure Data Engineer, you will play a crucial role in designing, implementing, and optimizing data storage solutions, ensuring efficient data retrieval, and supporting data-driven applications. The ideal candidate should have a strong background in SQL, database architecture, and data engineering.
Azure Data Architecture & Design:
- Design and implement scalable data architectures on Microsoft Azure, leveraging services like Azure Data Factory, and Azure Synapse Analytics.
- Select and configure appropriate Azure data storage solutions (e.g., Azure Blob Storage, Azure Data Lake Storage) based on specific data needs.
- Ensure data security, compliance, and governance are implemented throughout the data lifecycle.
Data Ingestion & Processing:
- Develop and manage efficient data pipelines using Azure Data Factory to automate data ingestion from various sources (internal applications, external APIs, streaming data).
- Utilize Azure Services or other big data processing tools for complex data transformations and ETL (Extract, Transform, Load) processes.
- Optimize data pipelines for performance and scalability to handle large data volumes.
Data Modeling & Warehousing:
- Design and implement dimensional data models (e.g., star schema) within Azure Synapse Analytics or other data warehousing solutions.
- Ensure data quality and consistency through data cleansing, transformation, and validation processes.
- Optimize data storage and querying performance for efficient data analysis and reporting.
Collaboration & Communication:
- Collaborate closely with cross-functional teams (product, engineering, analytics) to understand data requirements and translate them into actionable technical solutions.
- Effectively communicate complex data architecture concepts and findings to both technical and non-technical audiences.
- Document data pipelines, models, and procedures for knowledge sharing and future maintenance.
Cloud Expertise & Innovation:
- Stay up-to-date on the latest advancements in Azure data services and best practices.
- Proactively identify opportunities to leverage new Azure features to improve data management and analytics capabilities.
- Be a champion for innovation, seeking ways to optimize data pipelines and infrastructure for efficiency and cost-effectiveness.