Job Summary:
We are looking for a skilled Data Engineerto join our development team. This hybrid role involves both Data Analysis and Data Engineering tasks, focusing on validating data across product databases, data warehouses, reports, and ETL processes from customer data. The ideal candidate will have extensive experience with the Microsoft Fabric stack, including Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service. Additionally, strong expertise in Excel and other ETL tools is essential.
Key Responsibilities:
Data Validation:
- Validate and ensure the accuracy and integrity of data in the product database.
- Validate data warehouses, reports, and ETL processes to ensure consistency and reliability.
- Conduct data quality checks and implement data cleansing procedures.
Data Analysis:
- Understand and analyze customer data from various sources.
- Interpret business requirements and translate them into technical specifications for reporting and data processing.
- Collaborate with stakeholders to understand data needs and provide actionable insights.
Data Engineering:
- Design, develop, and maintain data pipelines and ETL processes using the MS Fabric stack.
- Implement data integration solutions using Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service.
- Develop and manage data flows, data factories, and data pipelines to support data processing and transformation.
Technical Skills:
- Utilize Azure Data Factory to create, schedule, and orchestrate data pipelines.
- Leverage Azure Synapse for big data analytics and data warehousing solutions.
- Manage and optimize Azure SQL databases for data storage and retrieval.
- Utilize Azure Data Lake for scalable data storage and advanced analytics.
- Implement Azure App Service for deploying and managing applications.
Collaboration and Communication:
- Work closely with the development team to integrate data solutions with product features.
- Collaborate with data analysts, business analysts, and other stakeholders to ensure data solutions meet business requirements.
- Provide technical guidance and support to team members on data-related tasks.
Continuous Improvement:
- Stay updated with the latest trends and best practices in data engineering and analysis.
- Continuously improve data processes and workflows to enhance efficiency and performance.
- Implement best practices for data governance, security, and compliance.
Education:
- Bachelor’s degree in computer science, Information Technology, Data Science, or a related field. Advanced degree preferred.
Experience:
- Minimum of 4+ years of experience in data engineering and data analysis.
- Preferred experience with the MS Fabric stack: Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service or similar technologies
- Experience with data validation, data warehousing, and ETL processes.
- Fluent in Excel and other ETL tools.
Skills:
- Strong analytical and problem-solving skills.
- Proficiency in SQL and database management.
- Ability to understand and interpret business requirements.
- Excellent communication and interpersonal skills.
- Ability to work independently and in a team environment.
- Strong organizational and time management skills.
Preferred Qualifications:
- Certification in Microsoft Azure or related technologies.
- Experience with other data engineering tools and frameworks.
- Knowledge of data governance and security best practices.
Send us your resume at [email protected] mentioning the position in subject line.