Azure Data Engineer
Full time @Shreyansh Gupta in Data Science & Big Data Email JobJob Detail
-
Experience 4 - 8 years
Job Description
About Company – The Company is a software development company that has been helping businesses embrace digital experiences for the past 36 years. The company employs more than 400+ talented engineers. With a global presence, they provide top-tier services to clients around the world and have earned ISO 9001:2015 and ISO/IEC 27001:2013 certifications to demonstrate their commitment to quality and security. The company serves enterprise customers in more than 25 countries with quality business solutions.
Responsibilities:
- Design, develop, and deploy scalable data solutions on the Azure platform, leveraging services such as Azure Databricks, Azure SQL Database, Azure Data Factory, and others as appropriate.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Build and optimize Azure data pipelines for data ingestion, transformation, and loading (ETL) processes using Python, SQL, and other relevant technologies.
- Implement data governance and security best practices to ensure data integrity, privacy, and compliance with regulatory standards.
- Monitor and troubleshoot data pipelines to identify and resolve performance issues, bottlenecks, and data quality issues.
- Develop and maintain documentation for data engineering processes, including data models, data flow diagrams, and system architecture diagrams.
- Stay current with emerging trends and technologies in the field of data engineering and contribute to the continuous improvement in processes.
Requirements:
- 3-4 years of experience in data engineering, with a focus on cloud-based data platforms and technologies.
- Strong proficiency in Azure cloud services, particularly Azure Databricks, Azure SQL Database, Azure Data Factories and Python Notebooks.
- Hands-on experience with SQL Server and MongoDB, including data modelling, querying, and optimization.
- Proficiency in Python programming for data processing, automation, and scripting. Experience with data integration tools, such as Apache Spark, Kafka, or Azure Data Factory.
- Solid understanding of data warehousing concepts, dimensional modelling, and ETL processes. Excellent problem-solving skills and attention to detail, with a strong focus on delivering high-quality solutions.
- Effective communication skills and the ability to collaborate with team members and stakeholders across different functional areas.
Preferred Qualifications:
- Experience with big data technologies such as Hadoop, Hive, or Spark.
- Certification in Azure Data Engineering or related Azure certifications.
- Experience working in Agile development environments and using DevOps practices for CI/CD.
Note: We appreciate every application, however, due to a high volume of applicants, only shortlisted candidates will be contacted
Required skills
Other jobs you may like
-
Azure Data Engineer
- @ Hemangi Panchal
- Ahmedabad, Gujarat, India