Azure Data Engineer

Full time @Hemangi Panchal in Data Science & Big Data
  • Ahmedabad, Gujarat, India View on Map
  • Salary: ₹200,000.00 - ₹2,400,000.00 / Yearly
Email Job

Job Detail

  • Experience  4 - 8 years

Job Description

About Company: Organization is a software development company that has been helping businesses embrace digital experiences for the past 36 years. We mean to guarantee most extreme consumer loyalty, dexterity, and unrivaled advanced execution. We do it by consolidating our abilities, energy, and values that empower us to go past individuals and reason. We believe in innovation and continuous learning to transform business models by leveraging next-gen technologies. We help leading enterprises and businesses achieve digital transformation goals through our wide range of IT services, business solutions, and custom software development.

Job Description:
We are seeking an experienced Azure Data Engineer with a solid background in Azure Databricks, SQL
Server, MongoDB, and Python data processing technologies. As a key member of our data
engineering team, you will be responsible for designing, implementing, and maintaining robust data
pipelines and architectures to support our client’s data processing needs.

Responsibilities:
Design, develop, and deploy scalable data solutions on the Azure platform, leveraging services such
as Azure Databricks, Azure SQL Database, Azure Data Factory, and others as appropriate.
Collaborate with cross-functional teams to understand data requirements and translate them into
technical solutions.
Build and optimize Azure data pipelines for data ingestion, transformation, and loading (ETL)
processes using Python, SQL, and other relevant technologies.
Implement data governance and security best practices to ensure data integrity, privacy, and
compliance with regulatory standards.
Monitor and troubleshoot data pipelines to identify and resolve performance issues, bottlenecks,
and data quality issues.
Develop and maintain documentation for data engineering processes, including data models, data
flow diagrams, and system architecture diagrams.
Stay current with emerging trends and technologies in the field of data engineering and contribute to
the continuous improvement in processes.
Requirements:
Bachelor’s or master’s degree in computer science, Engineering, or a related field.
3-4 years of experience in data engineering, with a focus on cloud-based data platforms and
technologies.
Strong proficiency in Azure cloud services, particularly Azure Databricks, Azure SQL Database, Azure
Data Factories and Python Notebooks.
Hands-on experience with SQL Server and MongoDB, including data modelling, querying, and
optimization.
Proficiency in Python programming for data processing, automation, and scripting.
Experience with data integration tools, such as Apache Spark, Kafka, or Azure Data Factory.
Solid understanding of data warehousing concepts, dimensional modelling, and ETL processes.
Excellent problem-solving skills and attention to detail, with a strong focus on delivering high-quality
solutions.

Effective communication skills and the ability to collaborate with team members and stakeholders
across different functional areas.
Preferred Qualifications:
Experience with big data technologies such as Hadoop, Hive, or Spark.
Certification in Azure Data Engineering or related Azure certifications.
Experience working in Agile development environments and using DevOps practices for CI/CD.

Required skills

Other jobs you may like