Assistant Manager – Data Engineering

About the Company

A global technology consulting firm specialising in digital transformation, enterprise solutions, and system implementation. The organisation works with clients across industries, providing end-to-end technology services, product engineering, and IT consulting — backed by modern cloud, integration, and scalable architecture practices.

Job Description:

Looking for an experienced Assistant Manager – Data Engineering with strong expertise in enterprise data platforms, cloud technologies, and modern data engineering practices.

• Strong experience in designing and implementing scalable data architectures across cloud and hybrid environments.
• Expertise in building and optimizing ETL/ELT pipelines for large-scale and high-velocity data processing.
• Hands-on experience with Python, SQL, Spark, Kafka, and Airflow.
• Experience working with Snowflake, Databricks, and Delta Lake platforms.
• Strong understanding of data modelling, governance, data lineage, and real-time data processing.
• Experience designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
• Collaborate with Data Science, BI, Product, and DevOps teams to deliver scalable and reliable data solutions.
• Lead technical discussions, mentor engineering teams, and ensure adherence to coding and architectural best practices.
• Implement DataOps, CI/CD pipelines, monitoring, and cloud security best practices.
• Support analytics, AI/ML, and reporting workloads with scalable and optimized data systems.
• Troubleshoot performance bottlenecks, optimize workflows, and ensure platform reliability and scalability.

Mandatory Skills:

Python, SQL, Spark, Kafka, Airflow, Snowflake, Databricks, Delta Lake, Cloud Platforms (Azure/AWS/GCP) ETL/ELT Pipelines, Data Modelling, REST API Development, Leadership, Agile Practices.

Good to Have Skills:

C#, .NET Core, Azure PaaS, Azure Integration Services (IPaaS), EF Core, Blazor UI, Design Patterns, Cloud Security Best Practices.