Senior Data Engineer

**Data Engineer – AI/BI--100% Remote--should able to work in USA EST time zone**

Overview:

We are seeking a Data Intelligence Engineer to design, build, and operate a Databricks based Data & AI capabilities with a strong foundation in the Medallion Architecture (raw/bronze, curated/silver, and mart/gold layers). This platform will orchestrate complex data workflows and scalable ELT pipelines to integrate data from enterprise systems such as PeopleSoft, D2L, and Salesforce, delivering high-quality, governed data for machine learning, AI/BI, and analytics at scale.

You will play a critical role in engineering the infrastructure and workflows that enable seamless data flow across the enterprise, power Databricks AI/BI dashboards and Genie experiences, and serve as the backbone for strategic decision-making, predictive modeling, and innovation.

Required Qualifications:

• Hands-on experience with Databricks (Delta Lake, Apache Spark) and building AI/BI solutions, including dashboards, semantic models, and Genie based natural language analytics.
• Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments.
• Experience implementing Medallion Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments.
• Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic.
• Proven experience integrating enterprise platforms (e.g., PeopleSoft, Salesforce, D2L) into centralized data platforms.
• Familiarity with data governance, lineage tracking, and metadata management tools.

Preferred Qualifications:

• Experience with Databricks Unity Catalog for metadata management and access control.
• Experience deploying ML models at scale using MLFlow or similar MLOps tools.
• Familiarity with cloud platforms like Azure or AWS, including storage, security, and networking aspects.
• Knowledge of data warehouse design and star/snowflake schema modeling.