Databricks Data Engineer / Developer (PL 866)

Location: Remote within Canada

Client: Consulting Client
Contract Duration: 6 months contract
MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Overview

Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities.

The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture. This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment.

Key Responsibilities

  • Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP).

  • Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements.

  • Make use of an Agentic approach to development and ensure that output matches development standards.

  • Develop scalable and reusable data solutions using Databricks and cloud-based data technologies.

  • Support migration and modernization activities from HANA environments to a modern data platform.

  • Collaborate with Data Architects to implement scalable data models and platform solutions.

  • Develop data transformation logic and workflows to support business and analytics requirements.

  • Ensure data quality, integrity, consistency, and performance across platform solutions.

  • Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns.

  • Participate in code reviews, testing, deployment, and release activities.

  • Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions.

  • Contribute to platform best practices, documentation, and continuous improvement initiatives.

Requirements

MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Required Qualifications

  • 3+ years of hands-on Databricks development experience.

  • 4+ years of overall Data Engineering, ETL, or Data Integration experience.

  • Strong experience building ETL/ELT data pipelines and transformation processes.

  • Proven experience working with large and complex datasets.

  • Experience with Agentic frameworks and AI-assisted coding is a value add.

  • Experience developing data solutions within cloud-based platforms.

  • Solid understanding of data warehousing, data lake, and lakehouse concepts.

  • Experience working in Agile delivery environments.

  • Strong problem-solving and analytical skills.

  • Excellent communication and collaboration abilities.

Preferred Qualifications

  • Experience supporting large data platform initiatives.

  • Experience in significant data migration efforts.

  • Experience with Azure Data Services and Databricks Lakehouse architecture.

  • Experience with modern data engineering frameworks and best practices.

  • Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives.

  • Experience working in large enterprise or consulting environments.

  • Knowledge of data governance, metadata management, and data quality frameworks.


Technical Knowledge

Required

  • Databricks

  • ETL / ELT Development

  • Data Engineering

  • Data Integration

  • SQL

  • Python

  • Data Pipeline Development

  • Data Transformation

  • Data Warehousing Concepts

  • Agile Delivery

Preferred

  • Azure Data Factory

  • Delta Lake

  • Spark / PySpark

  • Azure Synapse

  • Data Lake Architecture

  • Cloud Data Platforms

  • Data Governance & Data Quality

  • CI/CD for Data Solutions


Key Skills & Experience

  • Databricks Development

  • Data Engineering

  • ETL/ELT Design & Development

  • Enterprise Data Platforms

  • Data Modernization

  • Data Migration

  • Data Warehousing

  • Cloud Data Platforms

  • SQL & Python Development

  • Data Quality & Validation

  • Agile Delivery

  • Stakeholder Collaboration


Ideal Candidate Profile

We are seeking a developer who:

Has hands-on Databricks experience and can contribute immediately

Understands enterprise data concepts and platform modernization initiatives

Has strong ETL/ELT and data engineering experience

Can partner effectively with architects, project managers, and business teams

Is comfortable working in a fast-paced, highly visible enterprise transformation program

Can help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities

Back to blog

Other Jobs To Apply

No other job posts for this day.

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...