BCG Platinion | Senior IT Architect - AI Platforms

About the position

BCG Platinion is seeking a Senior IT Architect specializing in AI Platforms to join their team. This role focuses on designing and implementing intelligent, agentic AI platforms, integrating large language models (LLMs), data pipelines, and enterprise systems. The ideal candidate will have a strong foundation in software engineering and AI development, with hands-on experience in building and extending AI components. This position offers an opportunity to grow architectural skills while working collaboratively in an agile environment, contributing to innovative digital solutions for clients.

Responsibilities

  • Contribute to the design of AI and LLM-based system architectures with guidance from senior architects.
  • Implement agentic AI components that support intelligent workflow automation and task execution.
  • Build and extend RAG-based solutions for context retrieval, prompt workflows, and system integration.
  • Follow established architectural standards and contribute feedback to improve design patterns and practices.
  • Support implementation of batch and real-time inference pipelines with attention to performance and reliability.
  • Develop prototypes and technical proofs-of-concept to validate AI platform components and workflows.
  • Implement solutions using modern AI frameworks and libraries under architectural guidance.
  • Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.
  • Support implementation and deployment of AI platform components into development and production environments.
  • Assist with monitoring, troubleshooting, and improving system performance and reliability.
  • Follow defined standards for versioning, testing, and monitoring of AI services and models.
  • Communicate technical concepts clearly within the project team and with immediate stakeholders.
  • Support preparation of technical documentation and presentations.
  • Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
  • Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
  • Seek and incorporate feedback from senior team members to improve technical output.
  • Support junior team members through knowledge sharing and day-to-day collaboration.
  • Contribute positively to team culture and ways of working.
  • Seek feedback on work quality and incorporate guidance from senior architects.
  • Demonstrate professionalism and alignment with BCG’s culture and values.
  • Stay current on emerging concepts in agentic AI, RAG, and AI platform tooling.
  • Experiment with new tools and techniques under guidance to expand technical skill sets.
  • Build depth in AI platform engineering through hands-on delivery experience.
  • Actively pursue learning opportunities to grow toward broader architectural responsibilities.
  • Contribute technical input to proposals or internal initiatives when needed.

Requirements

  • Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
  • 4+ years of experience in software engineering, data engineering, or AI development.
  • Solid foundation in software development and distributed systems concepts.
  • Hands-on experience building or integrating AI/ML or LLM-based components.
  • Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
  • Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
  • Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
  • Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
  • Exposure to deploying AI workloads on cloud platforms.
  • Experience integrating AI components with APIs and data sources.
  • Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
  • Strong problem-solving skills and attention to code quality.
  • Ability to explain technical concepts clearly within a project team.
  • Willingness to learn and grow in fast-paced, ambiguous environments.
  • Agile mindset with a focus on iterative delivery and continuous improvement.
  • Willingness to travel to work with clients and BCG teams as needed.
  • Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Nice-to-haves

  • Proficiency in one or more programming language such as Python or JavaScript is nice to have.

Benefits

  • An opportunity to work organically across disciplines and across BCG, offering a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
  • A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
  • First year base compensation for this role is \$160,000 CAD.
  • Eligible for an annual discretionary performance bonus.
  • Retirement contribution.
  • Market leading benefits package.
  • Zero dollar (\$0) health insurance premiums for BCG employees, spouses, and children.
  • 100% coverage for prescription drugs, with no dispensing fee maximum.
  • Access to Telemedicine – virtual care when you need it.
  • Substantial mental health support, including mental health practitioner coverage and access to meditation and well-being apps.
  • Dental coverage, including orthodontia benefits for children and adults.
  • Robust vision coverage.
  • Flexible Spending Account for additional medical and wellbeing activities.
  • Retirement contributions made annually (whether you contribute or not), plus the option for employees to make personal contributions to an RRSP Plan.
  • Premier Family programs including, paid parental and family care leaves, and reimbursement for fertility, surrogacy, and adoption expenses.
  • Generous paid time off, including 10 public holidays and 2 floater days, office closure between Christmas and New Year’s, and 15 vacation days (earned at 1.25 days per month) annually.
  • Paid sick time on an as needed basis.
Back to blog

Other Jobs To Apply

No other job posts for this day.

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...