Skip to content
remoty.work
For employers
Menu

Senior GPU Infrastructure Engineer, Deployment

PolargridCanada

Developer Operations Senior Full Time

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.

The role

You will own how new GPU servers become ready for customers: from racks at a datacenter to tested, production-ready nodes. You will define when a node is ready, build the automation that gets it there, and keep the fleet healthy once it is running.

This is a hands-on senior role on a small team. You will work with datacenter partners and their on-site staff, and closely with the engineers who own routing and the network.

The work

We bring up large GPU servers at datacenters we don't own. Each node has to be provisioned, tested hard and proven healthy before customers use it. Between customers it has to be wiped clean. Once in service, failing hardware has to be caught early and taken out of rotation. The hard part is doing this the same way, every time, across many sites, with a small team.

What you bring

  • You have brought up multi-GPU servers or clusters for production workloads, including acceptance testing and burn-in.

  • Experience with high-speed GPU networking such as InfiniBand or RoCE.

  • You have automated bare-metal provisioning and kept firmware and images consistent across a fleet.

  • You can diagnose GPU and server hardware faults and decide when to repair or replace.

  • You have run GPUs inside virtual machines or otherwise isolated customers on shared hardware.

  • You have worked with remote datacenter staff and been on call for a fleet.

  • You write scripts and tools in a language such as Python, Go or Bash.

  • You use AI tools well and check their work.

You do not need ML model experience. What matters is that you have put real GPU hardware into service for other people's workloads and kept it running.

Originally posted on Himalayas

Apply for this role Opens himalayas.app — the link as listed; we have not yet verified it is the employer's own page

Keep looking

Similar remote roles, still open

See every "GPU Infrastructure Engineer" role →

Or follow the daily Telegram channel for the best new remote roles every morning.

Your turn · no account needed

Help the next applicant

You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.

I know what it pays

What you were offered, quoted in an interview, or paid in this role. A range is fine.

Sign in with Google to earn points for reports.

Where this listing came from

  1. 17 Nov 2026Himalayas first sighting

Seen on 1 board over 0 days.