A question about flying insects

So I currently have a colony of red wasps inside my heater well the igniter is out and I’m trying to replace it but having a difficult time combating the wasps. Is there any way I can kill them without damaging components of the heater? I don’t wanna just spray like crazy inside.