Oh no,you cannot stress out sweet Jasper
I would do what you're doing,keeping the temporary kitties seperated in a room,but I know just the fact they are in the house can set off your own cat and she will go for the closest victim.
I had a stray once downstairs,but his meowing drove Rocky bonkers..