I couldn't get the other bosses to leave, I wasn't sure if it was that you couldn't shoot them or not destroy them. One boss I dodged for like 8 full mins and he didn't leave. I just gave up and blasted him. The first boss does show up before the last one and I did it there and it still worked. I'll mess around with it some more and see if I can do it on the other bosses.