On my supergun, I used a 25 pin D cable, so I only had space for 2 grounds, one for each player, since I also needed start for each player and a coin button. No problems what so ever, ground is ground.

Sounds like you have the 4 player harness. The kick harness only has like 7 wires.