The lightning payments come from the lightning node of the server. After each round the vtxo comes from the server, what prevents double spending? The server has the forfeits.

There is also the delegated signing and the out of round possible collusion.