Alright, the chain reorg argument is much stronger than I thought. It's important for transactions to remain valid once they were valid, otherwise dependent transactions possibly created by other people (who are not aware of the limitation) might get removed retroactively. Furthermore, being able to do chain reorgs without huge complications helps Bitcoin's resilience against network splits, censoring attempts, etc.