The word referee comes from the Latin word referre which means to "earn from performing" or in modern terms "paid actor"
Originally in the Roman republic the senate would "refer" to them as experts, but they were bribed to make the case of the senate in order to pass laws favorable to the ruling class.
Today the tradition continues, however, the payment is now facilitated by bookies.