The dynamic graph of LN probes and gossip data has many temporal dependencies. I.e. past actions affect the topology of the graph. It is challenging to account for these temporal patterns in the problem statement of the RL agent.