Edge case in programming means rare cases where the program gives incorrect output. Like a program that gives the correct output for most inputs, but wrong output for a few rare types of inputs.

In the case of LLMs, I would define an edge case as types of things that LLMs are especially prone to get wrong, or types of nuances that they tend to miss, even if they tend to get most things broadly correct...