AliAbdulKareem said:
What I don't get about it, is why does it only happen on diagonal edges or so it seems?

If the edge is aligned to the grid axis, either X or Y remain constant. So if we sample along the edge we stay always at the same ‘error’. We're still on a hyperbola as you've figured out, but…