From rank 20, I can challenge rank 14... if I refresh dozens, sometimes hundreds, of times until that option finally shows up.
Can the "matches" screen simply show the top 3 opponents you are eligible to challenge each time you open it? If you want to semi-randomly refresh from that for lower-ranked opponents, fine, but I would guess for the vast majority of players those are the opponents they are aiming for, and refreshing over and over again to hit them is just an annoyance...
0