If we're going by fate lore, the ones with higher affinity should be easier to summon.
But I think maybe part of this is that Chaldea System is just different from Fate system when it comes to summoning.
On another note, do they have an explanation for why you can summon more of the same servant for NP upgrades?