I ran into the same thing as our organization grew. What helped was keeping the number of roles as small as possible and assigning permissions through broader group roles instead of creating lots of specialized ones. It also makes reviewing access much easier over time.