Smallmouth is basically a northern bass variety. Getting over 20 inches is hard to come by. Also as they get older, they probably get more and more difficult to catch. I assume that maybe they feed less.
I can't explain the rainbows, but I've fished in a stream where the brook trout had the extended crooked mouth going all summer long. I'm not familiar with their spawning season.