Some rubber cases are pretty much dust magnets so beware of those. Other than that, I'd generally still stick with rubber over plastic mainly because I feel that it absorbs shock/ fall damage a lot better than plastic. With plastic, feels more like crack on impulse. I have an Otterbox Defender and I dropped my phone while holding the door for someone and well, phone was still functioning so glad Otterbox worked. However, i haven't tried any other brands.
I did read about other phone case makers using fancy names like silicone, TPU, and what not. No clue what they are, but would be interesting to see an actual in-depth review of that.