Obviously the phone hasnt been out long, so its hard to say for sure... but from my current time spent with the black version, I can say quality of the matte is very high. Im pretty picky about finger prints so i wipe my phone with my t-shirt, dress shirt, or antibacterial wipes several times throughout the day. I see zero signs of any type of wear. Also, another area of the matte housing which gives me real confidence in its quality is by the micro usb hole. At night I plug in my charger sometimes carelessly since there's no light, the first couple times I was worried i left marks on it so i would check the next morning, but it still looks new. Now i dont even worry. I've only dropped it once, nothing major, but i dropped it in my car between the seat and center console, and it got caught in between the metal rail and carpeting. I couldnt pull it out so i had no choice but to slide it all the way to one edge of the rail (LOL) to grab it from the back. But still to this day my N5 looks like new out the boc.
I can confidently say that the matte will probably hardly wear under good care/hands, especially when most people dont keep there phones for more than a year or 2 these days. If it were used for 5+ years, or not taken care of well, it would be a different story.