I always assumed it was durability but my .9999 maples feel just as durable as the junk silver.
Try rubbing them with your thumb and you'll find out the hard way that .9999 silver is not very durable at all. It will scratch a lot easier than 90% silver coinage will.