Actually, "not being used" is the wrong way to put it, because VRAM works as a buffer, not storage that needs to be 100% full. Your card simply allocates exactly as much memory as the current scene requires, and that's completely normal - extra VRAM doesn't give you anything.
If you want to verify everything's legit, use FCAT or switch between games with different demands: you'll notice that in more demanding titles the memory usage goes up. Drivers have nothing to do with it - the graphics card itself manages memory allocation depending on the load.