I always collect gold, lockpicks, keys and arrows/bolts, no matter how little damage they do and how many I already have (just in case). It doesn't hurt to collect items that don't weight anything, you never know when you'll need them.
Weapons, robes and armor: Early in the game, when I'm...