You mean as the primary weapon? I've done that, but you need at least a Soul trap weapon, or to be good with the spell, because they burn through gems with a quickness. Great way to get your enchantment up in the early levels before you can make anything useful without grinding. Especially with the Staff of Jyric Gauldurson, which you can discharge rapidly, with enough hit-scan damage to take down Dragons with relative ease. I paired this (and other useful Staves, like DPs' and Magnus') with Spellbreaker, because it's Ward effect doesn't require Magicka, and it can block/bash for good defense against melee, and arrows as well as Magic. No investment in Magicka is just gravy.
Also, Scrolls (which are a lot more common) especially J'zargo's Experimental Flame Cloaks. I highly recomend The Black Star to keep them topped off. I used Bound Sword with Soul Stealer at first, then a Skyforge Steel Handaxe of Firey Souls, and Absorb Health from disenchanting the Drainheart Axe once I started DiY, and perked up Hack&Slash for a Staff/Blade combo. Not a gamebreaker Build (in Monk's robes with regular brown Boots, and Gloves to match.) I put it all in Health, with Stamina/regen enchantments for bashing, and sprinting.