There is not any way to remove a quest in PC, not even in other consoles. The only thing you can do it is to disable the quest, Press "J" in your keyboard and active and disable quests.
You must note that by playing all the quests you can enjoy much, none should neglect any quest. All of them is equally important. And if you neglect quest, you will surely fall off from benefits like joining the Companion, Dark Brotherhood, Imperial Legion, Gaining special ability etc.
I have a problem with this 'solution'. Many quests are diametrically opposed to one another on many levels (e.g., morally, logical consistency). I suppose it just depends on the nature of the player, of course, but it's true that the character need not be the most 'pious' of individuals, considering the vast amounts of thievery, murder, etc., condoned or speciously justified, so maybe one
should attempt every quest (if they're feeling
truly adventurous), since the game is absurdly inconsistent regarding 'direction'. However, I would easily admit that not every quest is
worth doing. If it's a first play-through, perhaps an all out quest fest is the way to go. Just remember to throw caution, morals, logical consistency and, well, any sort of direction out through the window. It is only a game after all, right?