I've had the same problem, but I recently joined the Stormcloaks. My overall outlook on the situation shows that both have their positives and negatives. At first, I was think to join the Imperials because looking at the extreme revolt at first seemed idiotic, especially with the current situation an order and strong, striving government was needed. The other part I liked about the Imperials was after meeting Elisif (Jarl and future Empress in Solitude), she seemed like she understood the negatives that were seen by those who supported the Stormcloaks and was a very orderly and respectful person.
I ended up siding with the Stormcloaks for a few main reasons. The Imperials seemed to be collapsing already, they have surrendered to the elves (I forget the name of that army) and agreed to remove Talos, a god that was the most famous of Dragonborns. Yes, I can understand some of the terms that would be dealt, but also not having much knowledge of the previous war, I don't see a reason to why the Imperials would have to surrender or give up the name? The failure in that war makes me think that the Imperials are already starting to dissolve. The corruption that's present in the game is well shown as well. I've had a few times where Imperials will demand money from me as I walk down the road, like bandits, and although all government gains corruption to have the soldiers be disobedient enough to force money from people is a huge problem. Lastly, and most important to myself, when I look at the movement of the Stormcloaks and who they are, I see the American Revolution. Yes, our country would have been stable and have more support if we did not rebel against the British Empire, but we wanted our society to have the rights in which we believed to the core, and to have our country guided by a government that was not even apart of our nation seemed useless. The Stormcloaks represent this well. Yes they're a bit racist, though they will accept others after they trust them, and the Stormcloaks bringing order back to Skyrim will be a difficult one, but I side with them because they know that the way their nation is being abused by the Imperials is not the way they wish to live, the Jarls are tyrants with too much power and the Stormcloaks are there to finally bring some equality to the people's needs and wants in their society.
The True question I have, is what will come after this? In the end other nations around Skyrim will see this, and just like the American Revolution will other nations realize that if another nation can do it, so can we?