This isn't to pick a fight...but what if God didn't take away the thing in your life? What if it just happened, or it's an evil influence? That is certainly borne out in my own life. If we have free will then God can't be fully in charge of the world. If God isn't fully in charge of the world then He doesn't cause everything. Thus a place for free will. Good or bad.