Once you feel some give while pressing down on the wheel with your thumb, turn it over to ensure that the wheel has fully separated from the housing.

Be very careful with the spring while removing the wheel. If it is bent out of the original shape it will not prevent the mouse wheel from spinning freely when reassembled.