Walker will stay in office