White House officials tamped down efforts to oust Max Miller in final days