Former Harvard president Larry Summers says a ban on foreign students would cause damage not just to the university but to the US’s image globally.