Anglo American rejected on Monday a proposal to merge from the British-Swiss mining company Xstrata, calling a combination “unattractive” and Xstrata’s terms “totally unacceptable.”