Cowell’s team do not accept the criticisms directed at him.