What not to Learn