To Tree or Not to Tree, That is the Question.