North Korea threatened to cancel the summit with the US