GPT-2’s writing is grammatically correct. It all more or less sounds true to its source, if all you heard was the tone. But what those sequences mean, therein lies the rub. GPT-2’s poetry prizes style over substance. Which is understandable, because it doesn’t know what substance is. – LitHub