The New Yorker wrote a nice article on LLMs and how they work, "What Kind of Mind Does ChatGPT Have?"