{"id":805,"date":"2024-04-13T17:08:13","date_gmt":"2024-04-13T17:08:13","guid":{"rendered":"http:\/\/morganredfield.com\/blog\/?p=805"},"modified":"2026-02-27T17:20:01","modified_gmt":"2026-02-27T17:20:01","slug":"learning-from-an-llm","status":"publish","type":"post","link":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/","title":{"rendered":"Learning from an LLM"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\" alt=\"\" class=\"wp-image-806\" srcset=\"https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer.png 1024w, https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-300x300.png 300w, https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-150x150.png 150w, https:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-768x768.png 768w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">After a lot of flailing, I&#8217;ve finally found a method of learning from ChatGPT (or other LLMs) that&#8217;s helpful for complex subjects.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the past few years, I&#8217;ve gotten a lot of use from LLMs for small bounded problems. It&#8217;s been great if I have a compiler error, or need to know some factoid about sharks, or just want to check an email for social niceties before I send it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Where I&#8217;ve struggled is in using it to learn something complicated. Not just a piece of syntax or a fact, but a whole discipline. For a while, my test of a new LLM was to try to learn about beta-voltaic batteries from it. This was interesting, and I did learn a bit. The problem was that I felt adrift and didn&#8217;t know how to go past a few responses to dig into what really mattered in the physics of the topic. It worked as a test of the LLM, but not for learning the topic.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Today I tried having ChatGPT teach me about SLAM, and it worked surprisingly well. The main difference was that I went in with an outline of what I wanted to learn. Specifically, I used <a href=\"https:\/\/www.cv-learn.com\/20231128-slam-interview-questions-100-eng\/\">this list of 100 interview questions<\/a>. This gave me a sense of progress &#8211; I knew I was learning something relevant to my topic. It also gave me a sense of what done looked like &#8211; it was very obvious that I still had 46 questions to go, so I hadn&#8217;t explored everything yet.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">My overall method was:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>go question by question<\/li>\n\n\n\n<li>Try to answer on my own<\/li>\n\n\n\n<li>pose the question to ChatGPT<\/li>\n\n\n\n<li>explore ChatGPT&#8217;s answer until I understood it fully&nbsp;<\/li>\n\n\n\n<li>Add new info to anki&nbsp;so I&#8217;d remember it later<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">What makes this work?&nbsp;The external sense of progress and done-ness certainly helped. Another aspect of this is that it was like an externally guided <a href=\"https:\/\/thinkbetteracademy.com\/posts\/ultimate-guide-feynman-technique\/\">Feynman technique<\/a>. I was constantly asking myself questions and trying to answer them. Then I compared my answer to an immediate nigh-expert-level answer.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is better than books or papers (at least where the topic is already in the LLM), because I get an immediate answer without having to search through tens of pages. It&#8217;s maybe not better than talking to a real practicing expert, because a human expert might be better at prompting me with other questions or pointing out thorny issues that the LLM misses.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In fact, this whole process has made me realize how similar the Feynman technique is to a Socratic dialog. Probably the Socratic dialog is ideal, and the Feynman technique is what you fall back on when you don&#8217;t have access to a Socrates. My list of interview questions acted like a Socrates, priming the question pump for a ChatGPT fueled Feynman technique.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The obvious next question is how do I do this for a less structured topic? What if I don&#8217;t have a list of 100 questions to answer for a well studied and documented topic?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I have two ideas for this:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Come up with a project (a program, an essay) that demonstrates that I know something. Then ask myself and the LLM questions until I&#8217;m able to complete the project.<\/li>\n\n\n\n<li>Get more comfortable having a conversational back and forth with an LLM. Asking it questions and prompting it to be more Socratic with me.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">This reminds me a lot of my <a href=\"https:\/\/morganredfield.com\/blog\/2020\/07\/on-knowledge-bootstrapping-v0-1\/\">prior<\/a> <a href=\"https:\/\/morganredfield.com\/blog\/2020\/08\/knowledge-bootstrapping-experiment-2\/\">learning<\/a> experiments. They had definite goals: write a blog post explaining some topic. Doing this required me to actually go deep and understand things, which my beta-voltaic explanation test for LLMs really didn&#8217;t. These ideas also force more question decomposition, which was one of the major benefits of my prior experiments too.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In fact, maybe the main takeaway here is that learning from an LLM can be done just by slotting the LLM into the &#8220;reading&#8221; step of the <a href=\"https:\/\/acesounderglass.com\/the-knowledge-bootstrapping-project\/\">Knowledge Bootstrapping method<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>After a lot of flailing, I&#8217;ve finally found a method of learning from ChatGPT (or other LLMs) that&#8217;s helpful for complex subjects. In the past few years, I&#8217;ve gotten a lot of use from LLMs for small bounded problems. It&#8217;s been great if I have a compiler error, or need to know some factoid about &hellip; <a href=\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Learning from an LLM&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-805","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Learning from an LLM - Theory and Practice<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Learning from an LLM - Theory and Practice\" \/>\n<meta property=\"og:description\" content=\"After a lot of flailing, I&#8217;ve finally found a method of learning from ChatGPT (or other LLMs) that&#8217;s helpful for complex subjects. In the past few years, I&#8217;ve gotten a lot of use from LLMs for small bounded problems. It&#8217;s been great if I have a compiler error, or need to know some factoid about &hellip; Continue reading &quot;Learning from an LLM&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\" \/>\n<meta property=\"og:site_name\" content=\"Theory and Practice\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-13T17:08:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-02-27T17:20:01+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\" \/>\n<meta name=\"author\" content=\"morgan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"morgan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\"},\"author\":{\"name\":\"morgan\",\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd\"},\"headline\":\"Learning from an LLM\",\"datePublished\":\"2024-04-13T17:08:13+00:00\",\"dateModified\":\"2026-02-27T17:20:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\"},\"wordCount\":665,\"publisher\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd\"},\"image\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\",\"url\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\",\"name\":\"Learning from an LLM - Theory and Practice\",\"isPartOf\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\",\"datePublished\":\"2024-04-13T17:08:13+00:00\",\"dateModified\":\"2026-02-27T17:20:01+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage\",\"url\":\"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\",\"contentUrl\":\"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/morganredfield.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Learning from an LLM\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/morganredfield.com\/blog\/#website\",\"url\":\"https:\/\/morganredfield.com\/blog\/\",\"name\":\"Theory and Practice\",\"description\":\"Exploring life through science and art.\",\"publisher\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/morganredfield.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd\",\"name\":\"morgan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0da7fa0a0a07a8497d51de4300111d978b649e254fc1afa26dc67f3b83d24c38?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0da7fa0a0a07a8497d51de4300111d978b649e254fc1afa26dc67f3b83d24c38?s=96&d=mm&r=g\",\"caption\":\"morgan\"},\"logo\":{\"@id\":\"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/image\/\"},\"url\":\"https:\/\/morganredfield.com\/blog\/author\/morgan\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Learning from an LLM - Theory and Practice","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/","og_locale":"en_US","og_type":"article","og_title":"Learning from an LLM - Theory and Practice","og_description":"After a lot of flailing, I&#8217;ve finally found a method of learning from ChatGPT (or other LLMs) that&#8217;s helpful for complex subjects. In the past few years, I&#8217;ve gotten a lot of use from LLMs for small bounded problems. It&#8217;s been great if I have a compiler error, or need to know some factoid about &hellip; Continue reading \"Learning from an LLM\"","og_url":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/","og_site_name":"Theory and Practice","article_published_time":"2024-04-13T17:08:13+00:00","article_modified_time":"2026-02-27T17:20:01+00:00","og_image":[{"url":"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png","type":"","width":"","height":""}],"author":"morgan","twitter_card":"summary_large_image","twitter_misc":{"Written by":"morgan","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#article","isPartOf":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/"},"author":{"name":"morgan","@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd"},"headline":"Learning from an LLM","datePublished":"2024-04-13T17:08:13+00:00","dateModified":"2026-02-27T17:20:01+00:00","mainEntityOfPage":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/"},"wordCount":665,"publisher":{"@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd"},"image":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage"},"thumbnailUrl":"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/","url":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/","name":"Learning from an LLM - Theory and Practice","isPartOf":{"@id":"https:\/\/morganredfield.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage"},"image":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage"},"thumbnailUrl":"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png","datePublished":"2024-04-13T17:08:13+00:00","dateModified":"2026-02-27T17:20:01+00:00","breadcrumb":{"@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#primaryimage","url":"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png","contentUrl":"http:\/\/morganredfield.com\/blog\/wp-content\/uploads\/2024\/04\/Designer-1024x1024.png"},{"@type":"BreadcrumbList","@id":"https:\/\/morganredfield.com\/blog\/2024\/04\/learning-from-an-llm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/morganredfield.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Learning from an LLM"}]},{"@type":"WebSite","@id":"https:\/\/morganredfield.com\/blog\/#website","url":"https:\/\/morganredfield.com\/blog\/","name":"Theory and Practice","description":"Exploring life through science and art.","publisher":{"@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/morganredfield.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/15fce334735dd60ce7bb5712c44a62dd","name":"morgan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0da7fa0a0a07a8497d51de4300111d978b649e254fc1afa26dc67f3b83d24c38?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0da7fa0a0a07a8497d51de4300111d978b649e254fc1afa26dc67f3b83d24c38?s=96&d=mm&r=g","caption":"morgan"},"logo":{"@id":"https:\/\/morganredfield.com\/blog\/#\/schema\/person\/image\/"},"url":"https:\/\/morganredfield.com\/blog\/author\/morgan\/"}]}},"_links":{"self":[{"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/posts\/805","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/comments?post=805"}],"version-history":[{"count":2,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/posts\/805\/revisions"}],"predecessor-version":[{"id":808,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/posts\/805\/revisions\/808"}],"wp:attachment":[{"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/media?parent=805"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/categories?post=805"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/morganredfield.com\/blog\/wp-json\/wp\/v2\/tags?post=805"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}