{"id":877,"date":"2026-01-13T08:44:08","date_gmt":"2026-01-13T00:44:08","guid":{"rendered":"https:\/\/qi122.qodeinteractive.com\/?p=877"},"modified":"2026-06-16T23:08:43","modified_gmt":"2026-06-16T15:08:43","slug":"ai-entropy-reduction-engineering","status":"publish","type":"post","link":"https:\/\/ragsitemap.com\/en\/blog\/ai-%e7%86%b5%e6%b8%9b%e5%b7%a5%e7%a8%8b\/","title":{"rendered":"AI Entropy-Reduction"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"877\" class=\"elementor elementor-877\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2fd9148 e-con-full e-flex qodef-elementor-content-no e-con e-parent\" data-id=\"2fd9148\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-1701352 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"1701352\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-9863c76 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"9863c76\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2fbd938 elementor-widget elementor-widget-heading\" data-id=\"2fbd938\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">\u70ba\u4ec0\u9ebc LLM \u53ef\u88ab\u8996\u70ba\u300c\u71b5\u300d<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ca8a9ee elementor-widget elementor-widget-text-editor\" data-id=\"ca8a9ee\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<p>\u5f9e\u8cc7\u8a0a\u8ad6\u89d2\u5ea6\uff0c\u71b5\u8861\u91cf\u7684\u662f\u300c\u4e0d\u78ba\u5b9a\u6027\u300d\u8207\u300c\u6df7\u4e82\u7a0b\u5ea6\u300d\u3002\u81ea\u7136\u8a9e\u8a00\u672c\u8eab\u5c31\u662f\u9ad8\u71b5\u8a0a\u865f\uff0c\u540c\u4e00\u500b\u554f\u984c\u53ef\u4ee5\u6709\u4e00\u767e\u7a2e\u5408\u7406\u4f46\u54c1\u8cea\u53c3\u5dee\u7684\u56de\u7b54\u3002LLM \u4f5c\u70ba\u57fa\u65bc\u6a5f\u7387\u5206\u5e03\u751f\u6210 token \u7684\u6a21\u578b\uff0c\u5176\u8f38\u51fa\u7a7a\u9593\u6975\u5927\uff0c\u672a\u7d93\u7d04\u675f\u6642\u672c\u8cea\u4e0a\u8655\u65bc\u9ad8\u71b5\u614b\uff0c\u5bb9\u6613\u7522\u751f\u5e7b\u89ba\u6216\u7121\u95dc\u5167\u5bb9\u3002<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6e9ec85 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"6e9ec85\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-8c8cab1 elementor-widget elementor-widget-heading\" data-id=\"8c8cab1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">\u4f7f\u7528\u65b9\u6cd5\u70ba\u4f55\u5c31\u662f\u300c\u71b5\u6e1b\u300d<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5b153c7 elementor-widget elementor-widget-text-editor\" data-id=\"5b153c7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7a963fd elementor-widget elementor-widget-text-editor\" data-id=\"7a963fd\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\"><div class=\"elementor-widget-container\"><p>\u71b5\u589e\u5b9a\u5f8b\u6307\u51fa\uff0c\u5728\u5c01\u9589\u6216\u662f\u5b64\u7acb\u7684\u7cfb\u7d71\u4e2d\uff0c\u6df7\u4e82\u81ea\u7136\u589e\u52a0\uff08\u5373\u71b5\u589e\uff09\uff1b\u82e5\u8981\u9006\u8f49\u6df7\u4e82\uff0c\u6062\u5fa9\u6709\u5e8f\uff0c\u5fc5\u9808\u5f9e\u5916\u90e8\u8f38\u5165\u8cc7\u8a0a\u8207\u7d50\u69cb\u3002\u800c\u4f60\u5c0d LLM \u505a\u7684\u6bcf\u4e00\u4ef6\u4e8b\uff0c\u5e7e\u4e4e\u90fd\u662f\u5728\u505a\u9019\u7a2e\u300c\u5916\u90e8\u505a\u529f\u300d\uff1a<\/p><\/div><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b953525 elementor-widget elementor-widget-text-editor\" data-id=\"b953525\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<ul><li>\u63d0\u793a\u5de5\u7a0b \/ \u4e0a\u4e0b\u6587\u5de5\u7a0b<ul><li>\u900f\u904e\u7cbe\u78ba\u63cf\u8ff0\u3001\u89d2\u8272\u8a2d\u5b9a\u8207\u7bc4\u4f8b\uff0c\u7e2e\u5c0f\u6a21\u578b\u53ef\u8f38\u51fa\u7684\u5408\u7406\u7bc4\u570d\uff0c\u4e5f\u5c31\u662f\u5728\u964d\u4f4e\u689d\u4ef6\u71b5\u3002<\/li><\/ul><\/li><\/ul><ul><li>RAG \u8207\u77e5\u8b58\u5eab\u6aa2\u7d22<ul><li>\u4e0d\u8b93\u6a21\u578b\u53ea\u9760\u5167\u90e8\u9ad8\u6b0a\u91cd\u7684\u6a21\u7cca\u8a18\u61b6\u56de\u7b54\uff0c\u800c\u662f\u5373\u6642\u6ce8\u5165\u7d93\u904e\u7be9\u9078\u7684\u5916\u90e8\u4f4e\u71b5\u4e8b\u5be6\uff0c\u76f4\u63a5\u58d3\u7e2e\u4e0d\u78ba\u5b9a\u6027\u3002<\/li><\/ul><\/li><\/ul><ul><li>\u7d50\u69cb\u5316\u8f38\u51fa\u8207\u683c\u5f0f\u7d04\u675f<ul><li>JSON \u6a21\u5f0f\u3001\u51fd\u6578\u547c\u53eb\u3001\u56b4\u683c\u6a21\u677f\uff0c\u90fd\u662f\u628a\u7121\u908a\u754c\u7684\u8a9e\u8a00\u7a7a\u9593\u58d3\u7e2e\u6210\u6709\u79e9\u5e8f\u7684\u4f4e\u71b5\u8f38\u51fa\u3002<\/li><\/ul><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1bbc91a elementor-widget elementor-widget-text-editor\" data-id=\"1bbc91a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7a963fd elementor-widget elementor-widget-text-editor\" data-id=\"7a963fd\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\"><div class=\"elementor-widget-container\"><p>\u63db\u53e5\u8a71\u8aaa\uff0cLLM \u7684\u300c\u8070\u660e\u300d\u5176\u5be6\u4f86\u81ea\u65bc\u5b83\u5167\u5316\u4e86\u4eba\u985e\u8a9e\u8a00\u7684\u9f90\u5927\u7d71\u8a08\u898f\u5f8b\uff1b\u4f46\u5b83\u300c\u4e0d\u6e96\u300d\u7684\u6642\u5019\uff0c\u6b63\u662f\u56e0\u70ba\u9019\u500b\u6a5f\u7387\u7a7a\u9593\u592a\u81ea\u7531\u3002\u4f60\u7684\u4f7f\u7528\u65b9\u6cd5\u7121\u8ad6\u662f\u5beb\u63d0\u793a\u8a5e\u3001\u505a RAG\u3001\u9084\u662f\u5efa\u7acb\u7d50\u69cb\u5316\u4e0a\u4e0b\u6587 \u2014 \u672c\u8cea\u4e0a\u90fd\u662f\u5728\u7528\u5916\u90e8\u8cc7\u8a0a\u8207\u898f\u5247\u4f86\u58d3\u7e2e\u71b5\u3002<\/p><\/div><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-8ab6e61 e-con-full e-flex qodef-elementor-content-no e-con e-parent\" data-id=\"8ab6e61\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-65e7427 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"65e7427\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-993ae97 elementor-widget elementor-widget-html\" data-id=\"993ae97\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t\t<style>\r\n\/* ====================== Scope \u5bb9\u5668 ====================== *\/\r\n.rag-entropy-scope {\r\n  \/* 3 \u4e3b\u8272 *\/\r\n  --rag-bg:     #eaeaea;\r\n  --rag-accent: #BE935D;\r\n  --rag-text:   #262019;\r\n\r\n  \/* \u884d\u751f\u8272\uff1aalpha on --rag-text *\/\r\n  --rag-ink-1: rgb(from var(--rag-text) r g b \/ 1);\r\n  --rag-ink-2: rgb(from var(--rag-text) r g b \/ 0.78);\r\n  --rag-ink-3: rgb(from var(--rag-text) r g b \/ 0.58);\r\n\r\n  \/* \u884d\u751f\u8272\uff1aalpha on --rag-accent *\/\r\n  --rag-acc-1:    var(--rag-accent);\r\n  --rag-acc-2:    rgb(from var(--rag-accent) r g b \/ 0.55);\r\n  --rag-acc-tint: rgb(from var(--rag-accent) r g b \/ 0.10);\r\n  --rag-acc-dots: rgb(from var(--rag-accent) r g b \/ 0.22);\r\n\r\n  \/* \u4e2d\u6027\u5fae\u8868\u9762 *\/\r\n  --rag-surface:  rgb(from var(--rag-text) r g b \/ 0.05);\r\n\r\n  font-family: \"Cormorant\", \"LXGW WenKai TC\", \"Nanum Myeongjo\", \"Noto Sans\", serif;\r\n  color: var(--rag-ink-1);\r\n  background: var(--rag-bg);\r\n  padding: 40px 26px;\r\n  max-width: 760px;\r\n  margin: 0 auto;\r\n  box-sizing: border-box;\r\n  line-height: 1.6;\r\n}\r\n\r\n.rag-entropy-scope *,\r\n.rag-entropy-scope *::before,\r\n.rag-entropy-scope *::after { box-sizing: border-box; }\r\n\r\n.rag-entropy-scope ::selection {\r\n  background: var(--rag-text);\r\n  color: var(--rag-bg);\r\n  fill: var(--rag-bg);\r\n}\r\n.rag-entropy-scope ::-moz-selection {\r\n  background: var(--rag-text);\r\n  color: var(--rag-bg);\r\n  fill: var(--rag-bg);\r\n}\r\n\r\n\/* ====================== \u6a19\u984c\u5340 ====================== *\/\r\n.rag-entropy-scope .rag-entropy-title {\r\n  font-size: 28px;\r\n  font-weight: 700;\r\n  color: var(--rag-ink-1);\r\n  margin: 0 0 8px;\r\n  line-height: 1.25;\r\n  letter-spacing: 0.5px;\r\n}\r\n\r\n.rag-entropy-scope .rag-entropy-subtitle {\r\n  font-size: 17px;\r\n  color: var(--rag-ink-3);\r\n  font-style: italic;\r\n  margin: 0 0 64px;\r\n  line-height: 1.5;\r\n}\r\n\r\n\/* ====================== SVG \u5340 (Flex Grid) ====================== *\/\r\n.rag-entropy-scope .rag-entropy-grid {\r\n  display: flex;\r\n  flex-direction: row;\r\n  gap: 12px;\r\n  align-items: stretch;\r\n  margin: 0 0 22px;\r\n}\r\n\r\n.rag-entropy-scope .rag-entropy-grid > svg {\r\n  flex: 1 1 0;\r\n  min-width: 0;\r\n}\r\n\r\n@media (max-width: 768px) {\r\n  .rag-entropy-scope .rag-entropy-grid {\r\n    flex-direction: column;\r\n    gap: 12px;\r\n  }\r\n}\r\n\r\n.rag-entropy-scope svg {\r\n  display: block;\r\n  width: 100%;\r\n  height: auto;\r\n  overflow: visible;\r\n}\r\n\r\n.rag-entropy-scope svg text {\r\n  opacity: 1 !important;\r\n  font-family: \"Cormorant\", \"LXGW WenKai TC\", \"Nanum Myeongjo\", \"Noto Sans\", serif;\r\n}\r\n\r\n\/* SVG hex \u2192 \u8b8a\u6578\u6620\u5c04 *\/\r\n.rag-entropy-scope svg [fill=\"#e6e4dc\"]  { fill: var(--rag-ink-1); }\r\n.rag-entropy-scope svg [fill=\"#c5c8c2\"]  { fill: var(--rag-ink-2); }\r\n.rag-entropy-scope svg [fill=\"#a8a6a0\"],\r\n.rag-entropy-scope svg [fill=\"#8a8d88\"]  { fill: var(--rag-ink-3); }\r\n.rag-entropy-scope svg [fill=\"#7dd87d\"]  { fill: var(--rag-acc-1); }\r\n.rag-entropy-scope svg [fill=\"#5a7d5e\"]  { fill: var(--rag-acc-2); }\r\n.rag-entropy-scope svg [fill=\"#0d1814\"]  { fill: var(--rag-acc-tint); }\r\n.rag-entropy-scope svg [fill=\"#1c2a1f\"]  { fill: var(--rag-acc-dots); }\r\n.rag-entropy-scope svg [fill=\"#0a1410\"]  { fill: var(--rag-surface); }\r\n\r\n.rag-entropy-scope svg [stroke=\"#c5c8c2\"] { stroke: var(--rag-ink-2); }\r\n.rag-entropy-scope svg [stroke=\"#a8a6a0\"] { stroke: var(--rag-ink-3); }\r\n.rag-entropy-scope svg [stroke=\"#7dd87d\"] { stroke: var(--rag-acc-1); }\r\n.rag-entropy-scope svg [stroke=\"#5a7d5e\"] { stroke: var(--rag-acc-2); }\r\n\r\n\/* SVG \u5b57\u7d1a\u5206\u6d41 - \u684c\u6a5f\u52a0\u5927 1px *\/\r\n.rag-entropy-scope svg text[font-size=\"16\"] {\r\n  font-size: 17px;\r\n  font-weight: 700;\r\n  letter-spacing: 0.5px;\r\n}\r\n.rag-entropy-scope svg text[font-size=\"13\"] {\r\n  font-size: 13px;\r\n  font-weight: 400;\r\n}\r\n.rag-entropy-scope svg text[font-size=\"12\"] {\r\n  font-size: 13px;\r\n  font-weight: 400;\r\n}\r\n.rag-entropy-scope svg text[font-size=\"10\"] {\r\n  font-size: 11px;\r\n  font-weight: 400;\r\n}\r\n\r\n\/* \u624b\u6a5f:SVG \u5b57\u7d1a\u56de\u5230\u539f\u59cb\u503c *\/\r\n@media (max-width: 768px) {\r\n  .rag-entropy-scope svg text[font-size=\"16\"] {\r\n    font-size: 16px;\r\n  }\r\n  .rag-entropy-scope svg text[font-size=\"12\"] {\r\n    font-size: 12px;\r\n  }\r\n  .rag-entropy-scope svg text[font-size=\"10\"] {\r\n    font-size: 10px;\r\n  }\r\n}\r\n\r\n\/* ====================== \u516c\u5f0f\u5340 ====================== *\/\r\n.rag-entropy-scope .rag-entropy-formula {\r\n  border-top: 1px solid var(--rag-ink-3);\r\n  border-bottom: 1px solid var(--rag-ink-3);\r\n  padding: 22px 0 24px;\r\n  margin: 8px 0 26px;\r\n  text-align: center;\r\n}\r\n\r\n.rag-entropy-scope .rag-entropy-formula-main {\r\n  font-size: 22px;\r\n  font-weight: 700;\r\n  color: var(--rag-ink-1);\r\n  margin-bottom: 8px;\r\n  letter-spacing: 1px;\r\n}\r\n\r\n.rag-entropy-scope .rag-entropy-formula-math {\r\n  font-size: 16px;\r\n  color: var(--rag-ink-3);\r\n  font-style: italic;\r\n  letter-spacing: 1.5px;\r\n  font-family: \"Cormorant\", serif;\r\n}\r\n\r\n\/* ====================== \u7d50\u5c3e\u6bb5 ====================== *\/\r\n.rag-entropy-scope .rag-entropy-footer {\r\n  font-size: 17px;\r\n  color: var(--rag-ink-2);\r\n  margin: 0;\r\n  line-height: 1.75;\r\n}\r\n\r\n.rag-entropy-scope .rag-entropy-footer-emphasis {\r\n  color: var(--rag-ink-1);\r\n  font-weight: 700;\r\n}\r\n\r\n\/* ====================== \u97ff\u61c9\u5f0f ====================== *\/\r\n@media (max-width: 1024px) {\r\n  .rag-entropy-scope { padding: 0; }\r\n}\r\n\r\n@media (max-width: 768px) {\r\n  .rag-entropy-scope .rag-entropy-title {\r\n    font-size: 22px;\r\n  }\r\n  .rag-entropy-scope .rag-entropy-subtitle,\r\n  .rag-entropy-scope .rag-entropy-footer {\r\n    font-size: 15px;\r\n  }\r\n  .rag-entropy-scope .rag-entropy-formula-main {\r\n    font-size: 17px;\r\n    letter-spacing: 0.5px;\r\n  }\r\n  .rag-entropy-scope .rag-entropy-formula-math {\r\n    font-size: 12px;\r\n  }\r\n}\r\n<\/style>\r\n<\/head>\r\n<body style=\"background:#eaeaea;margin:0\">\r\n\r\n<div class=\"rag-entropy-scope\">\r\n\r\n  <h2 class=\"rag-entropy-title\">\u8a0a\u606f\u589e\u76ca\u7684\u57fa\u790e\u662f\u71b5<\/h2>\r\n  <p class=\"rag-entropy-subtitle\">\u6df7\u4e82\u7a0b\u5ea6\u6e1b\u5c11(\u71b5\u6e1b)\u7684\u5e45\u5ea6\u8d8a\u5927,\u300c\u8a0a\u606f\u589e\u76ca\u5c31\u8d8a\u5927\u300d<\/p>\r\n\r\n  <div class=\"rag-entropy-grid\">\r\n\r\n    <!-- ============ \u5de6:\u8a0a\u606f\u71b5 H(X) ============ -->\r\n    <svg viewBox=\"0 0 240 320\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-labelledby=\"rag-entropy-left-title\">\r\n      <title id=\"rag-entropy-left-title\">Information entropy H(X): the LLM's original state<\/title>\r\n\r\n      <!-- \u6a19\u984c -->\r\n      <text x=\"120\" y=\"34\" font-size=\"16\" fill=\"#c5c8c2\" text-anchor=\"middle\">H(X) \u2500 Information Entropy<\/text>\r\n      <text x=\"120\" y=\"56\" font-size=\"12\" fill=\"#a8a6a0\" text-anchor=\"middle\">The LLM's original state<\/text>\r\n\r\n      <!-- \u4e0d\u898f\u5247\u5206\u5e03(path \u4e32\u8d77\u6bcf\u500b token \u9ede) -->\r\n      <path d=\"M 10 220\r\n               Q 22 215 35 197\r\n               Q 50 200 65 207\r\n               Q 80 200 95 192\r\n               Q 107 187 120 184\r\n               Q 135 184 150 194\r\n               Q 165 191 180 189\r\n               Q 197 198 215 215\r\n               Q 230 220 240 220 Z\"\r\n            fill=\"#0d1814\"\r\n            stroke=\"#a8a6a0\"\r\n            stroke-width=\"1.5\"\/>\r\n\r\n      <!-- \u5019\u9078 token \u9ede -->\r\n      <g fill=\"#a8a6a0\">\r\n        <circle cx=\"35\"  cy=\"197\" r=\"2\"\/>\r\n        <circle cx=\"65\"  cy=\"207\" r=\"2\"\/>\r\n        <circle cx=\"95\"  cy=\"192\" r=\"2\"\/>\r\n        <circle cx=\"120\" cy=\"184\" r=\"2\"\/>\r\n        <circle cx=\"150\" cy=\"194\" r=\"2\"\/>\r\n        <circle cx=\"180\" cy=\"189\" r=\"2\"\/>\r\n        <circle cx=\"215\" cy=\"215\" r=\"2\"\/>\r\n      <\/g>\r\n\r\n      <!-- \u57fa\u7dda -->\r\n      <line x1=\"10\" y1=\"220\" x2=\"230\" y2=\"220\" stroke=\"#a8a6a0\" stroke-width=\"1\"\/>\r\n\r\n      <!-- \u8ef8\u6a19\u7c64 -->\r\n      <text x=\"120\" y=\"248\" font-size=\"12\" fill=\"#a8a6a0\" text-anchor=\"middle\">Candidate token probabilities spread out<\/text>\r\n      <text x=\"120\" y=\"272\" font-size=\"12\" fill=\"#8a8d88\" text-anchor=\"middle\" font-style=\"italic\">\"What is the next string?\"<\/text>\r\n    <\/svg>\r\n\r\n    <!-- ============ \u4e2d:\u689d\u4ef6\u71b5 H(X|Y) ============ -->\r\n    <svg viewBox=\"0 0 240 320\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-labelledby=\"rag-entropy-mid-title\">\r\n      <title id=\"rag-entropy-mid-title\">Conditional entropy H(X|Y): residual entropy after condition Y<\/title>\r\n\r\n      <!-- \u6a19\u984c -->\r\n      <text x=\"120\" y=\"34\" font-size=\"16\" fill=\"#7dd87d\" text-anchor=\"middle\">H(X|Y) \u2500 Conditional Entropy<\/text>\r\n      <text x=\"120\" y=\"56\" font-size=\"12\" fill=\"#7dd87d\" text-anchor=\"middle\">Residual entropy after condition Y<\/text>\r\n\r\n      <!-- \u96e2\u6563\u5206\u5e03:6 \u500b\u9ede\u4e0d\u898f\u5247\u932f\u843d,\u7f3a\u7b49\u8ddd\u7b2c 5 \u500b\u4f4d\u7f6e -->\r\n      <g fill=\"#7dd87d\">\r\n        <circle cx=\"60\"  cy=\"216\" r=\"2.5\"\/>\r\n        <circle cx=\"80\"  cy=\"218\" r=\"2.5\"\/>\r\n        <circle cx=\"100\" cy=\"212\" r=\"2.5\"\/>\r\n        <circle cx=\"120\" cy=\"208\" r=\"2.5\"\/>\r\n        <circle cx=\"160\" cy=\"214\" r=\"2.5\"\/>\r\n        <circle cx=\"180\" cy=\"219\" r=\"2.5\"\/>\r\n      <\/g>\r\n\r\n      <!-- \u689d\u4ef6 Y \u5c0d 6 \u500b\u9ede\u65bd\u52a0\u7684\u5411\u4e0b\u58d3\u529b\u7bad\u982d -->\r\n      <g stroke=\"#7dd87d\" stroke-width=\"0.75\" fill=\"none\" stroke-linecap=\"round\">\r\n        <!-- \u9ede 1 cx=60 cy=216,\u7bad\u982d cy=204\u2192210 -->\r\n        <line x1=\"60\" y1=\"204\" x2=\"60\" y2=\"210\"\/>\r\n        <polyline points=\"57,207 60,210 63,207\"\/>\r\n        <!-- \u9ede 2 cx=80 cy=218,\u7bad\u982d cy=206\u2192212 -->\r\n        <line x1=\"80\" y1=\"206\" x2=\"80\" y2=\"212\"\/>\r\n        <polyline points=\"77,209 80,212 83,209\"\/>\r\n        <!-- \u9ede 3 cx=100 cy=212,\u7bad\u982d cy=200\u2192206 -->\r\n        <line x1=\"100\" y1=\"200\" x2=\"100\" y2=\"206\"\/>\r\n        <polyline points=\"97,203 100,206 103,203\"\/>\r\n        <!-- \u9ede 4 cx=120 cy=208,\u7bad\u982d cy=196\u2192202 -->\r\n        <line x1=\"120\" y1=\"196\" x2=\"120\" y2=\"202\"\/>\r\n        <polyline points=\"117,199 120,202 123,199\"\/>\r\n        <!-- \u9ede 5 cx=160 cy=214,\u7bad\u982d cy=202\u2192208 -->\r\n        <line x1=\"160\" y1=\"202\" x2=\"160\" y2=\"208\"\/>\r\n        <polyline points=\"157,205 160,208 163,205\"\/>\r\n        <!-- \u9ede 6 cx=180 cy=219,\u7bad\u982d cy=207\u2192213 -->\r\n        <line x1=\"180\" y1=\"207\" x2=\"180\" y2=\"213\"\/>\r\n        <polyline points=\"177,210 180,213 183,210\"\/>\r\n      <\/g>\r\n\r\n      <!-- 6 \u500b Y \u6a19\u7c64,\u5404\u5728\u5c0d\u61c9\u7bad\u982d\u8d77\u9ede\u4e0a\u65b9 -->\r\n      <g fill=\"#7dd87d\" font-size=\"12\" text-anchor=\"middle\" font-style=\"italic\">\r\n        <text x=\"60\"  y=\"195\">Y<\/text>\r\n        <text x=\"80\"  y=\"197\">Y<\/text>\r\n        <text x=\"100\" y=\"191\">Y<\/text>\r\n        <text x=\"120\" y=\"187\">Y<\/text>\r\n        <text x=\"160\" y=\"193\">Y<\/text>\r\n        <text x=\"180\" y=\"198\">Y<\/text>\r\n      <\/g>\r\n\r\n      <!-- \u57fa\u7dda -->\r\n      <line x1=\"40\" y1=\"220\" x2=\"200\" y2=\"220\" stroke=\"#a8a6a0\" stroke-width=\"1\"\/>\r\n\r\n      <!-- \u8ef8\u6a19\u7c64 -->\r\n      <text x=\"120\" y=\"248\" font-size=\"12\" fill=\"#7dd87d\" text-anchor=\"middle\">Entropy-reduction engineering injects Y<\/text>\r\n      <text x=\"120\" y=\"272\" font-size=\"12\" fill=\"#7dd87d\" text-anchor=\"middle\" font-style=\"italic\">prompt \u00b7 context \u00b7 agent \u00b7 harness<\/text>\r\n    <\/svg>\r\n\r\n    <!-- ============ \u53f3:\u8a0a\u606f\u589e\u76ca I(X;Y) ============ -->\r\n    <svg viewBox=\"0 0 240 320\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-labelledby=\"rag-entropy-right-title\">\r\n      <title id=\"rag-entropy-right-title\">Information gain I(X;Y): the result of entropy reduction<\/title>\r\n\r\n      <!-- \u6a19\u984c -->\r\n      <text x=\"120\" y=\"34\" font-size=\"16\" fill=\"#c5c8c2\" text-anchor=\"middle\">I(X;Y) \u2500 Information Gain<\/text>\r\n      <text x=\"120\" y=\"56\" font-size=\"12\" fill=\"#a8a6a0\" text-anchor=\"middle\">Result of entropy reduction \u00b7 uncertainty \u2192 zero<\/text>\r\n\r\n      <!-- \u5c16\u92b3\u55ae\u5cf0\u5206\u5e03:\u66f2\u7dda\u8cab\u7a7f 6 \u500b\u526f\u5019\u9078\u8207\u4e3b\u5cf0 -->\r\n      <path d=\"M 10 220\r\n               Q 25 218 40 216\r\n               Q 55 217 70 218\r\n               Q 85 215 100 212\r\n               Q 113 210 125 208\r\n               Q 140 200 155 110\r\n               Q 170 200 190 214\r\n               Q 205 217 220 219\r\n               Q 225 220 230 220 Z\"\r\n            fill=\"#0d1814\"\r\n            stroke=\"#7dd87d\"\r\n            stroke-width=\"1.5\"\/>\r\n\r\n      <!-- \u96c6\u4e2d\u65bc\u5cf0\u9802\u7684\u4e3b\u5019\u9078 + \u4e2d\u5340\u584a\u50b3\u627f\u4e0b\u4f86\u7684 6 \u500b\u526f\u5019\u9078 -->\r\n      <g fill=\"#7dd87d\">\r\n        <!-- \u4e3b\u5019\u9078:\u5cf0\u9802 -->\r\n        <circle cx=\"155\" cy=\"110\" r=\"3\"\/>\r\n        <!-- \u526f\u5019\u9078:\u5ef6\u7e8c\u689d\u4ef6\u71b5\u7684 6 \u9ede,\u5c55\u958b\u5206\u5e03\u5728\u57fa\u7dda\u9644\u8fd1 -->\r\n        <circle cx=\"40\"  cy=\"216\" r=\"2.5\"\/>\r\n        <circle cx=\"70\"  cy=\"218\" r=\"2.5\"\/>\r\n        <circle cx=\"100\" cy=\"212\" r=\"2.5\"\/>\r\n        <circle cx=\"125\" cy=\"208\" r=\"2.5\"\/>\r\n        <circle cx=\"190\" cy=\"214\" r=\"2.5\"\/>\r\n        <circle cx=\"220\" cy=\"219\" r=\"2.5\"\/>\r\n      <\/g>\r\n\r\n      <!-- \u57fa\u7dda -->\r\n      <line x1=\"10\" y1=\"220\" x2=\"230\" y2=\"220\" stroke=\"#a8a6a0\" stroke-width=\"1\"\/>\r\n\r\n      <!-- \u8ef8\u6a19\u7c64 -->\r\n      <text x=\"120\" y=\"248\" font-size=\"12\" fill=\"#a8a6a0\" text-anchor=\"middle\">Probability concentrates on a few candidates<\/text>\r\n      <text x=\"120\" y=\"272\" font-size=\"12\" fill=\"#8a8d88\" text-anchor=\"middle\" font-style=\"italic\">\"The next string is X.\"<\/text>\r\n    <\/svg>\r\n\r\n  <\/div>\r\n\r\n  <div class=\"rag-entropy-formula\">\r\n    <div class=\"rag-entropy-formula-main\">\u8a0a\u606f\u71b5\u3000\u2212\u3000\u5269\u9918\u71b5\u3000=\u3000\u8a0a\u606f\u589e\u76ca<\/div>\r\n    <div class=\"rag-entropy-formula-math\">H(X)  \u2212  H(X|Y)  =  I(X;Y)<\/div>\r\n  <\/div>\r\n\r\n  <p class=\"rag-entropy-footer\">LLM \u672c\u8eab\u662f\u4e00\u500b\u9ad8\u8a0a\u606f\u71b5\u7684\u5b57\u4e32\u751f\u6210\u5668\uff0c\u5b83\u77e5\u9053\u4e00\u5207\u53ef\u80fd\u7684\u5b57\u4e32\uff0c\u4f46\u6bcf\u4e00\u500b\u7b54\u6848\u90fd\u6709\u53ef\u80fd\u767c\u751f\u3002\u6240\u6709\u8b93 LLM \u52d5\u8d77\u4f86\u3001\u80fd\u5b8c\u6210\u4efb\u4f55\u4e8b\u60c5\u7684\u5de5\u7a0b\u90fd\u662f\u71b5\u6e1b\uff1aprompt \u6ce8\u5165\u662f\u71b5\u6e1b\u3001context \u8a2d\u8a08\u662f\u71b5\u6e1b\u3001agent \u898f\u5283\u662f\u71b5\u6e1b\u3001harness \u642d\u5efa\u662f\u71b5\u6e1b\uff0c\u53ea\u662f\u5f71\u97ff\u7bc4\u570d\u7684\u5927\u5c0f\u4e0d\u540c\u3002\u71b5\u6e1b\u5de5\u7a0b\u7684\u76ee\u7684\u662f\u6d88\u9664\u4e0d\u78ba\u5b9a\uff0c\u800c\u591a\u9918\u7684\u932f\u8aa4\u96dc\u8a0a\u4e0d\u6703\u8b93 LLM \u66f4\u7cbe\u78ba\uff0c\u53ea\u6703\u8b93\u5b83\u66f4\u80af\u5b9a\u5730\u7b54\u932f\u3002\r\n  <\/p>\r\n\r\n<\/div>\r\n<\/body>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-acb1c04 e-flex e-con-boxed qodef-elementor-content-no e-con e-parent\" data-id=\"acb1c04\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-1701352 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"1701352\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-9863c76 e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"9863c76\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5839895 elementor-widget elementor-widget-heading\" data-id=\"5839895\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">\u5f9e Prompt \u5230 Harness Engineering<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-43abc7c elementor-widget elementor-widget-heading\" data-id=\"43abc7c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t\t<h4 class=\"elementor-heading-title elementor-size-default\">\u71b5\u6e1b\u5de5\u7a0b\u7684\u56db\u6b21\u8e8d\u9077<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bc979ad elementor-widget elementor-widget-text-editor\" data-id=\"bc979ad\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<p>AI \u71b5\u6e1b\u5de5\u7a0b\u7684\u6f14\u9032\uff0c\u662f\u4e00\u5834\u6301\u4e45\u6230\uff0c\u5c0d\u6297\u7684\u662f\u8a9e\u8a00\u7684\u4e0d\u78ba\u5b9a\u6027\u3002\u5f9e Prompt \u958b\u59cb\u4f5c\u70ba\u6700\u65e9\u7684\u71b5\u6e1b\u624b\u6bb5\u51fa\u73fe\uff0c\u4ee5\u7cbe\u78ba\u6307\u4ee4\u6536\u7a84\u6a21\u578b\u7684\u8f38\u51fa\u7a7a\u9593\uff1b\u5230\u4e86 2023 \u81f3 2024 \u5e74\uff0c\u65b0\u8208\u7684 Agent \u67b6\u69cb\u8a66\u5716\u8b93 AI \u81ea\u4e3b\u884c\u52d5\uff0c\u628a\u55ae\u6b21\u751f\u6210\u63a5\u6210\u8ff4\u5708\uff0c\u4f46\u9019\u4e5f\u8b93\u71b5\u5728\u4e00\u6b65\u6b65\u8fed\u4ee3\u4e2d\u7d2f\u7a4d\uff0c\u6700\u7d42\u5fb9\u5e95\u5931\u63a7\u3002<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-52a5afc elementor-widget elementor-widget-text-editor\" data-id=\"52a5afc\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<p>\u649e\u7246\u4e4b\u5f8c\u624d\u767c\u73fe\uff0c\u5c11\u7684\u662f Context \u9019\u584a\u57fa\u790e\u5efa\u8a2d\uff1a\u5728\u6bcf\u4e00\u6b65\u91cd\u65b0\u6ce8\u5165\u7d50\u69cb\u5316\u7684\u77e5\u8b58\u8207\u76ee\u6a19\uff0c\u8b93\u6a21\u578b\u958b\u53e3\u524d\u5148\u6709\u6839\u64da\u3002\u4f46\u628a\u6bcf\u4e00\u6b65\u9935\u6e96\uff0c\u9084\u4e0d\u7b49\u65bc\u6574\u500b\u7cfb\u7d71\u80fd\u5920\u6301\u7e8c\u63a8\u9032\u3002\u9032\u5165 2026\uff0cHarness \u7684\u6982\u5ff5\u78ba\u7acb\uff0c\u5c07\u524d\u4e09\u8005\u7cfb\u7d71\u5316\u6574\u5408\uff0c\u628a\u964d\u71b5\u7684\u9435\u5247\u710a\u9032 AI \u904b\u4f5c\u7684\u7cfb\u7d71\uff0c\u8b93\u6a21\u578b\u5728\u81ea\u7531\u767c\u63ee\u4e4b\u9918\uff0c\u884c\u70ba\u59cb\u7d42\u7d04\u675f\u5728\u5b89\u5168\u7684\u908a\u754c\u5167\uff0c\u4e0d\u81f4\u812b\u97c1\u3002<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0c668bb e-con-full e-flex qodef-elementor-content-no e-con e-child\" data-id=\"0c668bb\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-c1399c6 elementor-widget elementor-widget-html\" data-id=\"c1399c6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t\t<style>\r\n\r\n.rag-diagram-scope {\r\n  \/* \u2500\u2500 \u4e3b\u8272 \u00b7 \u6539\u52d5\u96c6\u4e2d\u5728\u6b64 3 \u884c \u2500\u2500 *\/\r\n  --rag-bg:     #eaeaea;\r\n  --rag-accent: #BE935D;\r\n  --rag-text:   #262019;\r\n\r\n  \/* \u2500\u2500 \u5b57\u91cd \u2500\u2500 *\/\r\n  --rag-weight-title:    700;\r\n  --rag-weight-subtitle: 400;\r\n  --rag-weight-body:     400;\r\n\r\n  \/* \u2500\u2500 \u5b57\u7d1a \u00b7 \u6539\u9019 3 \u500b\u6703\u5e36\u52d5\u540c\u7fa4\u6b21\u968e\u5c64 \u2500\u2500 *\/\r\n  --rag-size-title:    17px;\r\n  --rag-size-subtitle: 13px;\r\n  --rag-size-body:     11px;\r\n\r\n  \/* \u2500\u2500 \u884d\u751f\u8272 \u00b7 \u03b1 on --rag-text \u2500\u2500 *\/\r\n  --rag-ink-1: rgb(from var(--rag-text) r g b \/ 1);\r\n  --rag-ink-2: rgb(from var(--rag-text) r g b \/ 0.78);\r\n  --rag-ink-3: rgb(from var(--rag-text) r g b \/ 0.58);\r\n\r\n  \/* \u2500\u2500 \u884d\u751f\u8272 \u00b7 \u03b1 on --rag-accent \u2500\u2500 *\/\r\n  --rag-acc-1:    var(--rag-accent);\r\n  --rag-acc-2:    rgb(from var(--rag-accent) r g b \/ 0.55);\r\n  --rag-acc-tint: rgb(from var(--rag-accent) r g b \/ 0.10);\r\n  --rag-acc-dots: rgb(from var(--rag-accent) r g b \/ 0.22);\r\n\r\n  \/* \u2500\u2500 \u4e2d\u6027\u5fae\u8868\u9762 \u2500\u2500 *\/\r\n  --rag-surface: rgb(from var(--rag-text) r g b \/ 0.05);\r\n\r\n  \/* \u2500\u2500 SKILL \u898f\u7bc4\u5b57\u7d1a(\u4e00\u822c\u6587\u5b57 + \u4e3b\u6a19\u984c) \u2500\u2500 *\/\r\n  --rag-text-size:    17px;   \/* \u4e00\u822c\u6587\u5b57:\u526f\u6a19\u984c\/\u5f15\u8a00\/\u7d50\u8ad6\u6bb5\u843d *\/\r\n  --rag-heading-size: 28px;   \/* \u4e3b\u6a19\u984c:diagram \u9802\u7aef h2 *\/\r\n\r\n  \/* \u5bb9\u5668\u672c\u8eab *\/\r\n  background: var(--rag-bg);\r\n  color: var(--rag-text);\r\n  font-family: \"Cormorant\",\"LXGW WenKai TC\",\"Nanum Myeongjo\",\"Noto Sans\",serif;\r\n  font-weight: var(--rag-weight-body);\r\n  max-width: 500px;\r\n  margin: 0 auto;\r\n  padding: 16px 26px;\r\n  box-sizing: border-box;\r\n}\r\n\r\n.rag-diagram-scope *,\r\n.rag-diagram-scope *::before,\r\n.rag-diagram-scope *::after {\r\n  box-sizing: border-box;\r\n}\r\n\r\n.rag-diagram-scope .diagram { width: 100%; display: block; }\r\n\r\n\/* SVG text \u5f37\u5236\u4e0d\u900f\u660e *\/\r\n.rag-diagram-scope svg text { opacity: 1 !important; }\r\n\r\n\/* \u9078\u53d6\u8272 \u00b7 \u53cd\u76f8 *\/\r\n.rag-diagram-scope ::selection {\r\n  background: var(--rag-text);\r\n  color: var(--rag-bg);\r\n  fill: var(--rag-bg);\r\n}\r\n.rag-diagram-scope ::-moz-selection {\r\n  background: var(--rag-text);\r\n  color: var(--rag-bg);\r\n  fill: var(--rag-bg);\r\n}\r\n\r\n\/* \u5b57\u91cd\u5206\u6d41 \u00b7 SVG \u4f9d font-size \u81ea\u52d5\u5957\u5c0d\u61c9 weight *\/\r\n.rag-diagram-scope svg text[font-size=\"14\"],\r\n.rag-diagram-scope svg text[font-size=\"13\"],\r\n.rag-diagram-scope svg text[font-size=\"12\"]   { font-weight: var(--rag-weight-title); }\r\n\r\n.rag-diagram-scope svg text[font-size=\"11\"],\r\n.rag-diagram-scope svg text[font-size=\"10\"],\r\n.rag-diagram-scope svg text[font-size=\"9.5\"]  { font-weight: var(--rag-weight-subtitle); }\r\n\r\n\/* \u5b57\u7d1a\u5206\u6d41 \u00b7 SVG \u4f9d\u539f font-size attribute \u81ea\u52d5\u5957\u5c0d\u61c9 size *\/\r\n.rag-diagram-scope svg text[font-size=\"14\"]   { font-size: var(--rag-size-title); }\r\n.rag-diagram-scope svg text[font-size=\"13\"]   { font-size: calc(var(--rag-size-title) - 1px); }\r\n.rag-diagram-scope svg text[font-size=\"12\"]   { font-size: calc(var(--rag-size-title) - 2px); }\r\n\r\n.rag-diagram-scope svg text[font-size=\"11\"]   { font-size: calc(var(--rag-size-subtitle) + 1px); }\r\n.rag-diagram-scope svg text[font-size=\"10\"]   { font-size: var(--rag-size-subtitle); }\r\n.rag-diagram-scope svg text[font-size=\"9.5\"]  { font-size: calc(var(--rag-size-subtitle) - 0.5px); }\r\n\r\n.rag-diagram-scope svg text[font-size=\"9\"]    { font-size: calc(var(--rag-size-body) + 1px); }\r\n.rag-diagram-scope svg text[font-size=\"8.5\"]  { font-size: calc(var(--rag-size-body) + 0.5px); }\r\n.rag-diagram-scope svg text[font-size=\"8\"]    { font-size: var(--rag-size-body); }\r\n.rag-diagram-scope svg text[font-size=\"7.5\"]  { font-size: calc(var(--rag-size-body) - 0.5px); }\r\n\r\n\/* SVG \u8272\u7968\u6620\u5c04 *\/\r\n.rag-diagram-scope svg [fill=\"#e6e4dc\"]   { fill: var(--rag-ink-1); }\r\n.rag-diagram-scope svg [fill=\"#c5c8c2\"]   { fill: var(--rag-ink-2); }\r\n.rag-diagram-scope svg [fill=\"#a8a6a0\"],\r\n.rag-diagram-scope svg [fill=\"#8a8d88\"],\r\n.rag-diagram-scope svg [fill=\"#5a5d58\"]   { fill: var(--rag-ink-3); }\r\n.rag-diagram-scope svg [fill=\"#7dd87d\"]   { fill: var(--rag-acc-1); }\r\n.rag-diagram-scope svg [fill=\"#5a7d5e\"]   { fill: var(--rag-acc-2); }\r\n.rag-diagram-scope svg [fill=\"#0a1410\"]   { fill: var(--rag-surface); }\r\n.rag-diagram-scope svg [fill=\"#0d1814\"]   { fill: var(--rag-acc-tint); }\r\n.rag-diagram-scope svg [fill=\"#1c2a1f\"]   { fill: var(--rag-acc-dots); }\r\n\r\n.rag-diagram-scope svg [stroke=\"#c5c8c2\"] { stroke: var(--rag-ink-1); }\r\n.rag-diagram-scope svg [stroke=\"#a8a6a0\"],\r\n.rag-diagram-scope svg [stroke=\"#7a7d78\"],\r\n.rag-diagram-scope svg [stroke=\"#5a5d58\"],\r\n.rag-diagram-scope svg [stroke=\"#4a4f4d\"] { stroke: var(--rag-ink-3); }\r\n.rag-diagram-scope svg [stroke=\"#7dd87d\"] { stroke: var(--rag-acc-1); }\r\n.rag-diagram-scope svg [stroke=\"#5a7d5e\"] { stroke: var(--rag-acc-2); }\r\n\r\n\/* \u97ff\u61c9\u5f0f:1024px \u7ba1 padding(\u907f\u514d\u8ddf\u5bbf\u4e3b\u908a\u8ddd\u758a\u52a0) *\/\r\n@media (max-width: 1024px) {\r\n  .rag-diagram-scope { padding: 0; }\r\n}\r\n\r\n\/* HTML \u6a19\u984c\/\u526f\u6a19\/footer \u2014 \u5957 SKILL \u898f\u7bc4\u5b57\u7d1a,\u81ea\u52d5\u63db\u884c *\/\r\n.rag-diagram-scope .diagram-title {\r\n  margin: 0 0 6px 0;\r\n  padding: 0;\r\n  font-size: var(--rag-heading-size);\r\n  font-weight: var(--rag-weight-title);\r\n  color: var(--rag-ink-1);\r\n  text-align: center;\r\n}\r\n\r\n.rag-diagram-scope .diagram-subtitle {\r\n  margin: 0 0 28px 0;\r\n  padding: 0;\r\n  font-size: var(--rag-text-size);\r\n  font-weight: var(--rag-weight-subtitle);\r\n  color: var(--rag-ink-3);\r\n  text-align: center;\r\n}\r\n\r\n.rag-diagram-scope .diagram {\r\n  margin: 0 0 14px 0;\r\n}\r\n\r\n.rag-diagram-scope .diagram-caption {\r\n  margin: 0;\r\n  padding: 0;\r\n  font-size: var(--rag-text-size);\r\n  font-weight: var(--rag-weight-subtitle);\r\n  color: var(--rag-acc-1);\r\n  text-align: center;\r\n}\r\n\r\n\/* SKILL \u898f\u7bc4\u97ff\u61c9\u5f0f:\u624b\u6a5f\u964d\u5b57\u7d1a *\/\r\n@media (max-width: 768px) {\r\n  .rag-diagram-scope {\r\n    --rag-text-size:    15px;\r\n    --rag-heading-size: 22px;\r\n  }\r\n}\r\n<\/style>\r\n<body style=\"background:#eaeaea;margin:0\">\r\n<div class=\"rag-diagram-scope\">\r\n\r\n<h2 class=\"diagram-title\">Overshoot \u00b7 Build base \u00b7 Break out<\/h2>\r\n<p class=\"diagram-subtitle\">The breakthroughs in AI entropy engineering are infrastructure forged from repeated wall-hits.<\/p>\r\n\r\n<svg class=\"diagram\" viewBox=\"3 88 380 422\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\r\n<defs>\r\n  <pattern id=\"ent-dots\" x=\"0\" y=\"0\" width=\"10\" height=\"10\" patternUnits=\"userSpaceOnUse\">\r\n    <circle cx=\"1\" cy=\"1\" r=\"0.5\" fill=\"#1c2a1f\"\/>\r\n  <\/pattern>\r\n  <marker id=\"ent-arr\" viewBox=\"0 0 10 10\" refX=\"8\" refY=\"5\" markerWidth=\"6\" markerHeight=\"6\" orient=\"auto\">\r\n    <path d=\"M0 1L8 5L0 9Z\" fill=\"#a8a6a0\"\/>\r\n  <\/marker>\r\n  <marker id=\"ent-arr-g\" viewBox=\"0 0 10 10\" refX=\"8\" refY=\"5\" markerWidth=\"6\" markerHeight=\"6\" orient=\"auto\">\r\n    <path d=\"M0 1L8 5L0 9Z\" fill=\"#7dd87d\"\/>\r\n  <\/marker>\r\n<\/defs>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 Title \u5df2\u79fb\u81f3 SVG \u5916\uff0c\u7528 HTML \u8655\u7406 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 Chart background \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<rect x=\"40\" y=\"90\" width=\"320\" height=\"300\" rx=\"6\"\r\n  fill=\"url(#ent-dots)\" stroke=\"#5a5d58\" stroke-width=\"0.4\" stroke-dasharray=\"3 3\"\/>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 Y-axis (scope) \u6a19\u8a18\u7559\u7d66 \u9ede\/\u7dda\/\u9762\/\u9ad4 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n\r\n<!-- 4 \u689d scope \u5e36\u6a6b\u7dda\uff08\u6975\u6de1\uff09 -->\r\n<line x1=\"46\" y1=\"132\" x2=\"354\" y2=\"132\" stroke=\"#5a5d58\" stroke-width=\"0.3\" stroke-dasharray=\"2 4\" opacity=\"0.45\"\/>\r\n<line x1=\"46\" y1=\"206\" x2=\"354\" y2=\"206\" stroke=\"#5a5d58\" stroke-width=\"0.3\" stroke-dasharray=\"2 4\" opacity=\"0.45\"\/>\r\n<line x1=\"46\" y1=\"278\" x2=\"354\" y2=\"278\" stroke=\"#5a5d58\" stroke-width=\"0.3\" stroke-dasharray=\"2 4\" opacity=\"0.45\"\/>\r\n<line x1=\"46\" y1=\"348\" x2=\"354\" y2=\"348\" stroke=\"#5a5d58\" stroke-width=\"0.3\" stroke-dasharray=\"2 4\" opacity=\"0.45\"\/>\r\n\r\n<!-- scope \u5e36\u5de6\u5074 Y-axis \u6a19\u8a18 Cube\/Plane\/Line\/Point (\u53d6\u4ee3\u300c\u5927\u2191\u5c0f\u300d\u8ef8\u7dda) -->\r\n<text x=\"20\" y=\"136\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Cube<\/text>\r\n<text x=\"20\" y=\"210\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Plane<\/text>\r\n<text x=\"20\" y=\"282\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Line<\/text>\r\n<text x=\"20\" y=\"352\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Point<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 \u9023\u7dda\uff08\u6642\u9593\u9806\u5e8f\uff09 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<!-- \u2460 Prompt (80, 348) \u2192 \u2461 Agent (150, 206) \u2014 \u7bad\u982d\u5c16\u7aef\u96e2\u958b Agent \u65b9\u584a\u5e95\u90e8 -->\r\n<line x1=\"88\" y1=\"340\" x2=\"140\" y2=\"224\" stroke=\"#a8a6a0\" stroke-width=\"0.9\" marker-end=\"url(#ent-arr)\"\/>\r\n\r\n<!-- \u2461 Agent (150, 206) \u2192 \u2462 Context (220, 278) \u56de\u982d\u88dc(\u7da0\u8272\u865b\u7dda\u00b7\u91cd\u9ede) \u2014 \u8d77\u9ede\u96e2\u958b Agent \u65b9\u584a\u53f3\u4e0b -->\r\n<line x1=\"167\" y1=\"224\" x2=\"209\" y2=\"270\" stroke=\"#7dd87d\" stroke-width=\"1.3\" stroke-dasharray=\"4 2\" marker-end=\"url(#ent-arr-g)\"\/>\r\n\r\n<!-- \u2462 Context (220, 278) \u2192 \u2463 Harness (320, 132) \u2014 \u7bad\u982d\u843d\u5728\u7acb\u65b9\u9ad4\u5916\u7684\u5de6\u4e0b\u3001\u4e0d\u9ecf\u65b9\u584a -->\r\n<line x1=\"225\" y1=\"270\" x2=\"304\" y2=\"154\" stroke=\"#a8a6a0\" stroke-width=\"0.9\" marker-end=\"url(#ent-arr)\"\/>\r\n\r\n<!-- \u6a19\u8a3b\uff1a\u8ddf\u7da0\u8272\u865b\u7dda\u7bad\u982d\u5e73\u884c\uff0845\u00b0 \u65cb\u8f49\uff09\uff0c\u5411\u5de6\u4e0a\u5782\u76f4\u504f\u79fb 7px \u7559\u9593\u8ddd -->\r\n<text x=\"172\" y=\"220\" font-size=\"8\" fill=\"#7dd87d\" opacity=\"0.75\"\r\n      transform=\"rotate(45 172 220)\" letter-spacing=\"0.06em\">backfill<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 \u2460 Prompt = \u9ede (2022 \u672b) \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<circle cx=\"80\" cy=\"348\" r=\"4\" fill=\"#e6e4dc\"\/>\r\n<text x=\"80\" y=\"372\" text-anchor=\"middle\" font-size=\"11\" fill=\"#c5c8c2\">Prompt<\/text>\r\n<text x=\"68\" y=\"338\" text-anchor=\"middle\" font-size=\"8\" fill=\"#a8a6a0\">\u2460<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 \u2461 Agent = \u9762 (2023) \u2014 \u6bd4 \u2462 \u5927 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<rect x=\"137\" y=\"193\" width=\"26\" height=\"26\" fill=\"#0a1410\" stroke=\"#e6e4dc\" stroke-width=\"1.2\"\/>\r\n<text x=\"150\" y=\"186\" text-anchor=\"middle\" font-size=\"11\" fill=\"#c5c8c2\">Agent<\/text>\r\n<text x=\"132\" y=\"200\" text-anchor=\"middle\" font-size=\"8\" fill=\"#a8a6a0\">\u2461<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 \u2462 Context = \u7dda (2024) \u2014 \u6bd4 \u2461 \u5c0f\uff0c\u8996\u89ba\u51f9\u9677 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<line x1=\"203\" y1=\"278\" x2=\"231\" y2=\"278\" stroke=\"#7dd87d\" stroke-width=\"3.5\"\/>\r\n<text x=\"217\" y=\"300\" text-anchor=\"middle\" font-size=\"11\" fill=\"#7dd87d\">Context<\/text>\r\n<text x=\"193\" y=\"282\" text-anchor=\"middle\" font-size=\"8\" fill=\"#7dd87d\">\u2462<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 \u2463 Harness = \u9ad4 (2026 \u521d) \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<!-- \u7acb\u65b9\u9ad4\uff1a\u5f8c\u9762 rect \u2192 3 \u689d\u5916\u5074\u9023\u63a5\u908a \u2192 \u524d\u9762 rect \u2192 1 \u689d\u5de6\u4e0b\u9023\u63a5\u908a(\u758a\u5728\u524d\u9762 rect \u4e0a) -->\r\n<rect x=\"315\" y=\"121\" width=\"22\" height=\"22\" fill=\"#0a1410\" stroke=\"#c5c8c2\" stroke-width=\"0.7\"\/>\r\n<line x1=\"310\" y1=\"126\" x2=\"315\" y2=\"121\" stroke=\"#c5c8c2\" stroke-width=\"0.6\"\/>\r\n<line x1=\"332\" y1=\"126\" x2=\"337\" y2=\"121\" stroke=\"#c5c8c2\" stroke-width=\"0.6\"\/>\r\n<line x1=\"332\" y1=\"148\" x2=\"337\" y2=\"143\" stroke=\"#c5c8c2\" stroke-width=\"0.6\"\/>\r\n<rect x=\"310\" y=\"126\" width=\"22\" height=\"22\" fill=\"#0a1410\" stroke=\"#c5c8c2\" stroke-width=\"0.7\"\/>\r\n<line x1=\"310\" y1=\"148\" x2=\"315\" y2=\"143\" stroke=\"#c5c8c2\" stroke-width=\"0.6\"\/>\r\n<text x=\"324\" y=\"114\" text-anchor=\"middle\" font-size=\"11\" fill=\"#c5c8c2\">Harness<\/text>\r\n<text x=\"304\" y=\"134\" text-anchor=\"middle\" font-size=\"8\" fill=\"#a8a6a0\">\u2463<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 X-axis \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<line x1=\"40\" y1=\"402\" x2=\"360\" y2=\"402\" stroke=\"#a8a6a0\" stroke-width=\"0.8\"\/>\r\n<path d=\"M360 402 L355 399 L355 405 Z\" fill=\"#a8a6a0\"\/>\r\n<text x=\"368\" y=\"416\" text-anchor=\"end\" font-size=\"9\" fill=\"#8a8d88\">time<\/text>\r\n\r\n<!-- X-axis tick marks and year labels\uff08\u4f9d\u5be6\u969b\u6642\u9593\u9593\u8ddd\uff09 -->\r\n<line x1=\"80\" y1=\"398\" x2=\"80\" y2=\"406\" stroke=\"#a8a6a0\" stroke-width=\"0.8\"\/>\r\n<text x=\"80\" y=\"420\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Late 2022<\/text>\r\n\r\n<line x1=\"150\" y1=\"398\" x2=\"150\" y2=\"406\" stroke=\"#a8a6a0\" stroke-width=\"0.8\"\/>\r\n<text x=\"150\" y=\"420\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">2023<\/text>\r\n\r\n<line x1=\"220\" y1=\"398\" x2=\"220\" y2=\"406\" stroke=\"#a8a6a0\" stroke-width=\"0.8\"\/>\r\n<text x=\"220\" y=\"420\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">2024<\/text>\r\n\r\n<line x1=\"320\" y1=\"398\" x2=\"320\" y2=\"406\" stroke=\"#a8a6a0\" stroke-width=\"0.8\"\/>\r\n<text x=\"320\" y=\"420\" text-anchor=\"middle\" font-size=\"9\" fill=\"#8a8d88\">Early 2026<\/text>\r\n\r\n<!-- \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 Footer caption\uff08\u5169\u5217 pill + \u4e00\u53e5\u8a71\uff09 \u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550\u2550 -->\r\n<rect x=\"40\" y=\"448\" width=\"320\" height=\"26\" rx=\"4\" fill=\"#0a1410\" stroke=\"#5a5d58\" stroke-width=\"0.4\"\/>\r\n<text x=\"56\" y=\"465\" font-size=\"9.5\" fill=\"#a8a6a0\">scope<\/text>\r\n<text x=\"140\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Prompt<\/text>\r\n<text x=\"170\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#5a5d58\">&lt;<\/text>\r\n<text x=\"200\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Context<\/text>\r\n<text x=\"230\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#5a5d58\">&lt;<\/text>\r\n<text x=\"260\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Agent<\/text>\r\n<text x=\"290\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#5a5d58\">&lt;<\/text>\r\n<text x=\"320\" y=\"465\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Harness<\/text>\r\n\r\n<rect x=\"40\" y=\"478\" width=\"320\" height=\"26\" rx=\"4\" fill=\"#0d1814\" stroke=\"#7dd87d\" stroke-width=\"0.5\"\/>\r\n<text x=\"56\" y=\"495\" font-size=\"9.5\" fill=\"#7dd87d\">emergence<\/text>\r\n<text x=\"140\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Prompt<\/text>\r\n<text x=\"170\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#7dd87d\">\u2192<\/text>\r\n<text x=\"200\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Agent<\/text>\r\n<text x=\"230\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#7dd87d\">\u2192<\/text>\r\n<text x=\"260\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#7dd87d\">Context<\/text>\r\n<text x=\"290\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#7dd87d\">\u2192<\/text>\r\n<text x=\"320\" y=\"495\" text-anchor=\"middle\" font-size=\"9.5\" fill=\"#c5c8c2\">Harness<\/text>\r\n\r\n<!-- \u918d\u9190\u704c\u9802\u7684\u4e00\u53e5\u5df2\u79fb\u81f3 SVG \u5916\uff0c\u7528 HTML \u8655\u7406 -->\r\n\r\n<\/svg>\r\n\r\n<p class=\"diagram-caption\">Agent hit a wall; Context backfilled the foundation.<\/p>\r\n\r\n<\/div>\r\n<\/body>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>AI entropy-reduction engineering is the umbrella term for every design that gets an LLM moving. From prompt to context to agent to harness, all of them narrow the range of prediction and lower the uncertainty of an answer; only the scope of their influence differs. This is because an LLM operates on a naturally high-entropy linguistic medium, and the core engineering of an AI application is to perform entropy reduction through structured input and external knowledge, lowering uncertainty and improving output quality.<\/p>","protected":false},"author":1,"featured_media":9286,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"video","meta":{"footnotes":""},"categories":[27],"tags":[],"class_list":["post-877","post","type-post","status-publish","format-video","has-post-thumbnail","hentry","category-blog","post_format-post-format-video"],"_links":{"self":[{"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/posts\/877","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/comments?post=877"}],"version-history":[{"count":369,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/posts\/877\/revisions"}],"predecessor-version":[{"id":11222,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/posts\/877\/revisions\/11222"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/media\/9286"}],"wp:attachment":[{"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/media?parent=877"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/categories?post=877"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ragsitemap.com\/en\/wp-json\/wp\/v2\/tags?post=877"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}