|
| 1 | +import { baseEntryStruct, blogEntry } from '../../../js/blog/blogEntryBase.js'; |
| 2 | + |
| 3 | +const entryData = baseEntryStruct(); |
| 4 | +entryData.title = "A Fault"; |
| 5 | +entryData.date = "2026-04-09"; |
| 6 | +entryData.eid = "A"; |
| 7 | +entryData.tags = ["theory", "metacognition", "cognitive science"]; |
| 8 | +entryData.body = ` |
| 9 | + The problem with thinking about metacognition is that you start deep diving your own mind, in a way that reveals thinking patterns that you haven't read about before. |
| 10 | + <br> That being said, means I need to do more research on active recall in the brain-hole! |
| 11 | +
|
| 12 | + <br><br> Under my own inspection, it seems my internal visual memory is entirely separate from my labeling and object association memory. |
| 13 | + <br> Yet can use my visual memory to recall object associations, yet not the label easily. And visual+object recall from a label alone, or nothing at all. |
| 14 | +
|
| 15 | + <br><br> Errmmm, like, if I think about an image of a video game I played as a child in my head, |
| 16 | + <br> like seeing the Prince of Persia jumping over pits in my mind, or the janky running in the game, but can't remember the name Prince of Persia. |
| 17 | + <br> I'll sooner remember the story, gameplay elements, and game mechanics from that old DOS game than I will the name of the game itself. Every attribute of the game, but the name. |
| 18 | + |
| 19 | + <br><br> While thinking about the game, may even re-forget the name, |
| 20 | + <br> Needing to remind myself of the label of the game while still thinking of the gameplay and imagery the entire time. |
| 21 | + <br> So there is a separation in activation between the label and thing itself in my meat-mind. |
| 22 | +
|
| 23 | + <br><br> I feel like we've all had "words on the tip of our tongues" before, |
| 24 | + <br> And every time we ask about a game or movie we can't remember the name of, we ask by describing what occurred in the movie or games story, or art style, or actors. |
| 25 | +
|
| 26 | + <br><br><br><div class='procPagesAIDevBar'></div> |
| 27 | +
|
| 28 | + <br><br> Research time!! |
| 29 | + |
| 30 | + <div class="textItalic textCenter">::doo do doo:: |
| 31 | + <br><span class="textBold">Research!</span> |
| 32 | + <br>::doo do doo:: |
| 33 | + <br><span class="textBold">yeah!</span> |
| 34 | + <br>::doo::</div> |
| 35 | +
|
| 36 | + <br><br> Allan Paivio's <span class="textName">Dual Coding Theory</span>, 1960 |
| 37 | + <br> So we have a name, a theory, and some validation of my observations above. |
| 38 | +
|
| 39 | + <br><br> On top of the <span class="textName">tip-of-the-tongue</span> being a titular topic in typical brains. |
| 40 | +
|
| 41 | + <br><br> Paivio researched the separation of verbal and non-verbal memory in the brain. |
| 42 | + <br> Which does align to my experience to a degree. |
| 43 | + <br> But the important part of his research is about memory degradation over the "staged" memory at the time. |
| 44 | +
|
| 45 | + <br><br> So in the case that I forgot the name Prince Of Persia while thinking of that drab yellow, weird stuttery run, the pits that were near impossible to jump over, exiting to a black screen with colored text saying thanks for playing, yet the name may vanish in that flurry of recall. |
| 46 | +
|
| 47 | + <br><br> Perhaps this is where my color recall being separated from my object detail recall, may come into play on a personal level, qualia. |
| 48 | + <br> I mentioned in the blog post <span class="textName">Dreamy Meanderings</span> of my limited color visualization in my mind, thinking it may just be an optimization technique my brain employed when I was younger due to Dyslexia messing with my visual cortex vs reading comprehension. |
| 49 | +
|
| 50 | + <br><br> If that made no sense to you, there is very limited research into the "colored auras" around text in children with dyslexia, |
| 51 | + <br> I had this effect. |
| 52 | + |
| 53 | + <br><br> It looked like rainbows of colors around the letters, like 4 or 5 colors around each letter, color chunks, mandalas; |
| 54 | + <br> Even covering the letters & words sometimes. |
| 55 | + <br> But I grew/learned out of that by 2nd-3rd grade and stopped seeing the color auras while reading. |
| 56 | + <br> Like my brain didn't understand what to do with textual input, but never had that problem with math. |
| 57 | +
|
| 58 | + <br><br> Trying to comprehend something lexical & phonological, yet presented visually. |
| 59 | + <br> Clashing functionalities on a young plastic mind. |
| 60 | +
|
| 61 | + <br><br> Reading light text on a dark background is extremely helpful for me, |
| 62 | + So if you had similar, maybe try that to read easier. |
| 63 | + <br> Art wise, white is positive space, black is negative space to me. |
| 64 | + |
| 65 | + <br><br><br><div class='procPagesAIDevBar'></div> |
| 66 | +
|
| 67 | + <br><br> This has been my biggest complaint of LLMs and this language based AI that feels just wrong to me. |
| 68 | +
|
| 69 | + <br><br> If we are conceptual thinkers, why would we make an AI designed to not think in concepts? |
| 70 | +
|
| 71 | + <br><br> I think the main reason for this approach is that, atoms make up matter, and matter makes up reality. So if we break down things to their core constituents, it'll provide a more granular level of data serialization. |
| 72 | +
|
| 73 | + <br><br> Data Serialization is the organization of information so other systems can understand it. |
| 74 | + <br> And what's a method to convey information in a serialized way? Language! |
| 75 | +
|
| 76 | + <br><br> Language is just serialized data. |
| 77 | + <br> So why not make GPTs derive from language based interactions? |
| 78 | + <br> It works! |
| 79 | +
|
| 80 | + <br><br> But my question is, why did we stop there? |
| 81 | + <br> And the answer to that... |
| 82 | + <br> The newer architecture hasn't been invented yet, |
| 83 | + <br> We just aren't there. |
| 84 | +
|
| 85 | + <br><br> Keeping in mind, we haven't reached the end of development on LLMs yet. |
| 86 | + <br> There is quite a few more areas it can be deployed in that it's not yet, in useful ways, it's just taking people playing with them in pipeline to find their use cases. |
| 87 | +
|
| 88 | + <br><br> Not some flippant idea to make a buck as an app or saas, but as a support system in an asset heavy pipeline. |
| 89 | + <br> But I think it's a dead end for primarily transformer based frontier models, and luckily others in respected positions are making that known as well. |
| 90 | +
|
| 91 | + <br><br> As Yan LeCun has stepped away from Meta citing the limited future for LLMs in late 2025; to then start AMI the French ai research lab in early 2026. |
| 92 | +
|
| 93 | + <br><br> A transformer as an ai makes sense; as the primary ai, not as much. It's supposed to be a transformer, the original transformed human input into usable AI data, that was about it. |
| 94 | +
|
| 95 | + <br><br><br><div class='procPagesAIDevBar'></div> |
| 96 | +
|
| 97 | + <br><br> But... I still have my little Nova LLM running on my local network, with a Tailscale connection so my phone always appears to be at home; usually running Llama. |
| 98 | + <br> I hope it's enough protection for now, but my dev is behind whitelists. |
| 99 | + |
| 100 | + <br><br> It's part of a newer project of mine, procMessenger. |
| 101 | + <br> It's a server to manage requests from my phone, and I have scripts that act as clients to send commands to. |
| 102 | + <br> Still some file transfer bugs, binary files can't send over messages yet, work-in-progress |
| 103 | +
|
| 104 | + <br><br> You can find Nodejs & Python servers, LLM Chat python client, and Android App & APK on my procMessenger repo. |
| 105 | + <br> Either enter a llm API key, or download Llama from a list of parameter size options. |
| 106 | +
|
| 107 | + <br><br> There is a protocol and client examples for each server, so it should be easy to make custom clients connect to your server on your local network. |
| 108 | +
|
| 109 | + <br><br><br><div class='procPagesAIDevBar'></div> |
| 110 | +
|
| 111 | + <br><br> A tip to those who want a personable LLM system prompt, write it in first person. My llm doesn't talk about the system prompt and talks to me more like a person than a data retrieval database. |
| 112 | + <br> Claude generated my system prompt initially and it made my llm sound very cold... Almost annoyed to respond. |
| 113 | +
|
| 114 | + <br><br> But no matter how much I ask, it really doesn't talk about itself (the system prompt); it talks about what it's been told to do, respond as, or think like. So I've found a First Person System Prompt to work the best for my needs. |
| 115 | +
|
| 116 | + <br><br> Who knows what the real AGI and ASI architecture will look like, |
| 117 | + <br> But I'll be over here poking at resonance frequencies between neurons in a graph network. |
| 118 | +
|
| 119 | + <br><br><div class="textFullRight">- April 9th 2026</div> |
| 120 | +`; |
| 121 | + |
| 122 | +const blogEntryObj = new blogEntry(null, entryData); |
| 123 | + |
| 124 | +export { blogEntryObj }; |
0 commit comments