|
| 1 | +import { baseEntryStruct, blogEntry } from '../../../js/blog/blogEntryBase.js'; |
| 2 | + |
| 3 | +const entryData = baseEntryStruct(); |
| 4 | +entryData.title = "Stop Listening to Soothsayers"; |
| 5 | +entryData.date = "2026-03-06"; |
| 6 | +entryData.eid = "A"; |
| 7 | +entryData.tags = []; |
| 8 | +entryData.body = ` |
| 9 | + Demis Hassabis, CEO of DeepMind, you've said some things in a recent talk I don't really agree with. |
| 10 | +
|
| 11 | + <br><br> In the same talk you mention a new test for AGI, |
| 12 | + <br> You also said Yan LeCun is maybe a bit misguided. |
| 13 | + <br> That "llms are a dead end" |
| 14 | +
|
| 15 | + <br><br> Demis' new test for AGI is to get recall to infer relevance in the data the ai knows. |
| 16 | + <br> But this test is basically where LLMs already are, |
| 17 | + <br> Activate neurons to cause shared neurons to fire together in the network. |
| 18 | + <br> The difference is that it is more general, that a year may cause the AI to think of an event around that year. |
| 19 | +
|
| 20 | + <br><br> Say the year 1910, does the LLM recall Einstein's 1915 "four papers"? |
| 21 | + <br> Somehow opposed to his 1905 papers, the Annus Mirabilis papers? |
| 22 | +
|
| 23 | + <br><br> This is spoofable with training. |
| 24 | + <br> An AGI's recall shouldn't be spoofable with training, |
| 25 | + <br> It should be emergent from the structure & ringing of the network itself. |
| 26 | +
|
| 27 | +
|
| 28 | + <br><br><br><div class='procPagesAIDevBar'></div> |
| 29 | +
|
| 30 | +
|
| 31 | + <br><br> I'm fairly certain that Yan LeCun is on the right path here. |
| 32 | + <br> Simply that, |
| 33 | + <br> I didn't understand why LLMs were set up to be so language dependant from maybe 2019 or so till now. |
| 34 | + <br> And then Yan LeCun admits to it being a dead end, last year. |
| 35 | + <br> So I'm left wondering if others will be tagging along with Yun or not. |
| 36 | + <br> And given the latest AI Summit, it seems that might be the case. |
| 37 | + <br> Other individuals were talking about ways to move forward from LLMs. |
| 38 | +
|
| 39 | + <br><br> I've been saying for years now that "language" is going to limit growth of ai models. |
| 40 | + <br> But of course, I'm the doof, cause, others are studying it for their job, and, I'm just an artist, or something... |
| 41 | + <br> It's funny how often people tell you what you know. |
| 42 | +
|
| 43 | + <br><br> So, yeah, I get it, but for how new AI is, well, the modern day ai is... |
| 44 | + <br> We are still in the wild west of ai development. |
| 45 | + <br> Breakthough to breakthough, |
| 46 | + <br> As I've said, and now Demis in the latest talk said. |
| 47 | +
|
| 48 | + <br><br> He mentioned we need a new way to think about our data. |
| 49 | + <br> That AI needs to be reactive, or in my words, dynamic. |
| 50 | + <br> But he's still talking about context windows. |
| 51 | +
|
| 52 | + <br><br> Resonance isn't a context window. |
| 53 | +
|
| 54 | + <br><br><div class="textFullRight">- March 6th 2026</div> |
| 55 | +`; |
| 56 | + |
| 57 | +const blogEntryObj = new blogEntry(null, entryData); |
| 58 | + |
| 59 | +export { blogEntryObj }; |
0 commit comments