this post was submitted on 15 Nov 2024
1257 points (99.5% liked)
Science Memes
11448 readers
948 users here now
Welcome to c/science_memes @ Mander.xyz!
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
- Don't throw mud. Behave like an intellectual and remember the human.
- Keep it rooted (on topic).
- No spam.
- Infographics welcome, get schooled.
This is a science community. We use the Dawkins definition of meme.
Research Committee
Other Mander Communities
Science and Research
Biology and Life Sciences
- !abiogenesis@mander.xyz
- !animal-behavior@mander.xyz
- !anthropology@mander.xyz
- !arachnology@mander.xyz
- !balconygardening@slrpnk.net
- !biodiversity@mander.xyz
- !biology@mander.xyz
- !biophysics@mander.xyz
- !botany@mander.xyz
- !ecology@mander.xyz
- !entomology@mander.xyz
- !fermentation@mander.xyz
- !herpetology@mander.xyz
- !houseplants@mander.xyz
- !medicine@mander.xyz
- !microscopy@mander.xyz
- !mycology@mander.xyz
- !nudibranchs@mander.xyz
- !nutrition@mander.xyz
- !palaeoecology@mander.xyz
- !palaeontology@mander.xyz
- !photosynthesis@mander.xyz
- !plantid@mander.xyz
- !plants@mander.xyz
- !reptiles and amphibians@mander.xyz
Physical Sciences
- !astronomy@mander.xyz
- !chemistry@mander.xyz
- !earthscience@mander.xyz
- !geography@mander.xyz
- !geospatial@mander.xyz
- !nuclear@mander.xyz
- !physics@mander.xyz
- !quantum-computing@mander.xyz
- !spectroscopy@mander.xyz
Humanities and Social Sciences
Practical and Applied Sciences
- !exercise-and sports-science@mander.xyz
- !gardening@mander.xyz
- !self sufficiency@mander.xyz
- !soilscience@slrpnk.net
- !terrariums@mander.xyz
- !timelapse@mander.xyz
Memes
Miscellaneous
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not advanced maths per se; neural networks are amazing! Fuzzy matching based on experience - taken to an incredible level. And, tuneable by internal simulation (imagination).
Don't be fooled to think computer neural networks is how the brain is structured. Through out history we've always compared the brain to the most advanced technology at the time. From clocks, to computers with short and long term memory, and now to neural networks.
That is a good point, though the architecture of computer neutral networks is inspired by how we think the brain works, and if I understand correctly there is some definite similarity in the architecture.
Lots of difference though, still!
I would guess that every statement made is kind of true. It is a clock, a computer and a LLM,...
I would even go as far as LLM is the closest to a functioning brain we can produce from a functional perspective. And even the artificial brains are to complex to understand in detail.
I reckon we can get a lot closer than an LLM in time. For one thing, the mind has particular understanding of interim steps whereas, as I understand it, the LLM has no real concept of meaning between the inputs and the output. Some of this interim is, I think, an important part of how we assess truthfulness of generated ideas before we put them into words.
I experimented with rules like : "Summarize everything of our discussion into one text you can use as memory below your answer." And "summarize and remove unnecessary info from this text, if contradictions occur act curious to solve them"... simply to mimic a short term memory.
It kind of worked better for problem solving but it ate tokens like crazy and the answers took longer and longer. The current GPT4 models seem to do something similar in the background.
I think that's still different from what I'm thinking of of interim steps, though.
...but as I think how to explain I realize I'm about to blather about things I don't understand, or at least haven't had time to think about! So I'd better leave it there!
I would really like to get into LLM and AI development but the math.....woosh right over my head.
there is certainly math going on in the brain at various levels, both equivalent models and identical sorts of calculations, it's not just fuzzy matching.
But probably not calculating trigonometry and calculus when juggling, right?
almost certainly doing those things and more (especially lin alg and diffeq solutions, and who knows what equivalent mathematical representations). Why wouldn't it? even stereotyped, there are subtle feedback variations you need to account for.