KrasnaiaZvezda

joined 10 months ago
[–] KrasnaiaZvezda@lemmygrad.ml 3 points 2 weeks ago (1 children)

Very unconfirmed so far but if there was indeed a new, and reasonably good, LLM trained without nvidia chips it would signal that alternatives exist, at least for the smaller models, and hopefully would drive down prices of chips needed for training or using such models by individuals and small groups as well, allowing for a lot more specialization of small LLMs for all sorts of tasks.

[–] KrasnaiaZvezda@lemmygrad.ml 9 points 1 month ago (4 children)

From what I remember from a few months back the H100 GPU (I think) cost something like 30k and there were a few companies each buying up to 100k of them so something like this makes sense.

So if the demand for this GPUS don't continue high, which is possible as the newer LLMs are smaller and much better while not taking as much compute to run after trained, then what matters is by how much this deman will fall as I really doubt the demand will fall to 0 but we could be one development away from the deman tanking, being maintained or even going up.

[–] KrasnaiaZvezda@lemmygrad.ml 8 points 1 month ago (1 children)

The first version needs people to teach it but it already costs less than paying for a worker in many cases.

The second will still need some coaching in some case but will do almost everything by itself out of the box.

The third will know even more and will be much more efficient and cheaper.

By the fourth or fith version their existance and number will likely have completely reshaped how work works making it clear to people that in the not distant at all future no one will need to work again.

...

[–] KrasnaiaZvezda@lemmygrad.ml 6 points 2 months ago

Ast it advances further if you get it you won't even be sure if you are really in reallity or trapped inside of it anyaway, unless you make your own, so I will let this tech for others or will wait until I can make my own.

[–] KrasnaiaZvezda@lemmygrad.ml 6 points 2 months ago* (last edited 2 months ago) (1 children)

Frankly, AI might have its uses, and I’ve found it useful here and there, but perhaps the cons outweigh the pros…

If I used a knife to write I shouldn't be surprised that I don't get good results. The other way around as well.

Present AIs/LLMs, like any other tool, has its places to shine and places where you shouldn't even think about using it, but as a new tool we are still figuring everything out while at the same time new versions are appearing. So we should be careful about how we use it, but for what it works great it should be used as any other tool and hopefully it gets used more and more for the people rather than for capital.

edit to better reply to you: The biggest con of AIs right now is capitalism.

How does a country like Vietnam or China tackle AI?

I don't know how they are using it but I'll give a few ideas about how they could be used to help improve countries, like:

A simple use is to try to get rid of as much work/human hours of work as possible and distribute this time to the whole population to enjoy life. In such a case it would be much easier to ask everyone to work hard to make new data to train the AIs to replace then by basically writing everything as if explaining to a new worker or giving the AI your emails, or even recording your talks with coworkers, to make more good quality data that will reduce everyone's workload.

Also, if a country were to ask each person to write a text about their lives, their strenghts, theirs problems, and an AI was trained on it the government, and the people, could ask it about what should be fixed in the country, how things could be fixed, and such things. Even if LLMs were simple "next token predictors" asking it to explain what people see as problems and how people think they can be solved could help governance in a Communist country massively.

I'm sure there are even better things to do though.

[–] KrasnaiaZvezda@lemmygrad.ml 29 points 2 months ago

Hope this means they can begin exporting chip making equipment undercuting and undermining western industry while making the lives of people from the Global South better by helping decrease the price of chips globally. Good job everyone!

[–] KrasnaiaZvezda@lemmygrad.ml 3 points 2 months ago

They can just make their money back through the IPO, so as long as the company is seen as valuable and promissing, as it still is, they won't really care about its losses.

[–] KrasnaiaZvezda@lemmygrad.ml 5 points 2 months ago (2 children)

I don't think that's how tech companies work. Rarely any of them make a profit at the start and survive from investiments, and considering how impactful AI is OAI has no need to make a profit for a long time unless some company comes up with something so much better than them and monopolizes the whole market overnight or something like that.

[–] KrasnaiaZvezda@lemmygrad.ml 7 points 2 months ago (4 children)

Embodiment and things like it are a good one. Giving then the ability to interact with the world and basically use its interactions with the world itself to tell it if it succeded or not, leading to high quality data that can then be used to improve the next models. And having a way to use this to train the model itself, instead of the next gen, would be even better.

[–] KrasnaiaZvezda@lemmygrad.ml 1 points 2 months ago (1 children)

Any chance of suing them or something like that?

Would be nice to see some extra blowback from this too.

[–] KrasnaiaZvezda@lemmygrad.ml 5 points 3 months ago

I wonder how long it would take for them to either go broke or require massive state support once China not only can make their own but can also export such machinery as well.

Either way, it will be quite funny. lol

[–] KrasnaiaZvezda@lemmygrad.ml 2 points 3 months ago

That would be nice.

Doing some math here even an aluminium (if this material is fine) foil 1 nanometer thick (if this thickness is fine) with one tenth the radius of the Earth (1% of the area of the Earth) would require enough almost 3 thousand tons. That's should be doable with current tech within a few years to a couple of decades even if you need a few times this mass to carry orbit keeping equipment although it would be a huge project unless some lighter material could be used.

But if the foil needed to be any thicker/heavier than this then it might be easier to do with asteroid mining/in space production.

view more: next ›