Futurology

1801 readers

65 users here now

founded 1 year ago

MODERATORS

Researchers say their open-source AI model LLaVA, is as powerful as GPT-4 Vision, which was released only weeks ago. (llava-vl.github.io)

submitted 1 year ago by RewindAgain to c/futurology

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] BetaDoggo_@lemmy.world 1 points 1 year ago

It's not even close, less than half of 3.5's 85.5% in ARC. Some larger Open models are competitive in Hellaswag, TruthfulQA and MMLU but ARC is still a major struggle for small models.

3Bs are kind of pointless right now because the machines with processors capable of running them at a usable speed probably have enough memory to run a 7B anyway.

permalink
fedilink
source
parent