this post was submitted on 05 Jun 2024
813 points (98.8% liked)
linuxmemes
20986 readers
1689 users here now
Hint: :q!
Sister communities:
- LemmyMemes: Memes
- LemmyShitpost: Anything and everything goes.
- RISA: Star Trek memes and shitposts
Community rules (click to expand)
1. Follow the site-wide rules
- Instance-wide TOS: https://legal.lemmy.world/tos/
- Lemmy code of conduct: https://join-lemmy.org/docs/code_of_conduct.html
2. Be civil
- Understand the difference between a joke and an insult.
- Do not harrass or attack members of the community for any reason.
- Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
- Bigotry will not be tolerated.
- These rules are somewhat loosened when the subject is a public figure. Still, do not attack their person or incite harrassment.
3. Post Linux-related content
- Including Unix and BSD.
- Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of
sudoin Windows. - No porn. Even if you watch it on a Linux machine.
4. No recent reposts
- Everybody uses Arch btw, can't quit Vim, and wants to interject for a moment. You can stop now.
Please report posts and comments that break these rules!
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Takes a screenshot every minute and saves it
Can you search the screenshots with OCR though? That's Recall's main selling point
You can start by running
sudo apt install tesseract-ocrand then reading its docs.Fulfills the AI quota 👍
It appears to be as simple as
tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line.So something like this should do the trick:
Skip the database, just use
grepto search that directory if you need to find anything. Voilà, homemade Recall.It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer.
I’m sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isn’t exactly trivial to set up).
This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality.
For instance, Windows Recall stores OCR content tagged by app, this solution doesn’t. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that don’t have any new data.
I can't imagine it'd be that hard to write some code that does that using an existing AI model.
I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI.
You're probably right.
Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen.
Using
tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though.This is a shitpost and not a real suggestion.