Maybe it's time we invent JPUs (json processing units) to equalize the playing field.
this post was submitted on 14 May 2024
1354 points (99.1% liked)
Programmer Humor
32558 readers
1000 users here now
Post funny things about programming here! (Or just rant about your favourite programming language.)
Rules:
- Posts must be relevant to programming, programmers, or computer science.
- No NSFW content.
- Jokes must be in good taste. No hate speech, bigotry, etc.
founded 5 years ago
MODERATORS
The best I can do is an ML model running on an NPU that parses JSON in subtly wrong and impossible to debug ways
Just make it a LJM (Large JSON Model) capable of predicting the next JSON token from the previous JSON tokens and you would have massive savings in file storagre and network traffic from not having to store and transmit full JSON documents all in exchange for an "acceptable" error rate.
Hardware accelerated JSON Markov chain operations when?
load more comments
(1 replies)
Latest Nvidia co-processor can perform 60 million curly brace instructions a second.
load more comments
(2 replies)
load more comments
(1 replies)
Well, do you have dedicated JSON hardware?
Please no, don't subsidize anything Java-Script. It will only make it less efficient.
My thoughts on software in general over the past 20 years. So many programs inefficiently written and in 4th level languages just eats up any CPU/memory gain. (Less soap box and more of a curious what if to how fast things would be if we still wrote highly optimized programs)
Answer: there'd be far less software in the world, it would all be more archaic and less useful, and our phones and laptops would just sit at 2% utilization most of the time.
There's an opportunity cost to everything, including fussing over whether that value can be stored as an int instead of a double to save 8 bits of space. High level languages let developers express their feature and business logic faster, with fewer bugs, and much lower ongoing maintenance costs.
Even if our apps used resources better the adware will just use the free space.
load more comments
(1 replies)
@Randelung @seaQueue well, i have dedicated JavaScript hardware (https://developer.arm.com/documentation/dui0801/h/A64-Floating-point-Instructions/FJCVTZS)
The R in ARM and RISC is a lie.
The website title says "Arm Developer", not "ARM Developer", in a clearly non-acronym way so it's a guide for making prosthetic hardware. Of course you want a cyborg arm to parse JS natively, why else even get one?
load more comments
(2 replies)
load more comments
(6 replies)
You don't?
load more comments
(1 replies)
Everybody gangsta still we invent hardware accelerated JSON parsing
https://ieeexplore.ieee.org/document/9912040 "Hardware Accelerator for JSON Parsing, Querying and Schema Validation" "we can parse and query JSON data at 106 Gbps"
106 Gbps
They get to this result on 0.6 MB of data (paper, page 5)
They even say:
Moreover, there is no need to evaluate our design with datasets larger than the ones we have used; we achieve steady state performance with our datasets
This requires an explanation. I do see the need - if you promise 100Gbps you need to process at least a few Tbs.
load more comments
(5 replies)
load more comments
(4 replies)
That is sometime the issue when your code editor is a disguised web browser 😅
No, if you're struggling to load 4.2 mb of text the issue is not electron.
there are simd accelerated json decoders
Would you rather have 100,000 kg of tasty supreme pizza, or 200 kg of steaming manure?
Choose wisely.
200kg of steaming manure would be pretty sweet if you had a vegetable garden
Not sure if I'm just missing a reference here, but if you choose the pizza you can have both.
load more comments
(1 replies)
load more comments
(3 replies)
load more comments
(3 replies)
CPU vs GPU tasks I suppose.
GPU, render my 4.2 MB json file!
I'm afraid I can't do that, Dave
I have the same problem with XML too. Notepad++ has a plugin that can format a 50MB XML file in a few seconds. But my current client won't allow plugins installed. So I have to use VS Code, which chokes on anything bigger than what I could do myself manually if I was determined.
Time to train an LLM to format XML and hope for the best
Do we need a "don't parse xml with LLM" copypasta?
load more comments
(4 replies)
Someone just needs to make a GPU-accelerated JSON decoder
Works fine in vim
Except if it's a single line file, only god can help you then. (Or running prettier -w on it before opening it or whatever.)
load more comments
(9 replies)
view more: next ›