Its interesting to see so much investor money chase AI unicorns at the moment. Something tells me many of them might be making the wrong bets.
I'm still avoiding reddit out of principle, might check on that eventually but I'll make at least a token effort to find the answers elsewhere first.
If you are comfortable with python, check huggingface.
To see how to set up a gui, check https://github.com/camenduru/text-generation-webui-colab to test models on colab.
You can copy the commands there and adapt to have it locally
I'm still avoiding reddit out of principle, might check on that eventually but I'll make at least a token effort to find the answers elsewhere first.
If you are comfortable with python, check huggingface.
To see how to set up a gui, check https://github.com/camenduru/text-generation-webui-colab to test models on colab.
You can copy the commands there and adapt to have it locally