Could be small or big.
My answer has always been that, Linux can't handle everything I'd ask out of it that I normally can with Windows. I know the games issue has been progressing far from the days when that used to have been an archaic flaw with Linux for the longest time. Games might not be the issue except for some concerns I have for some games.
I was taking some time a few moments ago, to check if a program called Firestorm Viewer would work on Linux Mint which could've been my distro of choice. And the description written on the linux page described exactly the kind of concerns I'd have for compatibility and usability from going Windows to Linux.
They said that their viewer was tested and designed to function mostly with Ubuntu and while it could work with other distros, it's not to be expected to be smooth.
That's the kind of sentiment and concern I have always had with Linux if I were to go from Windows to it. There are programs and tools on Windows that I have that are used for specific purposes and I know they will not function on Linux. Furthermore, incase anything breaks down, any and all solutions would only be applicable to that thing that would be far easier to solve than just being SOL if I was on Linux.
It is something as a user that I just can't simply afford to deal with on a regular basis if I made the switch.
So while I may not have too much of an issue running games, I won't have too much of an issue using alternatives, I won't have to deal with the Windows ecosystem .etc I will just be running into other walls that would simply make me second guess my decision and make me regret switching to the point where I would dip back into Windows in a hurry.
I have about 7 or 8 machines running some version of linux. I try to switch as a daily machine every decade or so and works fine for a couple of weeks. Then something needs an update, that update then updates some dependencies which breaks a half dozen other programs. Half of those have new updates for it the other half dont. Of the half that do about half of those also update even more dependencies which then breaks even more programs. This spirals for a month or two sometimes settling out sometimes not. Eventually i get tire of fixing the machine and just want to use it so i go back to my windows box i havent had to fuck with since i put it together. Wait a decade or so and the cycle repeats. Just waiting on that time when the cycle breaks and im still using a linux box. Maybe another 30 some odd years and it will be ready.