Excluding hardware (microcode, UEFI, etc); within my Linux system, the only proprietary software I have installed are Nvidia drivers and Steam (installed via flatpak). When I first made the switch to Linux, I was actually shocked at the minimal amount of proprietary software I actually used/needed.
I’ve had this exact same issue with a Nintendo Switch Pro Controller; IIRC, my fix was disabling Steam input.