First thing is, I think there’s a larger square fuse that can go bad and produce all kinds of crazy behavior with the power window operation. This is relatively simple and inexpensive to replace, and just might be your problem. Just can’t be sure.
Next, just so you can know, the wires that supply the power to the power window master control at the driver’s door are contained in a protective encasement coming from the main body of the vehicle and entering the driver’s door in the jamb area of the door, only visible when you open the door. what this means is that over time the repeated opening and closing of this door can possibly cause wear and damage to the wiring in that encasement, including those supplying the power windows. This can also be the possible source of your problem.
Need to know more specifics about your vehicle (year, make, model, sub-model, etc.) to consult ''your'' wiring diagram, in order to come up with more possibilities.
Otherwise, it’s a matter of accessing the power window wiring, switches and relays, etc., by removing the interior door panel, and using a multi-meter (or voltage indicator) to test the circuits and switches, etc., for voltage, to eventually identify the problem.