My rear windows randomly stopped working from the main driver switch but still work from the rear doors. it start just doing it every once in a while now its always.

You say the driver window works? wouldn't be a main fuse or fusible link then -driver door locks and window wouldn't work either. Each door has a module inside (computer) . The driver door has a circuit breaker power feed an a fuse DDM fuse 10amp located in rear junction block circuit breaker is located in under hood maxi fuse block. The circuit breaker also feeds battery voltage to the other door modules too. PDM - passenger door module fuse 10amp located in the instrument panel fuse box and the RDM - rear door module RDM fuse 10amp located in the rear fuse box - under the back seat.

Each power window is connected to a permanent magnet motor. The motor raises or lowers the glass when the door module applies voltage to the motor. The direction the motor turns depends on the polarity of the supply voltage provided by the associated door module. The 2 front doors have their own separate modules. The rear seat contains a single module, which controls both of the rear power windows.
A serial digital communications link, called the simple bus interface, is used for communications between door modules and the driver's door power window switches. The use of serial digital communications allows the use of a single wire to convey switching information between the power door lock switch and the driver's door module (DDM). The serial communication is also used in order to transmit switching information from the DDM to the other 2 door modules.
The door modules apply battery voltage of the correct polarity to the respective window motor when any local, or power door lock switch, UP switch is operated, driving the window up. Battery voltage is applied to the respective window motor in the opposite polarity when any local, or power window switch, DOWN switch is operated, driving the window down.

Driver Door Module (DDM)
The driver's door module (DDM) directly controls the driver's door window motor and the express down window feature. The DDM sends window UP/DOWN messages received from the power door lock switch to the passenger door module (PDM) and to the rear door module (RDM) over the simple bus interface (SBI) line. The DDM also contains a class 2 data link which communicates with the other vehicle system modules. The left front power door locks and the outside power mirror are also controlled through the DDM.
Passenger Door Module (PDM)
The passenger door module (PDM) controls the passenger's door window motor. The PDM controls the passenger's door window directly from the right front power window switch or from instructions over the simple bus interface (SBI). The right front power door locks and the outside power mirror are also controlled through this module.
Rear Door Module (RDM)
The rear door module (RDM) controls both of the rear door window motors. The RDM controls the rear windows directly from the rear door window switches or from instructions over the simple bus interface (SBI).

Look at the end of the dash and between the drivers side door for a second fuse panel. I think everything you mention works on one data bus. You can remove the button pad on the drivers door. Since it gets used all th3 time i# might have gone bad messing up the works.

You should be able to operate window from main front switch regardless if rear switch is bad. If it does not work from rear door or front door, it is probably not the switch, but the window motor which do go quite often. Take switch and verify it is working by testing with volt meter, next, check to see if you have 12VDC at switch, could be a broken wire, another common problem with older cars.
CeraCoat-NanoTech.com

Check if all of the windows (except the drivers window) work from the main switch, and from the window switches on each door. If the windows all work from the doors switches, you have a bad master (main) panel controlling the drivers door window. If the windows don't work from any switch, check for a fuse issue, or a pinched wire in the tube from the door hinge area to the door.

Maybe a broke wire inside the rubber boot from the body to the door ! See this a lot. Opening an closing the door a million times . Do you have a volt meter ? Pull the switch from the door an test for B+ voltage on the brown wire at pin G connector 1 The other window switches get B+ from the drive door switch . Also check the ground , black wire pin B connector 1 . Do you know how to use a DVOM - digital volt ohm meter ?
Videos on youtube .

it prys out from the rear and then the front lifts out. start from the rear of the switches

I would say the switch is going bad. That is the main switch. If regulators was bad i don't really think they all would go bad at once, so that is why i say main switch. Might find one at junk yard. Easy to replace.

Look for window relay on fuse box inside car or at motor compartment Once You find it switch it for another from a window that You know it works, if no thing happen, pull switch of the door, at main left door and by pass the wires, with an" U" shaped wire, see if works, if not, pull door panel off, brake nylon locate the window motor and tap it with hammer wile pressing switch going up, If is Your driver window,that's the first one to go bad

Should change drivers front switch. If neither rears work and main switch don operate them then it is the drivers control that is bad.