First off-Thanks to everyone who have started/posted on this thread. My mirrors would tilt down when backing up but would not adjust in or out or up/down. After reading this forum, just did my 2004 LS430. Both mirrors work like new again. Pulling out the module was very easy-just tug straight out!! Just get your fingers tips under the lip and pull. Don't use any tools. after it's off, disconnect the three electrical clip connectors. Remove the two screws, then gently pry the switch module using a very small screwdriver or two (one on each side) from the plastic base bracket. Rock the switch back and forth to release (This was the hardest step.) Once the switch is removed, again, pry the actual switch apart with the small screwdriver(s) and open up the switch. Someone said the parts are small--that was an understatement. I cleaned the contacts with a q-tip and alcohol and did not use di-electric grease. (You can actually see the film being removed from the contacts) Reinstall in reverse order.

 

Thanks so, so much for this. Worked like a charm. A can of cleaner from Canadian Tire and mirror adjustment works again. Had figured they were goners but wondered why they still tilted in reverse. May the force be with you

 

Many thanks to the person who initiated this simple and effective repair! Good karma is n you, sir!

Tools and materials I used:
Small Phillips screwdriver for two little screws
Small flat head screwdriver to pry switch from housing
Tweezer
Electrical contact cleaner
Q-tip
Dielectric grease

I had to reassemble twice, because it wasn’t paying attention and reinstalled the switch the opposite way from how it is supposed to be; result - left toggle controlled right mirror and vice versa. Cute that it even works like that.
Once I pulled my head out of my a$$ and did it right, everything now works as it should. Total time - 15 minutes.