I have a 2003 LS430 Non ML speakers the right one is clapped if I replace it do I have to be specific on the one for each side i.e Right Rear

 

If you are replacing the speakers with OEM speakers, yes, because the front and rear speaker housing is different due to how it mounts in the door. In the picture the front speakers are on top and the rear speakers are on the bottom. If you're replacing them with aftermarket speakers, no, but you may need adapter plates to mount them correctly. If going with aftermarket speakers, be aware that the OEM speakers are 2 ohm and most aftermarket speakers are 4 ohm, which can cause issues.