There may also be a contact in/under the passenger seat that detects if there is a passenger in the seat. You may want to check that too. If it's not working as it should the passenger seat belt light may be inconsistent.
If you drive with stuff in the passenger seat it may of course also be the problem. My camera bag does sometimes trigger the passenger detector contact causing the seat belt buzzer to go off.