This is a fairly common problem and is also on subaruoutback.org. https://www.subaruoutback.org/threads/gear-shift-indicator-light-out.473017/
They are LEDs - part of an assembly that is $60-70+. I am going to try to test the LEDs and maybe resolder some of the joints. Below is listed as the part but I have not verified.
Housing - Subaru (35170AL00A)
List Price: $95.82
You Save: $19.93 (20.80% off)
Sale Price: $75.89