The silencer is only there to reduce noise, however one should probably tape/plug the hole left after cutting it so you don't get extra dirt flying in.
I did this too except I just used old rubber mousepads. The best fix I have found so far besides taking apart the dash. You really have to jam it down there, I used a rubber spatula. It's kept the dash quiet for months now, a new record.