I'm with those above who said leave it in place for a while as long as it isn't causing problems. Yes, there's the cleaning factor and keeping her fingers off if it, but I'd hate to be in a position to NEED it later on and not have it anymore. Like Heather, I too used to hope that Emily's button would be gone by the start of kindergarten. But now, it's just not that important to me. If it's there, it's there. And I do LOVE that she gets meds through it. Can't imagine how we'll get her to take them orally once it's gone. She gags at the smell of some of her antibiotics.
Good luck with your decision, and DO make sure everyone's on board.