There may be a reason why no one grew up in Neverland.
Peter Pan was an Angel of Death that held kids hand when on their way to heaven (Neverland). That's why they never grew up. All those kids were dead.
(I just so this on Pinterest. And it made sense to me.)