I sent my son to boarding school and he came back on his birthday, so I missed him age up. They don't go to prom, at least I don't think they do, and no field trips.
Since you have aging off, he will never come back. In order for him to come back you have to either use the phone or the computer to bring him home, or you have to turn aging back on.