This goes more for maps like Volskaya Industries or Infernal Shrines and even Alterac. If your team has a hero that can hold out the target point long enough or get the most skulls, you don't need to hang around next to him, it's something I've seen a lot even in Grand Master games.
Here is a list of things you can do while one or two of your team finish an objective.
-Take their camps for a massive split push
-Crash your waves onto the enemy towers (this denies XP)
-Recall and prepare for the next fight
You can ask your team to wait for you before finishing an objective. Please, stop killing the last skull with 5 people, doesn't make any sense.