Encourage "by invitation only" activities.
Never permit "party crashers"; use a guest list.
Be a visible, active host. Tell guests who choose to leave the activity they may NOT return. Call the parents of the youth who leaves and inform them so they will know you are no longer supervising their child.
NEVER allow anyone "under the influence" to leave (MUST be with an adult). Call the parent or police.