Any penetration through a roof needs to be water tight, this is one of the most common areas where roofs leak.