That's an awkward situation, since you invited the guy, his poor behavior and your lack of corrective action would reflect poorly on you, even if you reported the incident.