It could be any of a number of things. Your traffic is still encrypted on the physical link and that takes time. Try QOS to prioritize the video traffic.
What product and version are you running? How fast is the link? What else is running on the link that needs bandwidth?
Regards,
David