What Are RTSP and ONVIF? Connecting IP Cameras to AI Video Analytics

The two standards that make it possible to add AI analytics to mixed-brand camera estates — explained without jargon.

5 min readBy the Hype Vision engineering team

RTSP (Real Time Streaming Protocol) is the common way to pull a live video stream from an IP camera or network video recorder (NVR). ONVIF is an industry standard that lets devices from different manufacturers be discovered and configured in a common way. Together, they are why an analytics system can usually work with cameras that are already installed.

How RTSP works

A client — a VMS, a media player or an analytics server — connects to the camera’s RTSP address with credentials and requests a stream. RTSP handles session control; video data is usually carried over RTP. The address format varies by manufacturer and typically includes the IP address, a port (often 554) and a stream path.

Main stream vs sub-stream

Most cameras offer a high-resolution main stream for recording and a lower-resolution sub-stream for live view. Which one analytics should use depends on the task: detecting a person in a zone may work on a sub-stream, while checking safety glasses usually needs the main stream.

What ONVIF adds

  • Profile S: basic streaming and configuration — the most widely supported.
  • Profile T: advanced streaming (e.g. H.265) and event handling.
  • Profile G: on-device recording and retrieval.
  • Profile M: analytics metadata and events.

ONVIF conformance applies to specific profiles; manufacturer-specific features may sit outside the standard. Check the vendor’s declaration for the exact device.

Security best practice

  • Never expose RTSP ports to the internet; keep cameras on a segmented network.
  • Change default passwords and create a view-only account for analytics.
  • Use VPN for any remote access.

Hype Vision connects to existing cameras over these standards and processes video on-premise. To check your cameras, request a camera assessment or read how to evaluate cameras for computer vision.

Not sure what is feasible on your site? Send a few camera frames and your use case.

Evaluate your cameras

Frequently asked questions

Can analytics connect through the NVR instead of each camera?

Often yes, if the NVR can serve the required number of simultaneous streams without re-encoding them to low quality.

What about analog cameras?

They need an encoder or DVR that exposes an IP stream; older analog image quality may limit what can be detected.