In today’s video production and streaming environment, the requirement for efficient, high-quality, and low-latency video compression is essential. One of the newest introductions in the world of video compression standards is the JPEG XS, which can fulfill these exact needs. The goal behind developing this visually lossless compression at low latency is to transform IP-based video workflows, especially in remote production models and live event streaming.
This article will provide a detailed guide on JPEG XS, exploring its technical specifications, applications, and impact on broadcasting and video production. We will also discuss the pros and cons of adopting this technology and help you understand whether it is the right choice for you.
What is JPEG XS? And What’s Its Purpose?
JPEG XS is a video compression standard developed by the Joint Photographic Experts Group Committee (JPEG) to satisfy the evolving demands of virtual reality, real-time image processing and video editing. Unlike the traditional JPEG used for still images, JPEG XS is optimized to maintain original image fidelity and offer users visually lossless compression with minimal latency.
Besides featuring low latency and high-quality compression, it prioritizes low computational complexity. Its efficiency enables JPEG XS to be utilized in conditions with limited processing power, such as automotive, broadcasting, and aerospace industries. JPEG XS meets the criteria for real-time and high-quality image and video transmission across a broad range of modern tools by balancing the need for image quality, processing speed, and compression efficiency.
What are the key features of JPEG XS?
Visually Lossless Compression: JPEG XS offers compression without significant visual loss, ensuring the video quality stays virtually indistinguishable from the original content. It is particularly important in professional settings where you need high visual fidelity.
Low Latency: One of the significant features you receive from this format is its low latency. JPEG XS is designed to minimize the delay that occurs during the compression and decompression processes, making it ideal for real-time applications such as remote production or live streaming.
Scalability: JPEG XS is highly scalable, with various supporting resolution and chroma subsampling schemes. Whether you want to compress video for high-end broadcast applications or consumer-grade scheming, this format will suit all your specific requirements.
Broad Platform Support: You can implement JPEG XS in multiple hardware platforms, including FPGA, ASIC, CPU, and GPU. This broad support indicates that the standard is highly usable for a wide range of environments, from high-performance broadcasting equipment to more modest consumer devices.
Supporting Multiple Pixel Format: JPEG XS supports multiple pixel formats, including 4:4:4, 4:2:2, RGB, and RAW Bayer. This flexibility allows you to use this standard for high-end professional video and casual consumer uses.
IP Workflow Compatibility: JPEG XS is fully compatible with IP-based workflows, making integrating into modern production environments easier. Part 22 of the SMPTE ST 2110 standard explicitly addresses transporting JPEG XS compressed video over IP networks to ensure seamless interoperability with the existing systems.
Technical Overview of JPEG XS
Compression Ratio: JPEG XS delivers high-quality compression with typical ratios of up to 10:1 for various chroma subsampling formats such as 4:4:4, 4:2:2 and 4:2:0. However, you can adjust this compression ratio based on your specific requirements or the applications you are using. For example, the bandwidth will be limited when you use high compression ratios, while low ratios can be employed to preserve maximum visual fidelity.
The Encoding and Decoding Process: The encoding process in JPEG XS includes several methods, such as color space transformation, entropy coding, and quantization. The color space transformation process includes converting the input video into a format essential for compression. Next, the wavelet transformation decomposes the images into multiple-frequency bands for efficient data reduction. Quantization and entropy coding further compress the data, resulting in a compact bitstream that can easily transmit over IP networks.
The decoding process is basically the reverse of encoding, where the compressed bitstream is decoded back into the original video format. Due to the low complexity of the decoding process, the video can be rendered in real-time, making JPEG XS an ideal tool for live applications.
Supporting Multiple Platforms: The JPEG XS is designed to support a wide range of hardware platforms, keeping flexibility in mind. FPGA (Field-Programmable Gate Array) and ASIC (Application-Specific Integrated Circuit) implementations provide users with hardware-accelerated encoding and decoding. The goal is to offer high performance with low energy consumption. And for software-based deployments, you can run JPEG XS on CPUs and GPUs to make it accessible to a broader range of devices, including consumer-grade hardware.
Integration with SMPTE ST 2110: The SMPTE 2110 standard represents a suite of protocols for professional media over managed IP networks. Part 22 of this standard specifically indicates JPEG XS compressed video transport. This integration ensures you can use JPEG XS for professional broadcast environments where high compatibility and reliability with the existing infrastructure are vital.
Applications of JPEG XS
Remote Production (REMI):
Remote Production, also known as REMI (Remote Production Model), has recently gained popularity, particularly in sports and events. Remi allows a production team to work remotely, reducing the need for extensive equipment and personnel on-site. With its low latency and high-quality compression, JPEG XS is ideal for these remote applications. It enables real-time video transport over IP networks without compromising the visual quality.
Live Event Streaming:
Live event streaming, such as sports, concerts or other events, requires high-quality video with minimal delay. JPEG XS can fulfill this need by offering necessary compression and low latency, ensuring the audience will receive an immersive and seamless viewing experience. In addition, its compatibility with IP workflows makes it much easier to integrate this format with advanced streaming infrastructures.
Broadcast and Media Production:
JPEG XS is an amazing alternative to existing compression standards such as H.264 or H.265 in traditional media and broadcast production environments. It has low latency and high visual quality, making it suitable for real-time applications such as news broadcasting, where delays need to be minimized. In addition, this format supports multiple pixel formats and chroma subsampling schemes for greater flexibility in production workflows.
Visual Reality (VR) and Augmented Reality (AR):
Virtual and Augmented Reality applications need high-quality video with low latency to offer users an immersive and seamless viewing experience. JPEG XS's low latency compression makes it an excellent tool for these sectors, where video content should be delivered in real-time without any noticeable delays or artifacts.
Advantages & Disadvantages of JPEG XS
The JPEG XS compression format has emerged as a highly efficient technique for coding high-quality images with low latency. However, like any new technology, technical professionals must understand its strengths and weaknesses before integrating it into their projects.
Advantages:
-
Ultra-low Latency: With less than ten milliseconds of latency, it is helpful for real-time applications. It will ensure smooth interaction and streaming without noticeable delay.
-
Efficient for different devices: It is designed to work seamlessly across different devices. Whether you are looking for high-end broadcast equipment or regular consumer electronics, it will ensure wide applicability.
-
High Quality: The format offers near-lossless images, helping to preserve clarity and minute details critical for any professional setting.
-
Bandwidth-Friendly: By compressing the video data, JPEG XS helps reduce the bandwidth needed for transmission, reduce cost, and improve network efficiency.
-
Reducing The Computational Complexity: Using efficient algorithms, JPEG XS is a software and hardware-friendly tool that provides seamless integration into existing workflows. It also requires less CPU power than other codecs such as VVC, HEVC, or AVC.
Disadvantages
-
It is a new standard: JPEG XS is a new compression standard that has yet to gain worldwide adoption and support compared to other established formats, such as H.264 or H.265. It may limit its applicability in many cases.
-
Higher Bitrates: While JPEG XS provides visually lossless compression, this results in higher bitrates than other compression standards. This could be a challenge where bandwidth is limited, as higher bitrates demand a more complex network infrastructure.
-
Complexity in Implementation: JPEG XS has complex encoding and decoding processes, making it a highly-performing tool. However, this may complicate its implementation, especially for software-based deployments. You need additional development resources and expertise, ultimately increasing the cost and time to deploy the JPEG XS.
-
Limited awareness and Adoption: Still a new compression standard in the market, JPEG XS is not as well-known and adopted as its older standards. This results in a lack of awareness among users about its potential benefits and features, limiting its uptake in many applications or industries.
-
Potential for Overkill: Advanced features such as low latency or high visual quality are sometimes more than we need for an application. For instance, in some cases, latency is not an important factor. So, using additional complexity and higher bitrates of JPEG XS is not required at all.
Difference Between Traditional JPEG vs. JPEG XS
When we compare JPEG XS with traditional JPEG, we demonstrate two different sets of priorities for image compression. Traditional JPEG has been used for digital images for a long time. It is popular for reducing file sizes and making the storing and sharing of images seamless, even if you have limited disk space. On the other hand, JPEG XS is the newest version that focuses on maintaining high-quality images and speed for real applications and streaming purposes. To give you a clear idea, we have come up with some key differences between these two in the section below,
Compression
-
The traditional JPEG is for file size reduction, even at the cost of degraded image quality.
-
JPEG XS focuses on providing near-lossless compression and maintaining high-quality images.
Hardware
-
With traditional JPEG, you can easily decode it using low-power devices because it is less demanding on hardware.
-
JPEG XS is more computationally complex, with critical encoding and decoding processes involved for high fidelity and low latency.
Latency
-
Delays can occur in traditional JPEG compression, which comes as a potential issue for interactive and live-streaming applications.
-
JPEG XS features low latency, which makes it ideal for real-time applications and broadcasting videos.
Applications
-
Web images, photography, or other situations that require high compression over the best quality are commonly captured using traditional JPEG.
-
But the theJPEG XS flourishes in sectors like medical imaging, broadcasting and production, VR and AR technology, video feeds or other applications where maintaining the original details in high-speed transmission is essential.
What the future holds for JPEG XS?
JPEG XS aims to play a significant role in the future of video compression, especially for IP-based workflows and real-time applications. With increasing adaptation and excellent hardware support, JPEG XS will likely become a preferred choice for live events and professional media production. Its incredible combination of high visual quality, low latency and scalability makes it a compelling tool for a wide range of use cases.
In the upcoming years, we expect JPEG XS to be integrated into more platforms and devices to solidify its future position in the tech industry. In addition, as the requirements for high-quality and low-latency videos continue to increase, JPEG XS will likely gain more traction in emerging markets such as VR and AR.
