Thera: Image Upscaling at Any Scale While Preserving High Quality 193

小编 ·

Thera: Image Upscaling at Any Scale While Preserving High Quality

Thera is a super-resolution method based on neural heat fields that enables aliasing-free, lossless image upscaling. Through a built-in physical observation model, it ensures high-quality image output at any upscaling factor, applicable to image enhancement, video upscaling, medical imaging, security surveillance, and more. Thera is jointly developed by ETH Zurich and the University of Zurich.

Thera: Image Upscaling at Any Scale While Preserving High Quality

What is Thera?

Thera is a super-resolution method based on neural heat fields that enables aliasing-free lossless image upscaling. Through its built-in physical observation model, it ensures high-quality image generation at any upscaling factor, and is applicable to fields such as image enhancement, video upscaling, medical imaging, and security surveillance. Thera was jointly developed by ETH Zurich and the University of Zurich.

Thera效果对比.webp

How Thera Works

Thera uses a hypernetwork to estimate the parameters of pixel-level local neural heat fields. Through globally learned components and a heat activation mechanism, it adjusts image details based on frequency and the target upscaling ratio, ultimately generating continuous local neural fields that are rasterized for output.

Thera工作原理.jpg

Thera Features

  • Arbitrary-scale super-resolution: Thera supports image upscaling at any scale, allowing flexible adjustment of the upscaling ratio as needed.

  • Aliasing-free: Through its built-in physical observation model, Thera is designed to deliver proper anti-aliasing, avoiding the edge blurring and jagged artifacts commonly seen during image upscaling.

  • Neural heat fields: Uses a hypernetwork to estimate the parameters of pixel-level local neural heat fields, and adjusts image details based on frequency and the target upscaling ratio through globally learned components and a heat activation mechanism.

  • Continuous local neural fields: The generated continuous local neural fields enable smooth image transitions, avoiding the discontinuities that can occur in traditional methods.

  • High-quality image reconstruction: Performs excellently across multiple super-resolution benchmarks, preserving more image details while avoiding excessive smoothing.

  • Efficient computation and sampling: Through linear combination and rasterization techniques, Thera can efficiently generate the final image at an appropriate sampling rate, accommodating different resolution requirements.

Thera Application Scenarios

  • Image and video enhancement: Improves the clarity of low-resolution images and videos, suitable for restoring old photos, upscaling videos, and more.

  • Medical imaging: Enhances the resolution of medical images (such as CT and MRI) to support more accurate diagnosis.

  • Security surveillance: Enhances details in surveillance video for easier identification and tracking.

  • Satellite remote sensing: Improves satellite image resolution for environmental monitoring and geographic information analysis.

  • Machine vision: Enhances image quality in scenarios such as face recognition and vehicle recognition, improving recognition accuracy.

  • Real-time rendering and gaming: Dynamically enhances in-game image resolution to improve visual effects.

Related Links

GitHub Repository:https://github.com/prs-eth/thera

Project Page:https://therasr.github.io/

Paper:https://arxiv.org/pdf/2311.17643

DEMO:https://huggingface.co/spaces/prs-eth/thera