Awesome-SIGGRAPH-Computational-Optics

A curated list that tracks Computational Optics papers from SIGGRAPH(NA/Asia) conferences.

Note: In Sep 2023, we changed the repo title from "Computational Imaging" to "Computational Optics" to better reflect the broader scope.

Purpose

SIGGRAPH has been publishing cutting-edge Computational Optics papers for decades. However, as it's a relatively niche area within SIGGRAPH (typically <10 papers/year), tracking these papers can be challenging. This curated list aims to:

1. Help researchers stay up-to-date with developments in the field;
2. Provide an entry point for those new or curious about Computational Optics;
3. Highlight key papers and their contributions.

⚠️ Note
This list is hard to be comprehensive. Tracking all the related papers in the past years is a hard job as we can miss some related papers. If you know of a paper that should be added, please open an issue or submit a pull request or contact us via email.

Overview

Computational Optics encompasses three main areas:

• 📷 Computational Imaging - Camera-based techniques
• 📺 Computational Display - Projector/display-based techniques
• 🔨 Computational Lithography - Fabrication-based techniques

This collection also includes related papers that don't strictly fit these categories but are relevant to computational optics (e.g., 🔄 differentiable rendering).

Papers

Year	Venue	Paper(w/ code)	Repo (if any)	Labels	Summary(if any)
2024	SIGA	AR-DAVID: Augmented Reality Display Artifact Video Dataset		📺 display
		TCSF: A Temporal Contrast Sensitivity Function for Flicker Detection and Modeling Variable Refresh Rate Flicker	code	📺 display
		Neural Light Spheres for Implicit Image Stitching and View Synthesis	code	📷 imaging
		Polarimetric BSSRDF Acquisition of Dynamic Faces		📷 imaging
		Large Étendue 3D Holographic Display with Content-adpative Dynamic Fourier Modulation		📺 display
		Inverse Rendering for Tomographic Volumetric Additive Manufacturing	code	🔨 lithography;🔄 differentiable rendering
		Embodied Visions: Interactive Installations That Reimagine Bodily Presence in Digital Imaging Apparatuses as Shadows		📺 display; 📷 imaging
		Coherent Optical Modems for Full-Wavefield Lidar		📷 imaging
		A Generalized Ray Formulation For Wave-Optics Rendering	code	🔄 differentiable rendering
		End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model		📷 imaging
		A Plenoptic 3D Vision System		📷 imaging
		Reconstructing Translucent Thin Objects from Photos		📷 imaging
		From Sim-to-Real: Toward General Event-based Low-light Frame Interpolation with Per-scene Optimization	code	📷 imaging
		Perspective-Aligned AR Mirror with Under-Display Camera		📷 imaging
		End-to-end Optimization of Fluidic Lenses		📷 imaging
		Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging		📷 imaging
		DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media		📷 imaging
2024	SIG	Zero Grads: Learning Local Surrogate Losses for Non-Differentiable Graphics	colab	🔄 differentiable rendering
		Deep Hybrid Camera Deblurring for Smartphone Cameras	code	📷 imaging
		NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects		📷 imaging
		Spin-Weighted Spherical Harmonics for Polarized Light Transport	code	📷 imaging; 🔄 differentiable rendering
		A Free-Space Diffraction BSDF	code	🔄 differentiable rendering
		Holographic Parallax Improves 3D Perceptual Realism		📺 display
2023	SIGA	Multisource Holography		📺 display
		Depolarized Holography with Polarization-multiplexing Metasurface		📺 display
		Thin On-Sensor Nanophotonic Array Cameras		📷 imaging
		Neural Lithography: Close the Design to Manufacturing Gap in Computational Optics with a 'Real2Sim' Learned Photolithography Simulator	code	🔨 lithography; 📷 imaging; 📺 display
		Holographic Near-eye Display with Real-time Embedded Rendering		📺 display
		Simultaneous Color Computer Generated Holography		📺 display
		High-quality Color-animated CGH Using a Motor-driven Photomask		📺 display
		The Effect of Display Capabilities on the Gloss Consistency Between Real and Virtual Objects		📺 display
		Multi-color Holograms Improve Brightness in Holographic Displays		📺 display
		Light-Efficient Holographic Illumination for Continuous-Wave Time-of-Flight Imaging		📷 imaging
		Self-Calibrating, Fully Differentiable NLOS Inverse Rendering	code	📷 imaging
		Neural Spectro-polarimetric Fields		📷 imaging
		Doppler Time-of-Flight Rendering	code	��� imaging
2023	SIG	Computational Long Exposure Mobile Photography		📷 imaging
		The Statistics of Eye Movements and Binocular Disparities in VR Gaming Headsets Should Drive Headset Design		📺 display
		Etendue Expansion in Holographic Near Eye Displays Through Sparse Eye-box Generation Using Lens Array Eyepiece		📺 display
		OpenMPD: A Low-level Presentation Engine for Multimodal Particle-based Displays		📺 display
		Perceptual Visibility Model for Temporal Contrast Changes in Periphery		📺 display
		Perspective-correct VR Passthrough Without Reprojection		📺 display
		Split-Lohmann Multifocal Displays	code	📺 display
		Seeing Photons in Color		📷 imaging
		∇-Prox: Differentiable Proximal Algorithm Modeling for Large-scale Optimization	code	📷 imaging
2022	SIGA	Self-Calibrating, Fully Differentiable NLOS Inverse Rendering	code	📷 imaging
		Pupil-aware Holography		📺 display
		Neural Photo-Finishing		📷 imaging
		Simulation of Hand Anatomy Using Medical Imaging		📷 imaging
		Reconstructing Hand-Held Objects from Monocular Video	code	📷 imaging
		Efficient Differentiation of Pixel Reconstruction Filters for Path-Space Differentiable Rendering		🔄 differentiable rendering
		Force-Aware Interface via Electromyography for Natural VR/AR Interaction		📷 imaging
		Color-Perception-Guided Display Power Reduction for Virtual Reality		📺 display
2022	SIG	NeAT: Neural Adaptive Tomography		📷 imaging
		Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape	code	📷 imaging
		Face Deblurring using Dual Camera Fusion on Mobile Phones		📷 imaging
		Holographic Glasses for Virtual Reality		📺 display
		Neural Spectro-polarimetric Fields		📷 imaging
		Joint Neural Phase Retrieval and Compression for Energy- and Computation-Efficient Holography on the Edge		📺 display
2021	SIGA	Neural 3D Holography	code	📺 display
		Polarimetric Spatio-Temporal Light Transport Probing		📷 imaging
		Reproducing Reality with a High-Dynamic-Range Multi-Focal Stereo Display		📺 display
		Kaleidoscopic Structured Light		📷 imaging
		Time-Travel Rephotography	code	📷 imaging
	SIG	End-to-End Complex Lens Design		🔄 differentiable rendering; 📷 imaging
		Imaging with local speckle intensity correlations	code	📷 imaging
		Differentiable Compound Optics		🔄 differentiable rendering; 📷 imaging
		A Generic Framework for Physical Light Transport		🔄 differentiable rendering
		Monte Carlo Estimators for Differential Light Transport		🔄 differentiable rendering
		Free-form Scanning of Non-planar Appearance with Neural Trace Photography		📷 imaging
		Low-Cost SPAD Sensing	code	📷 imaging
		Dirty Pixels: Towards End-to-End Image Processing and Perception		📷 imaging
		Imaging with local speckle intensity correlations: theory and practice		📷 imaging
2020	SIGA	Neural Holography	code	📺 display
		Design and Fabrication of Freeform Holographic Optical Elements		🔨 lithography
		Learned Hardware-in-the-loop Phase Retrieval		📺 display
		Rendering Near-Field Speckle Statistics		🔄 differentiable rendering
	SIG	Local Fourier Slice Photography		📷 imaging
		Quanta Burst Photography		📷 imaging
		One Shot 3D Photography	code	📷 imaging
		Non-Line-of-Sight Reconstruction using Efficient Transient Rendering		📷 imaging
		End-to-end Learned, Optically Coded Super-resolution SPAD Camera		📷 imaging
2019	SIGA	Learning Efficient Illumination Multiplexing for Joint Capture of Reflectance and Shape		📷 imaging
		Handheld Mobile Photography in Very Low Light		📷 imaging
		Accelerating ADMM for efficient simulation and optimization	code	🔄 differentiable rendering
		Learned Large Field-of-View Imaging With Thin-Plate Optics	code	📷 imaging
	SIG	Synthetic Defocus and Look-Ahead Autofocus for Casual Videography		📷 imaging
		Handheld Multi-Frame Super-Resolution	code	📷 imaging
		A Unified Framework for Compression and Compressed Sensing of Light Fields		📷 imaging
		Hyperparameter Optimization in Black-box Image Processing		📷 imaging
		Coding Optimization for Fast Fluorescence Lifetime Imaging		📷 imaging
		Non-line-of-sight Imaging with Partial Occluders and Surface Normals		📷 imaging
		Wave-based Non-line-of-sight Imaging using Fast fk-Migration	code	📷 imaging
		Compact Snapshot Hyperspectral Imaging with Diffracted Rotation	code	📷 imaging
2018	SIGA	A System for Acquiring, Processing, and Rendering Panoramic Light Field Stills		📷 imaging
		Learning to reconstruct shape and spatially-varying reflectance from a single image	code	📷 imaging
	SIG	What Are Optimal Coding Functions for Time-of-Flight Imaging?		📷 imaging
		Single-Photon 3D Imaging with Deep Sensor Fusion		📷 imaging
		End-to-end Optimization of Optics and Image Processing	code	🔄 differentiable rendering; 📷 imaging
		Megapixel Adaptive Optics	code	📷 imaging
2017	SIGA	Compact Single-Shot Hyperspectral Imaging Using a Prism		📷 imaging
		High-Quality Hyperspectral Reconstruction Using a Spectral Prior	code	📷 imaging
		DeepToF: Off-the-Shelf Real-Time Correction of Multipath Interference		📷 imaging
		Snapshot Difference Imaging using Correlation Time-of-Flight Sensors	code	📷 imaging
	SIG	CoLux: Multi-Object 3D Micro-Motion Analysis Using Speckle Imaging		📷 imaging
		4D Imaging through Spray-On Optics		📷 imaging
		Rainbow Particle Imaging Velocimetry	code	📷 imaging
		Epipolar Time-of-Flight Imaging		📷 imaging
		Deep Bilateral Learning for Real-Time Image Enhancement		📷 imaging
2016	SIGA	Deep Joint Demosaicking and Denoising	code	📷 imaging
		Computational Bounce Flash for Indoor Portraits		📷 imaging
		Burst photography for HDR and low-light imaging (HDR+)	code	📷 imaging
		Learning-Based View Synthesis for Light Field Cameras		📷 imaging
		Birefractive Stereo Imaging for Single-Shot Depth Acquisition		📷 imaging
		Model-Based Teeth Reconstruction		📷 imaging
		Recovering Shape and Spatially-Varying Surface Reflectance		📷 imaging
		Simultaneous Acquisition of Microscale Reflectance and Normals		📷 imaging
		Motion Parallax in Stereo 3D		📺 display
	SIG	The Diffractive Achromat: Full-Spectrum Computational Imaging With Diffractive Optics		📷 imaging
		Practical Multispectral Lighting Reproduction		📺 display
		Computational Imaging With Multi-Camera Time-of-Flight Systems		📷 imaging
		Occluded Imaging With Time-of-Flight Sensors		📷 imaging
		Additive Light-Field Displays: Realization of Augmented Reality With Holographic Optical Elements		📺 display
		Fairy Lights in Femtoseconds: Aerial and Volumetric Graphics Rendered by a Focused Femtosecond Laser Combined With Computational Holographic Fields		📺 display
		Image Perforation: Automatically Accelerating Image Pipelines by Intelligently Skipping Samples		📷 imaging
		Automatically Scheduling Halide Image Processing Pipelines		📷 imaging
		ProxImaL: Efficient Image Optimization using Proximal Algorithms		📷 imaging
		Rigel: Flexible Multi-Rate Image Processing Hardware		📷 imaging
2015	SIGA	Data-Driven Structural Priors for Shape Completion		📷 imaging
		Autoscanning for Coupled Scene Reconstruction		📷 imaging
		Unsynchronized structured light		📷 imaging
	SIG	Homogeneous Codes for Energy Efficient Illumination and Imaging		📷 imaging
		Doppler Time-of-Flight Imaging		📷 imaging
		Phasor Imaging: A Generalization of Correlation-Based Time-of-Flight Imaging		📷 imaging
		Micron-scale Light Transport Decomposition Using Interferometry		📷 imaging
		Linear volumetric focus for light field cameras		📷 imaging
		A Light Transport Framework for Lenslet Light Field Cameras		📷 imaging
		Improving Light Field Camera Sample Design		📷 imaging
		Light Field Reconstruction Using Sparsity		📷 imaging
		Layered Light-Field Reconstruction for Defocus Blur		📷 imaging

[Previous years' entries continue in same format...]

TODO

• Initial collection of papers
• Find omitted papers
• Complete paper tracking for past years before 2015
• Add paper summaries

Resources

• Ken-sen SIGGRAPH Papers Database
• Github TOC Sidebar Extension (Recommended for browsing)