Skip to content

AI4Optics

Automate optical system design with AI agents and high-performance differentiable optics.

AI4Optics brings together tools for optical design and computational imaging. This documentation covers open-source, PyTorch-based simulators and research code: DeepLens, End2endImaging, DiffTMM, and DeepLens Hyperspectral Imaging. DeepO is the browser-based optical design software in the same ecosystem.

AI-native Optical Simulators

AI-native optical simulators built for LLM agents. High-performance computation enables fast iteration in agent loops, and readable source with well-written docstrings ensures reliable use.

  • DeepLens

    Differentiable optical lens simulator for end-to-end camera system design — geometric, diffractive, and hybrid lens models with PSF rendering and automated design.

    Open the DeepLens docs

  • End2endImaging

    End-to-end differentiable imaging framework — optics, sensor, ISP, and reconstruction networks as one optimizable graph for deep optics design.

    Open the End2endImaging docs

  • DiffTMM

    Differentiable transfer matrix method in PyTorch for multi-layer thin-film optics — isotropic and anisotropic solvers, GPU batching, and gradient-based inverse design of optical coatings.

    Open the DiffTMM docs

Computational Imaging Applications

Computational imaging applications that combine optical simulation and neural reconstruction.

  • Hyperspectral Imaging

    A diffractive optical lens encodes spectral information into RGB images, and a neural network reconstructs spectral channels from RGB captures.

    Explore hyperspectral imaging

  • Polarization Imaging

    End-to-end polarization imaging, jointly designing polarization optics and the reconstruction network.

    Coming soon

AI Optical Design Software

  • DeepO

    AI-powered optical design software in the browser — edit lens data, view 2D layouts, optimize, and compute PSFs, with an AI design assistant built in.

    Launch DeepO

Which AI4Optics project should I use?

Choose a starting point based on the part of the optical system you want to model. DeepLens models the optics; End2endImaging combines DeepLens with a sensor and image-processing pipeline for joint optimization.

I want to… Start here Source code and research
Trace rays, compute point spread functions (PSFs), or optimize a lens DeepLens quickstart DeepLens source · Papers and citations
Simulate a camera or jointly optimize optics and image reconstruction End2endImaging quickstart End2endImaging source · Research citation
Simulate reflection and transmission or optimize a multilayer thin-film coating DiffTMM quickstart DiffTMM source · Research citation
Reconstruct spectral channels from RGB captures Hyperspectral imaging examples Hyperspectral source · Papers and citations
Edit and optimize a lens in the browser with an AI assistant DeepO quickstart Launch the browser application