Light Field Toolbox for MATLAB
This is a toolbox for working with light field imagery in MATLAB. Features include decoding, calibration, rectification, filtering, and visualization of light field images.Publications
• D. G. Dansereau, O. Pizarro, and S. B. Williams, “Decoding, calibration and rectification for lenselet-based plenoptic cameras,” in Computer Vision and Pattern Recognition (CVPR), 2013, pp. 1027–1034. Available here.
• D. G. Dansereau, O. Pizarro, and S. B. Williams, “Linear volumetric focus for light field cameras,” ACM Transactions on Graphics (TOG), Presented at SIGGRAPH 2015, vol. 34, no. 2, p. 15, Feb. 2015. Available here.
Download
Toolbox v0.5 released April 28, 2020 is now available on github here.v0.5 introduces new features, bug fixes, and performance improvements. Highlights:
- Linear refocus super-resolution using LFFiltShiftSum
- New display functions LFDispLawnmower, LFDispTiles, LFDispTilesSubfigs, LFDispProj, LFDispProjSubfigs
- LFReadESLF, LFWriteESLF
- Improved decode performance and speed
- Improved calibration accuracy
- LFDisp* functions are better behaved, now display in the active figure window
The development branch includes experimental functionality under development including depth estimation, rectifying to a parallel array of cameras, and additional filtering functionality.
Community
A community-driven list of light field resources on github. The Light Field Vision mailing list is dedicated to light fields and their application to computer vision here.
Datasets
The toolbox v0.5 sample light field pack is here.A small sample calibration is available here. This small example is intended as a fast test to validate the calibration code, and does not represent a very good calibration dataset. See some of the larger datasets, below, for better examples.
There are five calibration datasets accompanying our 2013 CVPR paper on decoding, calibration and rectification (link above). Datasets A and B are good example datasets for calibrating a Lytro-like camera, in that they feature dense grids imaged at close range and over diverse poses. Dataset A, Dataset B, Dataset C, Dataset D, Dataset E.
External Datasets
A dataset from IRISIA is here.
A large dataset from EPFL is here.
A dataset of materials from UCSD is here.
A light field dataset from HCI Heidelberg is here.
Other Useful Tools
Light Field Imaging Toolkit, a MATLAB toolkit for the interactive processing of plenoptic images, available here.
cocolib / light field suite: a CUDA library for continuous optimization and light field analysis by Basian Goldluecke is here.
HCI Heidelberg have some tools for working with their benchamark dataset, as well as a blender plugin for generating light fields here.
Lytro Meltdown is a site dedicated to the Lytro cameras, and includes tools for working with Lytro files and the Lytro Communicator, for controlling the Lytros over WiFi.