Here's a video where Prof. Wetzstein talks about light field displays in more detail. https://www.youtube.com/watch?v=c8Ge08MwSLQ

Could this technology help those who are nearsighted or farsighted be better able to use virtual reality / augmented reality? If we can produce any arbitrary light from any arbitrary position, we could alter those to give the same rays that a pair of eyelgasses might. I myself find wearing glasses in a VR-headset to be quite cumbersome as the VR-headset is too small to accommodate my glasses and thus I have to do without them, resulting in rather subpar image quality regardless of how much resolution is in the OLED display.

Would a large ambient light field display look like a window into a virtual world?

@jchh it turns out that some of Gordon Wetzstein's students actually created a product that do just that, it autofocuses using light field technology!