Making sure I have this straight: We store in perceived brightness in order to capture more of the variation in human perception, and then translate back to luminance to tell the monitor what to display?

Yes I believe so!