Since text has a lot of high frequency edges on the letter, the JPEG compression will tend to create more artifacts compared to a picture that has less hard edges.

For font, I think one interesting way to "compress" is to represent them in SVG because they usually have defined shapes. By doing so, we can render high resolution of text with just a fixed size of font file.