In this case when it is mentioned that an edge connects exactly two faces, does an edge that is on the boundary of the manifold also technically connect two faces in the same way that boundaries do on slide 83 of Lecture 6?

I think so. Also 10:25 to 11:25 on the Canvas lecture video. The way it was explained is to think of it as a looping around to the the second face.