As a follow-up, would memory latency here be the number of clock cycles starting from the green to the start of the blue in one of the later load instructions?

@potato I think that technically not all of those cycles are from memory latency

How does bandwidth bound vs computation bound differ?

1) Bandwidth Bound and Latency bound programs are both subsets of memory bound programs.

i) Bandwidth Bound - Relates to the amount of data that can be pushed from one system to another across a connection. Is limited by the connection's capability to transfer data

ii) Latency bound - Time taken to get a response back for a load/store (or memory request) made. The longer it takes to get a response, the greater the latency.

2)Computation Bound - Programs that simply cannot be made to run faster because of limited computational power of the CPU (limited by the throughput)