This looks like some rip-rap protection, albeit with smaller stone than one would use today. As a result a problem arose, probably because of some severe wave action. The damage was not fixed, and this is probably several years work of erosion.