Can anyone recommend me the best way to create this image effect and layout?
Take a look here:
Also sections box.
That layout and several similar ones are all ready made in the project downloads for Sections Pro and Sections Box.
For that simple black overlay on hover you just need Sections Pro. Sections Box will allow you to add many more hover caption effects.