Is this them in 1861:
https://www.findmypast.co.uk/transcr...1%2F0010551319
Was the mother's maiden name Harvey, not Finney?
The marriage is on FMP with image too:
https://search.findmypast.co.uk/reco...R%2F319619%2F1
Still can't find a birth registration or baptism.