Background Parallax Issue When Camera Moves Vertically In Horizontal Movement Game

In a game I am working on I am having issues with the background images moving vertically. The character is moving horizontally but when the character hits a spring and jump the camera follows him up and down. When the camera pans up and down the background images move verbally and look bad. How can I fix this issue. I tried taking out all of the backgrounds and putting those images in as objects and setting linear velocity but there where gaps from one scene to the next. Thanks