Well thats what parallax works isn't it? Some layers move faster than others, creating the illusion of parallax. You'll just have to pad out the layers that finish quicker so all of them match up in the end, or limit the movement so you don't go beyond a certain limit.