The dimensions at the output of each branch of the parallel filter are inconsistent due to different combinations of rate change factors. Try changing your input size to be a integral multiple of the overall upsample or downsample rate
filter