Cascaded nonlinearity based soliton pulse compression in the process of femtosecond difference frequency generation is studied theoretically. A set of simplified coupled wave equations under the conditions of large phase mismatch and matched group velocities is obtained,which reveals the physical mechanism of soliton compression in this process. Numerical simulations demonstrate that in the presence of group velocity dispersion and equivalent cross phase modulation,both the pump and the signal pulses can be compressed with a high compression ratio.