Either: Copy the smaller clip, then move the other clip, then paste back the smaller clip.
Or: Select only a small portion at the beginning of the clip you want to move, drag that to the place you want and then adjust its right border until it reaches the smaller clip.