DOMS usually go away a short while after you begin training. Giving yourself these extra days off might be causing your body to take longer to adapt to the repeated-bout effect.

If it is still too much you can try to deload and start with lower weights to get your muscles more accustomed to it. I would recommend stretching beforehand, but Switch Fit is already a pretty great warmup.