Is One-Set Training Enough?