Yep. Exactly correct, sometimes deceiving though!
As long as the soreness is just from actual lifting not a muscle tear or something, I don't see why you sould stop working out. As others have said, don't go working the same muscle groups on back to back days though.