What do you consider the hardest part about losing weight? Some might say it’s the need to give up junk food. Others might bemoan the increased physical activity and exercise. But when it comes down to it, the hardest part about weight loss may not be in losing the pounds, but rather in keeping them off.