Some people have a lot of excess fat to lose (say, 30 pounds or more), and struggle to do so.
Some people have very little excess fat to lose (say, 5 pounds or less), and struggle to do so.
Yes, believe it or not, there are people who have a strong desire to lose just 3, 4, or 5 pounds, and it’s really hard for them.
The point is that if it’s hard for you, then it’s hard for you.
It doesn’t matter what anyone else thinks.
What matters (in either case) is, how can you make it easier on yourself?