To achieve your objective, you must be the one who determines what you work on, and when.
Anything else is other people dictating their objectives onto you.
If their objective is directly aligned with yours, then it is not an interruption or derailment.
Be careful, and protect your own integrity, because the self-serving objectives of others are not always obvious, nor intentionally harmful … but they can be harmful just the same.