Yeah. You can safely remove that permission. It's what is used to manage access tokens, not use them