Giving a letter of recommendation also puts your reputation on the line, so don’t feel bad about refusing to give in to someone’s request. Download and edit the file as necessary, and use this refusal letter to express your decision properly in a swift, yet professional manner to avoid possible conflicts.