Yes. post attachments are tied to the post they are attached to.
When a post is displayed, all attachments matching that post id are displayed with the post.
When the post is deleted, so are its attachments.
Attachment view/download permissions are granted based on what post they are attached to, and the post + its parent's permission settings.