After downloading the entire message, we should iterate through MailMessage.Attachments collection and check how many attachments have .Inline=False. If you found any, the message has at least on real attachment.
Because we need to quickly detect if message has real attachments or not (not inline attachments) this property can help a lot :)