If the public reply appears under the comment, your automation matched the comment and ran. The DM is a separate message, with its own rules, so something specific is stopping it.
1. Allow access to messages is off
This is the cause most of the time. Instagram blocks apps from sending DMs until you turn on Allow access to messages in the Instagram app. See "Turn on Allow access to messages in Instagram" in Getting Started.
2. The comment is older than 7 days
Instagram only lets a business send a DM about a comment within 7 days of it. Comments older than that get no DM, even if you rerun the automation.
3. The DM is waiting on a delay
If you turned on Delay before each message in Account safety, each DM waits up to 45 seconds. On a busy post, DMs may also queue for a few minutes to stay inside Instagram's hourly limits. Give it a few minutes before testing again.
4. You tested from your own account
Comments from the account the automation runs on are ignored, to stop reply loops. Test from a different Instagram account.
5. The person already got one DM about that comment
Instagram allows one DM per comment. A follow-up only goes out if the person replies, and only within 24 hours of their reply. Comment again with a fresh comment to test.