Step 1. Go to the "Advanced settings" step.
You can access this step while creating or editing an action.
Step 2. Look for the "Product Back in Stock - make visible" section and then enable "Exclude products from being "Made visible" based on a specific tag".
Step 3. Start adding tags in the dropdown menu box.
Note that it can be a pre-made tag (you can choose from your list) or a new tag. You can also use multiple tags.
Now, all products that are included in the action and has the selected tags will no longer be made visible even though their stock levels has already recovered.
Read more about Advanced settings.