If you need to pull pages from Google search results, you have a few reliable...

https://hotel-wiki.win/index.php/I_Blocked_a_Page_in_Robots.txt_and_Now_Noindex_Won%E2%80%99t_Work%E2%80%94Why%3F

If you need to pull pages from Google search results, you have a few reliable options. Add a "noindex" tag to the page header to tell crawlers to drop it from the index. Alternatively, return a 404 or 410 status code to signal the content is gone