You May include these pages to your file to be explicitly overlooked. Robots.txt files use a thing called the Robots Exclusion Protocol. This website will quickly generate the file for you with inputs of pages to generally be excluded. And Talking of citations, there are also EasyBib citation tools accessible. https://seotoolstube.com/