From 9499bd8bb07c4d5850410fe72c00fdfe16bbbc17 Mon Sep 17 00:00:00 2001 From: ginja-n1nja <104853447+ginja-n1nja@users.noreply.github.com> Date: Mon, 13 May 2024 16:12:07 -0700 Subject: [PATCH] Update Readme.md Fixed typo for "top 100, 1000, and 1000" string under the Robots heading that is nested under the How it Works heading. It should read "top 100, 1000, and 10000" --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index f8b70e3b..87d311f8 100644 --- a/README.md +++ b/README.md @@ -44,7 +44,7 @@ A [Trickest](https://trickest.com) workflow clones the repositories in [technolo ![Trickest Workflow](images/technologies.png "Trickest Workflow - wordlists/technolgies") ### Robots -Another [Trickest](https://trickest.com) workflow gets the top 100, 1000, and 1000 websites from [Domcop's Open PageRank dataset](https://www.domcop.com/top-10-million-websites), uses [meg](https://github.com/tomnomnom/meg) to fetch their `robots.txt` files (Thanks, [@tomnomnom](https://github.com/tomnomnom)!), removes irrelevant entries, cleans up the paths, and pushes the wordlists to this repository. +Another [Trickest](https://trickest.com) workflow gets the top 100, 1000, and 10000 websites from [Domcop's Open PageRank dataset](https://www.domcop.com/top-10-million-websites), uses [meg](https://github.com/tomnomnom/meg) to fetch their `robots.txt` files (Thanks, [@tomnomnom](https://github.com/tomnomnom)!), removes irrelevant entries, cleans up the paths, and pushes the wordlists to this repository. ![Trickest Workflow](images/robots.png "Trickest Workflow - wordlists/robots") ## Contribution