The goal of this project was to develop a passive Google dork script to collect potentially vulnerable web pages and applications on the Internet. There are 2 parts. The first is
ghdb_scraper.py
that retrieves Google Dorks and the second portion is pagodo.py
that leverages the information gathered by ghdb_scraper.py
.What are Google Dorks?
The awesome folks at Offensive Security maintain the Google Hacking Database (GHDB) found here: https://www.exploit-db.com/google-hacking-database. It is a collection of Google searches, called dorks, that can be used to find potentially vulnerable boxes or other juicy info that is picked up by Google's search bots.
Installation
Scripts are written for Python 3.6+. Clone the git repository and install the requirements.
git clone https://github.com/opsdisk/pagodo.git
cd pagodo
virtualenv -p python3 .venv # If using a virtual environment.
source .venv/bin/activate # If using a virtual environment.
pip install -r requirements.txt
Google is blocking me!
If you start getting HTTP 503 errors, Google has rightfully detected you as a bot and will block your IP for a set period of time. The solution is to use proxychains and a bank of proxies to round robin the lookups.
Install proxychains4
apt install proxychains4 -y
/etc/proxychains4.conf
configuration file to round robin the look ups through different proxy servers. In the example below, 2 different dynamic socks proxies have been set up with different local listening ports (9050 and 9051). Don't know how to utilize SSH and dynamic socks proxies? Do yourself a favor and pick up a copy of The Cyber Plumber's Handbook to learn all about Secure Shell (SSH) tunneling, port redirection, and bending traffic like a boss.vim /etc/proxychains4.conf
round_robin
chain_len = 1
proxy_dns
remote_dns_subnet 224
tcp_read_time_out 15000
tcp_connect_time_out 8000
[ProxyList]
socks4 127.0.0.1 9050
socks4 127.0.0.1 9051
proxychains4
in front of the Python script and each lookup will go through a different proxy (and thus source from a different IP). You could even tune down the -e
delay time because you will be leveraging different proxy boxes.proxychains4 python3 pagodo.py -g ALL_dorks.txt -s -e 17.0 -l 700 -j 1.1
ghdb_scraper.py
To start off,
pagodo.py
needs a list of all the current Google dorks. A datetimestamped file with the Google dorks and the indididual dork category dorks are also provided in the repo. Fortunately, the entire database can be pulled back with 1 GET request using ghdb_scraper.py
. You can dump all dorks to a file, the individual dork categories to separate dork files, or the entire json blob if you want more contextual data about the dork.To retrieve all dorks
python3 ghdb_scraper.py -j -s
python3 ghdb_scraper.py -i
categories = { 1: "Footholds", 2: "File Containing Usernames", 3: "Sensitives Directories", 4: "Web Server Detection", 5: "Vulnerable Files", 6: "Vulnerable Servers", 7: "Error Messages", 8: "File Containing Juicy Info", 9: "File Containing Passwords", 10: "Sensitive Online Shopping Info", 11: "Network or Vulnerability Data", 12: "Pages Containing Login Portals", 13: "Various Online devices", 14: "Advisories and Vulnerabilities", }
pagodo.py
Now that a file with the most recent Google dorks exists, it can be fed into
pagodo.py
using the -g
switch to start collecting potentially vulnerable public applications. pagodo.py
leverages the google
python library to search Google for sites with the Google dork, such as:intitle:"ListMail Login" admin -demo
The -d
switch can be used to specify a domain and functions as the Google search operator:site:example.com
Performing ~4600 search requests to Google as fast as possible will simply not work. Google will rightfully detect it as a bot and block your IP for a set period of time. In order to make the search queries appear more human, a couple of enhancements have been made. A pull request was made and accepted by the maintainer of the Python google
module to allow for User-Agent randomization in the Google search queries. This feature is available in 1.9.3 and allows you to randomize the different user agents used for each search. This emulates the different browsers used in a large corporate environment.The second enhancement focuses on randomizing the time between search queries. A minimum delay is specified using the
-e
option and a jitter factor is used to add time on to the minimum delay number. A list of 50 jitter times is created and one is randomly appended to the minimum delay time for each Google dork search.categories = {
1: "Footholds",
2: "File Containing Usernames",
3: "Sensitives Directories",
4: "Web Server Detection",
5: "Vulnerable Files",
6: "Vulnerable Servers",
7: "Error Messages",
8: "File Containing Juicy Info",
9: "File Containing Passwords",
10: "Sensitive Online Shopping Info",
11: "Network or Vulnerability Data",
12: "Pages Containing Login Portals",
13: "Various Online devices",
14: "Advisories and Vulnerabilities",
}
intitle:"ListMail Login" admin -demo
To run it:
site:example.com
Conclusion
Comments, suggestions, and improvements are always welcome. Be sure to follow @opsdisk on Twitter for the latest updates.
via KitPloit Related word
- Pentest Tools Open Source
- Github Hacking Tools
- Hacker Tools Apk Download
- Hacking Tools Kit
- Hacker
- Hack Tools For Games
- Hacker Tools Mac
- Hacker Tools For Ios
- Hacker Tools 2019
- Hacker Tools For Ios
- New Hacker Tools
- Pentest Tools Android
- Hacking Tools Windows 10
- Hacker Tools Windows
- Termux Hacking Tools 2019
- Hacking App
- World No 1 Hacker Software
- Hack Tools Pc
- Hacking Tools For Kali Linux
- Hacker Tools For Pc
- New Hacker Tools
- Hacks And Tools
- Hack Tools For Ubuntu
- Hacker Tool Kit
- Computer Hacker
- Hacker Tools Linux
- Hacker Tools Software
- Hack Tools For Windows
- Tools Used For Hacking
- Pentest Tools For Android
- Hack Tool Apk No Root
- Pentest Tools Linux
- Nsa Hacker Tools
- Hacker Tools 2019
- Hacker Tools Apk Download
- Physical Pentest Tools
- Hacker Hardware Tools
- Hacker Tools 2020
- Easy Hack Tools
- Kik Hack Tools
- Hack Tools Mac
- Pentest Recon Tools
- Black Hat Hacker Tools
- Tools Used For Hacking
- Hacking Tools For Windows
- Pentest Tools Android
- Hack And Tools
- Hack Tools For Pc
- What Is Hacking Tools
- Pentest Tools Alternative
- Hacker Tools Online
- Hacking Tools Mac
- How To Install Pentest Tools In Ubuntu
- Pentest Tools
- Pentest Tools Website
- Hacking Tools Online
- Pentest Tools Download
- Pentest Tools Port Scanner
- Hacker Tools
- Hacking App
- Blackhat Hacker Tools
- Hacking Tools For Kali Linux
- Best Pentesting Tools 2018
- Hackrf Tools
- Hacker Tools Hardware
- Pentest Tools Website
- Wifi Hacker Tools For Windows
- Install Pentest Tools Ubuntu
- Hacker Tools Free
- Pentest Tools Alternative
- Growth Hacker Tools
- Hacking Tools Mac
- Black Hat Hacker Tools
- Hacker Tools For Windows
- Pentest Tools Open Source
- Pentest Tools Alternative
- Hacking Apps
- Hacker Hardware Tools
- How To Make Hacking Tools
- Hacking Tools Software
- Hack Tools For Games
- Best Pentesting Tools 2018
- Free Pentest Tools For Windows
- Hacker Tools Hardware
- Tools For Hacker
- Hack Tools Pc
- Nsa Hack Tools Download
- Pentest Tools Windows
- Pentest Tools For Ubuntu
- Pentest Tools Kali Linux
- Hacking Tools For Windows
- Hacker Tools Windows
- Hacker Tools Apk Download
- Hack Tools For Mac
- Hacking Tools 2020
- Hacker Tools Mac
- Hacking Tools Kit
- Hack Tool Apk No Root
- Bluetooth Hacking Tools Kali
- Blackhat Hacker Tools
- Hacker Security Tools
- Pentest Tools Linux
- Hacker Tools Mac
- Game Hacking
- Hack Rom Tools
- Hack App
- Hacking Tools Pc
- Hacking Tools Windows
- Hack Tools Mac
- Pentest Tools Tcp Port Scanner
- Pentest Tools Download
- Hacking Tools Usb
- Pentest Tools Github
- Black Hat Hacker Tools
- Bluetooth Hacking Tools Kali
- Hacking Tools For Windows 7
- Growth Hacker Tools
- Hacker Tools For Windows
- Hacker Tools Free
- Beginner Hacker Tools
- Hacker Tools For Pc
- Pentest Tools Nmap
- Hacker Hardware Tools
- Pentest Tools For Android
- Hacking Tools Github
- Hacks And Tools
- Hack App
- Pentest Box Tools Download
- Hacker Tools 2020
- Nsa Hacker Tools
- Best Pentesting Tools 2018
- New Hack Tools
- Hacker Tools Github
- Hacker Tools Free Download
- Pentest Tools Online
- Pentest Tools Review
- Pentest Tools Subdomain
- Kik Hack Tools
- Pentest Tools Find Subdomains
- Black Hat Hacker Tools
- Pentest Tools Online
- Hacker Tools For Ios
- Hackrf Tools
- Easy Hack Tools
- Hacker Security Tools
- Hacker Techniques Tools And Incident Handling
- Hacker Tools Free Download
- Pentest Tools Apk
- Hack Tools For Games
- Hacker Tools Github
- What Is Hacking Tools
- Hack Tools 2019
- Hackrf Tools
No hay comentarios:
Publicar un comentario