giturl-scanner

This tool goes through all public (non-archived) repos of any GitHub org, clones them, extracts every URL and package dependency. Inspired by similar tool of Arshad Kazmi github-scanner-local

---

⚡ What It Does

• 🔎 Clones all non-archived repos from a GitHub org using api as well from local folder's
• 🕵️ Extracts URLs from code, docs, configs, HTML, JSON, etc.
• ⚔️ Validates URLs using httpx
• 📦 Extracts packages (npm, pypi, gem, go)
• 💀 Flags broken links + potentially hijackable packages

---

🛠 Requirements

• Python 3.x

• httpx Go tool in your $PATH

• Optional: GH_TOKEN set for higher GitHub API limits

🚀 Usage

export GH_TOKEN=gh_yourtoken

git clone https://github.com/noob6t5/giturl-scanner.git

cd giturl-scanner

python3 finder.py -o <github-org-name>

python3 finder.py -f folder_here

---

---

TODO

• Scan secrets in cloned repo using TruffleHog and Gitleaks
• Add requirements.txt
• Adjust exporting GitHub token safely
• Configure with Confused for dependency confusion
• Separate Username and Check for Takeover by 404 status code