Advanced Proxy Scraper

What is Prawler ?

Prawler finds best and working proxies from the internet in seconds. Proxies are used by developers, ethical hackers, pentesters and so on, in order to cover their tracks or bypass firewall restrictions. Prawler helps to find desired proxy in all possible formats.

Features:

• Fast Proxy Server Scraping through multiple API's
• Extracts various types of Proxy Servers (HTTP, SOCKS4, SOCKS5)
• Scraps for Proxy Servers based on their Anonymity Level (Transparent, Anonymous, Elite)
• Find proxies from a specific country (using Country Codes)
• Various output formats available (List, JSON, TXT file)

What's new in 0.6beta update ?

• Bug fixes
• Reduced the code length
• User can specify the number of proxies he/she needs in all available formats (List, JSON, TXT file)
• User can specify a country code to find proxies from a specific country.

Installation:

New Installation:

pip install Prawler

Updating the package:

pip install --upgrade Prawler

Usage:

We can use Prawler in several ways:

• Find a single random proxy server

Syntax:

Prawler.get_random_proxy(<PROXY TYPE>, <PROXY ANONYMITY LEVEL>)

Example:

import Prawler
proxy = Prawler.get_random_proxy("http", "elite")

• Find all proxies in list format

Syntax:

Prawler.get_proxy_list(<NO. OF PROXIES>, <PROXY TYPE>, <PROXY ANONYMITY LEVEL>, <COUNTRY CODE>)

Example:

import Prawler
proxy_list = Prawler.get_proxy_list(5, "http", "elite")

or

import Prawler
proxy_list = Prawler.get_proxy_list(5, "http", "elite", "US")

• Find all proxies in JSON format

Syntax:

Prawler.get_proxy_json(<NO. OF PROXIES>, <PROXY TYPE>, <PROXY ANONYMITY LEVEL>, <COUNTRY CODE>)

Example:

import Prawler
proxy_list = Prawler.get_proxy_json(5, "http", "elite")

or

import Prawler
proxy_list = Prawler.get_proxy_json(5, "http", "elite", "US")

• Find all proxies and save it into a text file

Syntax:

Prawler.get_proxy_txt(<FILENAME>, <NO. OF PROXIES>, <PROXY TYPE>, <PROXY ANONYMITY LEVEL>, <COUNTRY CODE>)

Example:

import Prawler
Prawler.get_proxy_txt("proxy_list.txt", 50, "http", "elite")

or

import Prawler
Prawler.get_proxy_txt("proxy_list.txt", 50, "http", "elite", "US")

Note:

• Valid Proxy Type:
  

http, socks4, socks5

• Valid Anonymity Level:
  

all, elite, anonymous, transparent

• Valid Country Codes:
  

AF, AL, AM, AR, AT, AU, BA, BD, BG, BO, BR, BY, CA, CL, CM, CN, CO, CZ, DE, EC, EG, ES, FR, GB, GE, GN, GR, GT, HK, HN, HU, ID, IN, IQ, IR, IT, JP, KE, KG, KH, KR, KZ, LB, LT, LV, LY, MD, MM, MN, MU, MW, MX, MY, NG, NL, NO, NP, PE, PH, PK, PL, PS, PY, RO, RS, RU, SC, SE, SG, SK, SY, TH, TR, TW, TZ, UA, UG, US, VE, VN, ZA

Donate:

If you feel this project was awesome, you can give me a cup of coffee :)