Release v0.5

Release v0.5

What's new?

• Redis support !

apt install redis and set your Redis config in your config.py

#Redis
redis_support_enabled = True
redis_host = "localhost"
redis_port = 6379
redis_db = 0

And bang, you can use Redis now.
Just restart the server after config changes.

How this works

Redis gets a request first. If no key values are found, then the same request goes to the SQLite database. If a result is found in the database, the same key values from the response are being inserted into the Redis cache.

Release v0.4

Release v0.4

• Sha encoding included (No more cleartext passwords or usernames/approach like this was inevitable)
• Some minor tweaks here and there

In Consideration (Redis)

• Redis integration. I am still seeing some problems with this. SQLite databases are fast by nature, so Redis might slow down things a bit because database synchronization will be needed.

In consideration (::memory::)

What if a replica of the mentioned SQLite database would be stored in memory instead? Such an approach would make the process of serving responses even faster.

Concept:

1. Bot requests the worker script
2. Worker script requests Peekaboo
3. Peekaboo launches its bot if the response source is not found
4. Modified HTML source is being stored in a local database
5. Data from the local is being transferred to the in-memory database
6. Later bots get the response from memory

If the memory database has no such data, it takes it from local.

v0.3

Version v0.3

This is another stable release with some minor modifications

Changes

• Connector module (makes it much easier to query the SQLite databases)
• Critical and important functions are divided into separate modules to liquidate spaghetti code for better readability

In consideration

• Redis caching plugin

v0.2

This is a second, more stable release

Lots of things were changed, but the most important things are:

• Selenium timeout variable was added into config.py, get.py and update.py files in case some sites do not manage to render on the time interval of three seconds.
• eliminate_links = ["script", "style","iframe","link"] was added into config.py (Beautiful Soup removes unnecessary scripts and elements)
• eliminate_tags = ["class", "id", "name", "style"] was added into config.py (Beautiful Soup removes unnecessary element tags)

v0.1

The first stable release

Tested on Windows and Linux. Seems to be working well. One of the peekaboos is spinning on the artefaktas.eu. You can simulate the bot request just by changing your user agent string on the browser. Change it to "facebookexternalhit/1.0" or something more official, because... I protect it really good from the random bots.

If you experience any issues, I will be glad to solve them and update the codebase.

Contacts: andrius@artefaktas.eu