Some error correction and improvements

[mirsamantajbakhsh]

Dear Sir,

I am Dr. Tajbakhsh from the Department of Computer Engineering at Urmia University. As part of my course on Information Retrieval, I have been researching self-hosted dark net search engines that include a crawler, indexer, and web UI, similar to Ahmia. During my search, I came across your repository, which is already dockerized, and attempted to install and use it. However, I encountered some issues, as outlined below:

1. The Elasticsearch container is causing problems during startup. Solution: Update the Elasticsearch volume in the docker-compose.yml file to /var/lib/....

2. In the web-general component, the deployed website sends requests to darknxy.com. Solution: Modify layout_footer.html to send requests to the deployed host and port.

Additionally, I propose the following improvements:

3. Update the README to specify the necessary values before building the image.
4. Update the README to emphasize the need to update onion_lists.txt before deployment.
5. Update onion_lists.txt to include Ahmia’s list of onions.

I have addressed the tasks mentioned above and created a pull request accordingly.

Thank you for your attention.

Sincerely,

Dr. Tajbakhsh
Department of Computer Engineering, Faculty of Electrical and Computer Engineering, Urmia University, Urmia, Iran

[ak2766]

@mirsamantajbakhsh - Any chance you can elaborate on the deployment URL? I'm trying to figure out what this URL is used for.

[mirsamantajbakhsh]

Any chance you can elaborate on the deployment URL? I'm trying to figure out what this URL is used for.

The URL is for ElasticSearchClient. It was pointing to 'darknyx.com:443' which is the online version of the Darknet search engine and self deployed search engine cannot make request to 'darknyx.com:443' for two reasons:

1. CORS
2. The data indexed by darknyx.com not your locally deployed data.

So the URL should be changed to your own domain (or ip address) to use your own elastic search.

You may check out my YouTube about deploying the self hosted darknet search engine for more information:

https://youtu.be/Lnj8i07dC2I

[ak2766]

Thank you for taking the time to respond and also updating the README.md. I now fully grok its inner workings.

Off to find them onions...