GayTorrent.ru requires a login unless you are a search engine/bot?
-
Not expert at this, but once in a while I will search for things to help here. In this instance, more than one of us want subtitles for El Cazador (Young Hunter).
One of the search results links to a post I made here.
How does Google (or any search engine/bot) have access to publish anything that is posted here? Should we assume there is no privacy despite requiring a login?
Editing to add this:
Remembered that options can be made using the robots.txt file, and this is what is at https://www.gaytorrent.ru/robots.txt
User-agent: *
Disallow: /pic
Disallow: /signup.php
Disallow: /login.php
Disallow: /lostpassword.php
Disallow: /ok.php
Disallow: /download.php
Allow: /
Sitemap: https://forum.gaytorrent.ru/index.php?action=sitemap;xml
Sitemap: https://www.gaytorrent.ru/sitemap_torrents_index.xml.gzWhy are the last two items explicitly allowed?
-
I like being able to use a regular Google search for this site because it is easier to pinpoint what I'm looking for and also torrents that are no longer available here sometimes show in search results. The on-site search feature here has been very wonky at times, to say the least.