Need Help? Contact the Espiya Helpdesk. CLICK HERE


Author Topic: Invisible side of a Website  (Read 2450 times)

force_driv3n

  • The AntiVirus
  • 2009 Cavaliers
  • Active - Top Level
  • *
  • Posts: 560
  • Karma 0
  • Gender: Male
  • Nobody Can Stop Information Insemination
Invisible side of a Website
« on: September 09, 2009, 06:15:01 am »


The Invisible side of a Website


============================

Some websites have a fill called robots.txt in it's root.This file allows or disallows the search engines to report that results to you that the website owner don't want to tell you about. BUT do you know that still you can view these results by typing /robots.txt after the website address; for example, if you want to know what Microsoft hides from you just type http://www.microsoft.com/robots.txt and you will find the list of directories that bill gates want to hide from you.

8-)

=============================
the unexamined life is not worth living and the unexamined thought is not worth having!
             

liquid metal

  • Liquid Metal
  • 2006 Vanguards
  • Active - Top Level
  • *
  • Posts: 541
  • Karma 25
  • Gender: Male
  • ya need some of the good old ultra-violence eh?
Re: Invisible side of a Website
« Reply #1 on: September 25, 2009, 12:06:50 am »
mostly na disallowed sites eh sakanya ng MAC....

 laffman:: laffman::
"this world is the last bastion of HEAVEN before the gates of the BURNING HELL"

sphinxavior

  • Gold Member (Premium)
  • Active - Three Stars
  • *
  • Posts: 369
  • Karma 6
Re: Invisible side of a Website
« Reply #2 on: September 25, 2009, 08:27:08 am »
mostly na disallowed sites eh sakanya ng MAC....

 laffman:: laffman::

ha?
Part of getting a second chance is taking responsibility for the mess you made in the first place.

Ethan Hunt

  • IMF Agent
  • 2008 Guardians
  • Active - Top Level
  • *
  • Posts: 688
  • Karma 3
  • It isn't mission difficult-it's mission impossible
Re: Invisible side of a Website
« Reply #3 on: September 25, 2009, 11:46:22 am »
^ oo nga... ha?!

asylum001

  • 2009 Cavaliers
  • Active - First Star
  • *
  • Posts: 24
  • Karma 0
Re: Invisible side of a Website
« Reply #4 on: October 07, 2009, 09:05:47 am »
anu nmn kng mkta mo 2?

force_driv3n

  • The AntiVirus
  • 2009 Cavaliers
  • Active - Top Level
  • *
  • Posts: 560
  • Karma 0
  • Gender: Male
  • Nobody Can Stop Information Insemination
Re: Invisible side of a Website
« Reply #5 on: October 07, 2009, 09:40:16 pm »
anu nmn kng mkta mo 2?


This file allows or disallows the search engines to report that results to you that the website owner don't want to tell you about.
the unexamined life is not worth living and the unexamined thought is not worth having!