Spider Simulator

You've probably heard about redirection techniques that some webmasters use.  
 
In general these are optimized pages which redirect visitors depending on their browser (User Agent) or their IP address.  
For example, if a search engine robot (e.g. Scooter for Altavista) requests a webpage, then the server detects the User Agent and returns a highly optimized page for this robot, but if a visitor requests the same webpage the server detects its User Agent (e.g. Mozilla xxx Browser) and sends the normal webpage.  
  
1st Position can simulate any search engine robot and retrive most of these hidden optimized webpages of your competitors, unless they use IP redirection techniques.  
 
1. Select from the Options Menu the User Agent/Robot from the list within browser/robot option.  
clip0026.png  
 
 
2. Just type in the web address and press the get page button. If the "view html source box" is checked you will receive the page in html format as below. Here you can see the header information and the source of the page is in html format.  
clip0015.png  
 
3. When the "view html source" is unchecked you will receive the standard web page in browser format (note that only the text is shown not images).  
clip0016.png  
 
 
 
Next  
Doorway Page Builder  


Table of contents  |   1st Position Home page  

© 2000 - 2004 Data OnLine. All rights reserved