Re: [OT] Indexing of dynamic web sites

This WebDNA talk-list message is from

2003


It keeps the original formatting.
numero = 48024
interpreted = N
texte = >Spider Linker solves this problem by making the invisible pages visible.Looks like a scam.It's nothing but a php script that makes a TOC with links for the SE's to follow. You can have WC create the same thing.A Site Map that's linked to your home page AND a good robots.txt file will do everything this does and more. See Google's info for webmaster for how to create a robots.txt file and using the Allow: tag (even though that's not part of the RFC on bots).Never use the Disallow: tag to try and keep bots away from certain pages. Bad bots will use it to look where they shouldn't.No matter how it's created, a site map is worth its weight in gold to SE's. Just try to avoid using query strings in the URL's. Some won't follow them and those that do won't rank them very highly.Glenn------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: [OT] Indexing of dynamic web sites (Glenn Busbin 2003)
  2. Re: [OT] Indexing of dynamic web sites (Michael Davis 2003)
  3. Re: [OT] Indexing of dynamic web sites (Kimberly D. Walls 2003)
  4. Re: [OT] Indexing of dynamic web sites (Kenneth Grome 2003)
  5. Re: [OT] Indexing of dynamic web sites (Glenn Busbin 2003)
  6. Re: [OT] Indexing of dynamic web sites (Kenneth Grome 2003)
  7. Re: [OT] Indexing of dynamic web sites (Glenn Busbin 2003)
  8. Re: [OT] Indexing of dynamic web sites (Kenneth Grome 2003)
  9. Re: [OT] Indexing of dynamic web sites (Alain Russell 2003)
  10. Re: [OT] Indexing of dynamic web sites (Kimberly D. Walls 2003)
  11. Re: [OT] Indexing of dynamic web sites (Donovan 2003)
  12. Re: [OT] Indexing of dynamic web sites (Donovan 2003)
  13. Re: [OT] Indexing of dynamic web sites (Jeff Logan 2003)
  14. Re: [OT] Indexing of dynamic web sites (Jay Van Vark 2003)
  15. Re: [OT] Indexing of dynamic web sites (Glenn Busbin 2003)
  16. [OT] Indexing of dynamic web sites (Stuart Tremain 2003)
>Spider Linker solves this problem by making the invisible pages visible.Looks like a scam.It's nothing but a php script that makes a TOC with links for the SE's to follow. You can have WC create the same thing.A Site Map that's linked to your home page AND a good robots.txt file will do everything this does and more. See Google's info for webmaster for how to create a robots.txt file and using the Allow: tag (even though that's not part of the RFC on bots).Never use the Disallow: tag to try and keep bots away from certain pages. Bad bots will use it to look where they shouldn't.No matter how it's created, a site map is worth its weight in gold to SE's. Just try to avoid using query strings in the URL's. Some won't follow them and those that do won't rank them very highly.Glenn------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Glenn Busbin

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Shared conversion under WebTen (1998) Automatic Download? (2003) Re:2nd WebCatalog2 Feature Request (1996) Enhancement Request for WebCatalog-NT (1996) 100% CPU (2003) Error Lob.db records error message not name (1997) Nested tags count question (1997) Some Advise needed (1997) [WebDNA] agree? --> [url] broken inside [redirect], on a square-bracket-style include, included from a XML-style page (2009) Time for a hard questions. (1997) ANother SHOWIF problem (1997) Looping control (1997) WebCat2 - [format thousands] (1997) Quantity * price (1997) PDF Writefile problem (2005) 5.0 Pricing (2003) [WebDNA] Image Magick and Webdna (2009) Typhoon Rev. and PCS store problems (1999) WebDNA made easier? (1998) Non-repeating Random Numbers (2002)