Re: New Website with Redakto CMS
This WebDNA talk-list message is from 2003
It keeps the original formatting.
numero = 51869
interpreted = N
texte = On 23.7.2003 17:28 Uhr, "John Peacock"
wrote:> I think his point was that "Disallow" is like an invitation to all of tho=se> less=20> than scrupulous people out there. There are more than a few spiders whic=h> ignore it (and in fact I think it can be a trigger for more aggressive> scanning).That could be. According to the log statistic there are already hundreds ofspiders crawling:-) I will take a look at the robot.txt and adjust it. Than=kyou.Sincerely,Nitai AventaggiatoCEO--Redakto - Content Management that simply worksComputerOil=AE GmbHUnionstrasse 48032 Z=FCrich / SwitzerlandTelefon +41 43 333 1 555info@computeroil.comhttp://computeroil.com-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
On 23.7.2003 17:28 Uhr, "John Peacock" wrote:> I think his point was that "Disallow" is like an invitation to all of tho=se> less=20> than scrupulous people out there. There are more than a few spiders whic=h> ignore it (and in fact I think it can be a trigger for more aggressive> scanning).That could be. According to the log statistic there are already hundreds ofspiders crawling:-) I will take a look at the robot.txt and adjust it. Than=kyou.Sincerely,Nitai AventaggiatoCEO--Redakto - Content Management that simply worksComputerOil=AE GmbHUnionstrasse 48032 Z=FCrich / SwitzerlandTelefon +41 43 333 1 555info@computeroil.comhttp://computeroil.com-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
"Nitai @ ComputerOil"
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
[ot] New List. Was: Webcat no longer supported? (2006)
POST Datamissing? (1998)
A few questions. . . (1997)
rn doesn't work on date fields (1998)
[WebDNA] cant't restart webcatalog missing libcrypto.so.0.9.8 (2014)
[WebDNA] Acceleratin Search / Index Performance in a Formum Service (2013)
Country & Ship-to address & other fields ? (1997)
WebStar 3 crackable !!!! (1998)
WebCat editing, SiteGuard & SiteEdit (1997)
Date or time comparisons have bugs ... (1998)
I give up!! (1997)
WebCat2b15MacPlugIn - [authenticate] not [protect] (1997)
EIMS & emailer conflicts? (1999)
[math date] with non-US date format (2000)
[isfolder] and [filename] (1997)
Location of Browser Info.txt file (1997)
Pass Thru Page? (1998)
creator code (1997)
CC: (1998)
New commands in Final candidate (1997)