Re: SOP for WebDNA talk - MSNBot Crashing

This WebDNA talk-list message is from

2004


It keeps the original formatting.
numero = 57802
interpreted = N
texte = Blocking the ranges of IP's used by the MSNBot servers via the firewall did the trick.... BUT the client wants the sites indexed by MSN. Gotta let them in... Gotta keep webcat from crashing a thousand times an hour... Paul On 5/13/04 2:09 PM, "Gary Krockover" wrote: > Can you do a redirect for MSNBots, something like: > > [showif [browsername]^MSNBOT] > [redirect (to a static sitemap that has no links & doesn't carry the [cart])] > [/showif] > > Not sure if that would rectify the problem, just thinking out loud.... > > GK > > At 11:37 AM 5/13/2004, you wrote: >> Scott, >> >> This looks like what I experienced last week. I tracked the cart problems >> down to MSNBot which was flooding the shopping cart folder with carts. Many >> of the carts had file names that where hundreds of characters long. That was >> partly due to the way I handle cart naming for repeat customers. >> >> MSNBot is beta. I think it is flawed. MSN insists that it's just >> sophisticated. And perhaps it is WebDNA that is flawed. >> >> There may be some truth to that. Large volumes of carts or long file names >> for carts should not cause Webcatalog to crash, but it does... And with >> great frequency and predictability. >> >> So Scott, if there is anything that you can do to stop this crashing >> behavior displayed when MSNBot floods our servers it would be greatly >> appreciated. >> >> Crashes occur on 4.5.1, 5.0.1 and 6 >> >> Thanks, Paul > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ ________________________________________________________ Paul Uttermohlen http://www.Anoweb.com/ http://www.Uttermohlen.com/ Paul@Anoweb.com Columbus, Ohio 43026 614-529-8963 _______________________________________________________ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  2. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  3. Re: SOP for WebDNA talk - MSNBot Crashing ( "Scott Anderson" 2004)
  4. Re: SOP for WebDNA talk - MSNBot Crashing ( Frank Nordberg 2004)
  5. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  6. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  7. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  8. Re: SOP for WebDNA talk - MSNBot Crashing ( Donovan Brooke 2004)
  9. Re: SOP for WebDNA talk - MSNBot Crashing ( Donovan Brooke 2004)
  10. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  11. Re: SOP for WebDNA talk - MSNBot Crashing ( Alain Russell 2004)
  12. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  13. Re: SOP for WebDNA talk - MSNBot Crashing ( Alain Russell 2004)
  14. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  15. Re: SOP for WebDNA talk - MSNBot Crashing ( Gary Krockover 2004)
  16. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
Blocking the ranges of IP's used by the MSNBot servers via the firewall did the trick.... BUT the client wants the sites indexed by MSN. Gotta let them in... Gotta keep webcat from crashing a thousand times an hour... Paul On 5/13/04 2:09 PM, "Gary Krockover" wrote: > Can you do a redirect for MSNBots, something like: > > [showif [browsername]^MSNBOT] > [redirect (to a static sitemap that has no links & doesn't carry the [cart])] > [/showif] > > Not sure if that would rectify the problem, just thinking out loud.... > > GK > > At 11:37 AM 5/13/2004, you wrote: >> Scott, >> >> This looks like what I experienced last week. I tracked the cart problems >> down to MSNBot which was flooding the shopping cart folder with carts. Many >> of the carts had file names that where hundreds of characters long. That was >> partly due to the way I handle cart naming for repeat customers. >> >> MSNBot is beta. I think it is flawed. MSN insists that it's just >> sophisticated. And perhaps it is WebDNA that is flawed. >> >> There may be some truth to that. Large volumes of carts or long file names >> for carts should not cause Webcatalog to crash, but it does... And with >> great frequency and predictability. >> >> So Scott, if there is anything that you can do to stop this crashing >> behavior displayed when MSNBot floods our servers it would be greatly >> appreciated. >> >> Crashes occur on 4.5.1, 5.0.1 and 6 >> >> Thanks, Paul > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ ________________________________________________________ Paul Uttermohlen http://www.Anoweb.com/ http://www.Uttermohlen.com/ Paul@Anoweb.com Columbus, Ohio 43026 614-529-8963 _______________________________________________________ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Paul Uttermohlen

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Word Break (1999) taxTotal (1997) Site builder (2004) Pithy questions on webcommerce & siteedit (1997) Problems with [Search] param - Mac Plugin b15 (1997) WCS Newbie question (1997) Searching multiple fields (1997) [WebDNA] RETS... HELP! (2009) GoLive CyberStudio 1.0.1 (1997) WebCat2 several catalogs? (1997) Hard Questions ? (1997) notification solutions (1997) Math Help (2000) Possible Hijacking from Globix (2002) [WebDNA] END processing (2014) international time (1997) ANother SHOWIF problem (1997) RE: MacFinder -- a new WebDNA web site (1998) [WebDNA] Advices for Linux Config (2017) searching by date range help needed (1997)