Re: [WebDNA] Limits?

This WebDNA talk-list message is from

2009


It keeps the original formatting.
numero = 102322
interpreted = N
texte = Nicely figured! On Apr 1, 2009, at 15:58, "Psi Prime, Matthew A Perosi " wrote: > In relation to this topic. > > One of my production servers has 100 websites on it, all running in > each their own sandbox. > The server has run solid, without a hiccup for 4 years. > > In January I notices that my Triggers were being deleted. Randomly. > I tried to figure out if there was a pattern to it all, and > discovered that they would be deleted between 4:30am - 5:30am right > during the height of my backup process. > > A few weeks later the entire server, all websites, started to > experience a 45-50second delay in loading pages. The WebDNA engine > was practically halting on every page load. > > Here's what I figured out: > Each of the 100 websites has 120+ databases. > Each website had 3 databases dedicated to user tracking (a record of > every product and page viewed), that's 300 tracking databases. > Of the 300 tracking databases, about 10 of them had reached 300MB+ > in size, that's 3GB. > I only have 4GB RAM on that server. > The massive slow down was caused by the databases needing time to > commit, flush and reload. > Once I deactivated the tracking on the 10 databases the server > immediately went back to normal operations. > > Getting back to the trigger issue... > What I later realized was that during the backup process every night > the server creates a zip file of each website and saves it into a > temp folder, then transfers it to my backup machine. Whenever the > server started the zip of a very large website it was causing a > memory overflow and all the WebDNA databases were being pushed out > of memory before they could finish committing and flushing. I would > find a few empty database files on the websites, but I always found > all of my active Triggers.db cleared out. I also would find a > partially saved file called Triggers.db.TeMpOr (i can't actually > remember the real temporary file name, but it was something like > that.) in every Sandbox. This Trigger issue was resolved the same > day I fixed the issue with the 300MB databases I described above. > > Matthew A Perosi JewelerWebsites.com > ------------------------------by Psi Prime------- > Senior Web Developer 323 Union Blvd. > Totowa, NJ 07512 > Pre-Sales: 888.872.0274 > Service: 973.413.8213 > Training: 973.413.8214 > Fax: 973.413.8217 > > http://www.jewelerwebsites.com > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc > http://www.psiprime.com > > > > Govinda wrote: >> I remember back in v.3 days (v.4 too?) the stated limit (from >> WebDNA's side) was (IIRC) "maximum of 100 open databases". >> Later we were informed something like, 'WenDNA is now so >> intelligent in the way that it opens and closes databases that >> there is effectively no limit since once the limit is reached then >> WebDNA closes one that is not being used and opens the new one >> being called so well that to the end user it is as good as 'no >> limits'. >> -G >> >>> Bob, what gives your customer the impression that there is >>> a limit? What is his needs and what is he doing? >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] Limits? (rupert ravens 2009)
  2. Re: [WebDNA] Limits? (christophe.billiottet@webdna.us 2009)
  3. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  4. Re: [WebDNA] Limits? (rupert ravens 2009)
  5. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  6. Re: [WebDNA] Limits? (Donovan Brooke 2009)
  7. Re: [WebDNA] Limits? (Dale - Ehome 2009)
  8. RE: [WebDNA] Limits? ("Olin Lagon" 2009)
  9. Re: [WebDNA] Limits? (Bob Minor 2009)
  10. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  11. RE: [WebDNA] Limits? ("Michael A. DeLorenzo" 2009)
  12. Re: [WebDNA] Limits? (Govinda 2009)
  13. Re: [WebDNA] Limits? (Donovan Brooke 2009)
  14. Re: [WebDNA] Limits? (christophe.billiottet@webdna.us 2009)
  15. [WebDNA] Limits? (Bob Minor 2009)
Nicely figured! On Apr 1, 2009, at 15:58, "Psi Prime, Matthew A Perosi " wrote: > In relation to this topic. > > One of my production servers has 100 websites on it, all running in > each their own sandbox. > The server has run solid, without a hiccup for 4 years. > > In January I notices that my triggers were being deleted. Randomly. > I tried to figure out if there was a pattern to it all, and > discovered that they would be deleted between 4:30am - 5:30am right > during the height of my backup process. > > A few weeks later the entire server, all websites, started to > experience a 45-50second delay in loading pages. The WebDNA engine > was practically halting on every page load. > > Here's what I figured out: > Each of the 100 websites has 120+ databases. > Each website had 3 databases dedicated to user tracking (a record of > every product and page viewed), that's 300 tracking databases. > Of the 300 tracking databases, about 10 of them had reached 300MB+ > in size, that's 3GB. > I only have 4GB RAM on that server. > The massive slow down was caused by the databases needing time to > commit, flush and reload. > Once I deactivated the tracking on the 10 databases the server > immediately went back to normal operations. > > Getting back to the trigger issue... > What I later realized was that during the backup process every night > the server creates a zip file of each website and saves it into a > temp folder, then transfers it to my backup machine. Whenever the > server started the zip of a very large website it was causing a > memory overflow and all the WebDNA databases were being pushed out > of memory before they could finish committing and flushing. I would > find a few empty database files on the websites, but I always found > all of my active triggers.db cleared out. I also would find a > partially saved file called triggers.db.TeMpOr (i can't actually > remember the real temporary file name, but it was something like > that.) in every Sandbox. This Trigger issue was resolved the same > day I fixed the issue with the 300MB databases I described above. > > Matthew A Perosi JewelerWebsites.com > ------------------------------by Psi Prime------- > Senior Web Developer 323 Union Blvd. > Totowa, NJ 07512 > Pre-Sales: 888.872.0274 > Service: 973.413.8213 > Training: 973.413.8214 > Fax: 973.413.8217 > > http://www.jewelerwebsites.com > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc > http://www.psiprime.com > > > > Govinda wrote: >> I remember back in v.3 days (v.4 too?) the stated limit (from >> WebDNA's side) was (IIRC) "maximum of 100 open databases". >> Later we were informed something like, 'WenDNA is now so >> intelligent in the way that it opens and closes databases that >> there is effectively no limit since once the limit is reached then >> WebDNA closes one that is not being used and opens the new one >> being called so well that to the end user it is as good as 'no >> limits'. >> -G >> >>> Bob, what gives your customer the impression that there is >>> a limit? What is his needs and what is he doing? >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Bob Minor

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Total number (2004) [format xs] freeze (1997) RE: WebDNA-Talk searchable? (1997) OT : javascript form filling (2000) timing out? (1997) [OT] Redhat 6.1 (2003) OFF-TOPIC: Check www.godaddy.com for me ... (2003) WebCat2b15MacPlugin - [protect] (1997) Help Please WebDNA 6 Secure Forms Problem (2004) emailer w/F2 (1997) SiteEdit NewFile.html ? (1997) More NT encyption!! (1999) Multiple prices (1997) [WebDNA] agree? --> [url] broken inside [redirect], on a square-bracket-style include, included from a XML-style page (2009) Document Contains No Data, Blank Pages with b4, b6 mac! (1999) Can Web Cat Do this? - LOOK (2000) [WriteFile] problems (1997) Pass a form (2003) Dummy Credit Card Number for debug? (1997) WebCatalog vs WebDNA (2002)