Re: [WebDNA] Limits?

This WebDNA talk-list message is from

2009


It keeps the original formatting.
numero = 102322
interpreted = N
texte = Nicely figured! On Apr 1, 2009, at 15:58, "Psi Prime, Matthew A Perosi " wrote: > In relation to this topic. > > One of my production servers has 100 websites on it, all running in > each their own sandbox. > The server has run solid, without a hiccup for 4 years. > > In January I notices that my Triggers were being deleted. Randomly. > I tried to figure out if there was a pattern to it all, and > discovered that they would be deleted between 4:30am - 5:30am right > during the height of my backup process. > > A few weeks later the entire server, all websites, started to > experience a 45-50second delay in loading pages. The WebDNA engine > was practically halting on every page load. > > Here's what I figured out: > Each of the 100 websites has 120+ databases. > Each website had 3 databases dedicated to user tracking (a record of > every product and page viewed), that's 300 tracking databases. > Of the 300 tracking databases, about 10 of them had reached 300MB+ > in size, that's 3GB. > I only have 4GB RAM on that server. > The massive slow down was caused by the databases needing time to > commit, flush and reload. > Once I deactivated the tracking on the 10 databases the server > immediately went back to normal operations. > > Getting back to the trigger issue... > What I later realized was that during the backup process every night > the server creates a zip file of each website and saves it into a > temp folder, then transfers it to my backup machine. Whenever the > server started the zip of a very large website it was causing a > memory overflow and all the WebDNA databases were being pushed out > of memory before they could finish committing and flushing. I would > find a few empty database files on the websites, but I always found > all of my active Triggers.db cleared out. I also would find a > partially saved file called Triggers.db.TeMpOr (i can't actually > remember the real temporary file name, but it was something like > that.) in every Sandbox. This Trigger issue was resolved the same > day I fixed the issue with the 300MB databases I described above. > > Matthew A Perosi JewelerWebsites.com > ------------------------------by Psi Prime------- > Senior Web Developer 323 Union Blvd. > Totowa, NJ 07512 > Pre-Sales: 888.872.0274 > Service: 973.413.8213 > Training: 973.413.8214 > Fax: 973.413.8217 > > http://www.jewelerwebsites.com > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc > http://www.psiprime.com > > > > Govinda wrote: >> I remember back in v.3 days (v.4 too?) the stated limit (from >> WebDNA's side) was (IIRC) "maximum of 100 open databases". >> Later we were informed something like, 'WenDNA is now so >> intelligent in the way that it opens and closes databases that >> there is effectively no limit since once the limit is reached then >> WebDNA closes one that is not being used and opens the new one >> being called so well that to the end user it is as good as 'no >> limits'. >> -G >> >>> Bob, what gives your customer the impression that there is >>> a limit? What is his needs and what is he doing? >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] Limits? (rupert ravens 2009)
  2. Re: [WebDNA] Limits? (christophe.billiottet@webdna.us 2009)
  3. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  4. Re: [WebDNA] Limits? (rupert ravens 2009)
  5. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  6. Re: [WebDNA] Limits? (Donovan Brooke 2009)
  7. Re: [WebDNA] Limits? (Dale - Ehome 2009)
  8. RE: [WebDNA] Limits? ("Olin Lagon" 2009)
  9. Re: [WebDNA] Limits? (Bob Minor 2009)
  10. Re: [WebDNA] Limits? ("Psi Prime, Matthew A Perosi " 2009)
  11. RE: [WebDNA] Limits? ("Michael A. DeLorenzo" 2009)
  12. Re: [WebDNA] Limits? (Govinda 2009)
  13. Re: [WebDNA] Limits? (Donovan Brooke 2009)
  14. Re: [WebDNA] Limits? (christophe.billiottet@webdna.us 2009)
  15. [WebDNA] Limits? (Bob Minor 2009)
Nicely figured! On Apr 1, 2009, at 15:58, "Psi Prime, Matthew A Perosi " wrote: > In relation to this topic. > > One of my production servers has 100 websites on it, all running in > each their own sandbox. > The server has run solid, without a hiccup for 4 years. > > In January I notices that my triggers were being deleted. Randomly. > I tried to figure out if there was a pattern to it all, and > discovered that they would be deleted between 4:30am - 5:30am right > during the height of my backup process. > > A few weeks later the entire server, all websites, started to > experience a 45-50second delay in loading pages. The WebDNA engine > was practically halting on every page load. > > Here's what I figured out: > Each of the 100 websites has 120+ databases. > Each website had 3 databases dedicated to user tracking (a record of > every product and page viewed), that's 300 tracking databases. > Of the 300 tracking databases, about 10 of them had reached 300MB+ > in size, that's 3GB. > I only have 4GB RAM on that server. > The massive slow down was caused by the databases needing time to > commit, flush and reload. > Once I deactivated the tracking on the 10 databases the server > immediately went back to normal operations. > > Getting back to the trigger issue... > What I later realized was that during the backup process every night > the server creates a zip file of each website and saves it into a > temp folder, then transfers it to my backup machine. Whenever the > server started the zip of a very large website it was causing a > memory overflow and all the WebDNA databases were being pushed out > of memory before they could finish committing and flushing. I would > find a few empty database files on the websites, but I always found > all of my active triggers.db cleared out. I also would find a > partially saved file called triggers.db.TeMpOr (i can't actually > remember the real temporary file name, but it was something like > that.) in every Sandbox. This Trigger issue was resolved the same > day I fixed the issue with the 300MB databases I described above. > > Matthew A Perosi JewelerWebsites.com > ------------------------------by Psi Prime------- > Senior Web Developer 323 Union Blvd. > Totowa, NJ 07512 > Pre-Sales: 888.872.0274 > Service: 973.413.8213 > Training: 973.413.8214 > Fax: 973.413.8217 > > http://www.jewelerwebsites.com > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc > http://www.psiprime.com > > > > Govinda wrote: >> I remember back in v.3 days (v.4 too?) the stated limit (from >> WebDNA's side) was (IIRC) "maximum of 100 open databases". >> Later we were informed something like, 'WenDNA is now so >> intelligent in the way that it opens and closes databases that >> there is effectively no limit since once the limit is reached then >> WebDNA closes one that is not being used and opens the new one >> being called so well that to the end user it is as good as 'no >> limits'. >> -G >> >>> Bob, what gives your customer the impression that there is >>> a limit? What is his needs and what is he doing? >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Bob Minor

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

PROBLEM (1997) Only charge card when product shipped ? (1997) Calculating multiple shipping... (1997) [WebDNA] Libmysql.dll error (2009) Possible Macv2.1b2 Merge Bug (1997) no global [username] or [password] displayed ... (1997) Re1000001: Setting up shop (1997) [WebDNA] [announce] CentOS and RedHat support for CICADA (2009) Saving Text Areas with Orders (1997) Indexing Web sites? (2000) creating a ShipCosts database (1997) Webmerchant quitting (1998) Multiple Users.db Possible? (1997) [input] [/input] (1997) Goofy Date Sorting (1998) Search (1997) RE: Purchased cart being overwritten (1997) Running 2 two WebCatalog.acgi's (1996) no global [username] or [password] displayed ... (1997) [convertchars] Problem (2000)