Re: [WebDNA] WebDNA slow processing

This WebDNA talk-list message is from

2011


It keeps the original formatting.
numero = 107738
interpreted = N
texte = Bill if you want to clean up all those old error log files and start = fresh on your mac you can run this command line via sudo find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; where /Your/Web/Root is actually the path to your webserver root folder = ie /Library/WebServer/Documents=20 then turn logging back on when your ready to trouble shoot your pages. = Use this command to find where all the error logs are: find /Your/Web/Root -name ErrorLog.txt Personally you I don't think error logging should be kept on = indefinitely. Its a troubleshooting aid and shouldn't be turned on = unless your actively using it.=20 On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > I can also report that turning off all error logging has helped my > situation. Now when I see 99.9% WebCatalog activity for extended > time, the system stays responsive. >=20 > Bill >=20 > On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul = wrote: >> Can you tell us what column 3, 4, and 6 are used for? >>=20 >> On Sat, Nov 26, 2011 at 7:25 AM, = wrote: >>> Based on what you copy here, the problem seems to be a RAM problem: = databases and templates are loaded in RAM by WebDNA, and there might be = other applications running on your server that could need lots of memory = (Safari is a good example). You can type "free" in your terminal to see = the avaiable RAM, check the swap usage (this would tremendously slow = things down) or even use your "Activity Monitor" application >>>=20 >>>=20 >>> Here is the .debug exemple, broken in lines to simplify the reading >>>=20 >>> The webdna.debug, activated by "Technical Support Information" >>>=20 >>> 1.- 11/18/08 >>> 2.- 14:20:09 >>> 3.- 11 >>> 4.- -944508928 >>> 5.- 024.183.098.016 >>> 6.- >>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) = Gecko/20050416 >>> 9.- login >>> 10.- password >>> 11.- = http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 13.- /var/www/html/ >>> 14.- = command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&SerialNumb= er2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25M%3A%25S= &ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&CenturyBreak=3D= 0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScript=3D0&Ca= cheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockSeconds=3D= 20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DShowPage%2C= +FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+NewCart= Search%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions=3D.tmp= l+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabaseExten= sions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath=3D0&In= secureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal=3D0&L= ogError=3D0&DisplayError=3D1 >>> 15.- = __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmccn=3D(refe= rral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.114012872= 0646497800.1222376773.1226506042.1226682779.28& >>> 16.- Host=3D = www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B%20U%3B%20PPC%20M= ac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko/20050416&Accept= =3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ctext/html%3Bq%3D= 0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&Accept-Language= =3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Accept-Charset=3D= ISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&Connection=3D= keep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalogEngine/Admi= n/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.utmcsr%3Dstor= e.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmcct%3D/defa= ult.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.1226506042.= 1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Content-Typ= e=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>=20 >>> The SignalCatcher.debug, activated by "Catching Terminate signal" = will provide the problematic code and the domain name: >>>=20 >>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive = SIGSEGV: >>> ContextName: [EXCLUSIVELOCK] >>> TemplatePath: = /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/processorders.tpl >>> Includefile: ^WebMerchant/DoPurchases.inc >>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>> [text]ordersFolder=3D../[lookup = db=3DSandBoxPrefs&lookInField=3Dpreference&value=3DOrdersFolder&returnFiel= d=3Dvalue][/text] >>> [text]completedFolder=3D../[lookup = db=3DSandBoxPrefs&lookInField=3Dpreference&value=3DCompletedF >>>=20 >>>=20 >>> - chris >>>=20 >>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>=20 >>>> Hi >>>>=20 >>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>> Apache has about 35 vhosts >>>>=20 >>>> As soon as the server gets a bit load (~100 concurrent connections) = and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds = to serve a page with WebDNA. >>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to use more than 160% .... or am I wrong? >>>>=20 >>>> Pages served directly from apache (no DNA) appear very quick. >>>>=20 >>>> In cases of heavy load I have the following lines in the console = log: >>>> 25.11.11 14:26:43 sioux WebDNA[210] Error Could not = establish connection with the module. >>>>=20 >>>>=20 >>>> And I've also seen the following lines, which makes me even more = nervous: >>>> 25.11.11 11:18:44 sioux com.apple.SystemStarter[36] = Notice *** set a breakpoint in malloc_error_break to debug >>>> 25.11.11 11:18:45 sioux com.apple.SystemStarter[36] = Notice WebCatalog(210,0xa047a540) malloc: *** error for object = 0xe0c970: pointer being freed was not allocated >>>> 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] = Notice sem_open failed: returned EMFILE: Too many open files >>>>=20 >>>> All the lines are repeated several times. >>>>=20 >>>>=20 >>>> How can I find out what's blocking WebCatalog? >>>> Is something wrong with my module? >>>>=20 >>>>=20 >>>> Thanks for any help >>>> Thierry >>>>=20 >>>> ______________________ >>>> mac&web gmbh >>>> thierry almy >>>> grabenstrasse 15 >>>> 8200 schaffhausen >>>> switzerland >>>> web www.mac-web.ch >>>>=20 >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>>=20 >>=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] WebDNA slow processing - conclusion (Kenneth Grome 2011)
  2. Re: [WebDNA] WebDNA slow processing - conclusion (Thierry Almy 2011)
  3. Re: [WebDNA] WebDNA slow processing (Kenneth Grome 2011)
  4. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  5. Re: [WebDNA] WebDNA slow processing (Kenneth Grome 2011)
  6. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  7. Re: [WebDNA] WebDNA slow processing (Kenneth Grome 2011)
  8. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  9. Re: [WebDNA] WebDNA slow processing (Kenneth Grome 2011)
  10. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  11. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  12. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  13. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  14. Re: [WebDNA] WebDNA slow processing (Kenneth Grome 2011)
  15. Re: [WebDNA] WebDNA slow processing (Donovan Brooke 2011)
  16. Re: [WebDNA] WebDNA slow processing ("Mr. Robert Minor Jr." 2011)
  17. Re: [WebDNA] WebDNA slow processing (Donovan Brooke 2011)
  18. Re: [WebDNA] WebDNA slow processing (christophe.billiottet@webdna.us 2011)
  19. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  20. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  21. Re: [WebDNA] WebDNA slow processing (christophe.billiottet@webdna.us 2011)
  22. Re: [WebDNA] WebDNA slow processing ("lists@almy.ch" 2011)
  23. Re: [WebDNA] WebDNA slow processing (christophe.billiottet@webdna.us 2011)
  24. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  25. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  26. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  27. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  28. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  29. Re: [WebDNA] WebDNA slow processing (Donovan Brooke 2011)
  30. Re: [WebDNA] WebDNA slow processing (Donovan Brooke 2011)
  31. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  32. Re: [WebDNA] WebDNA slow processing (William DeVaul 2011)
  33. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  34. Re: [WebDNA] WebDNA slow processing (Thierry Almy 2011)
  35. Re: [WebDNA] WebDNA slow processing (Daniel Meola 2011)
  36. Re: [WebDNA] WebDNA slow processing (D Brooke 2011)
  37. [WebDNA] WebDNA slow processing (Thierry Almy 2011)
Bill if you want to clean up all those old error log files and start = fresh on your mac you can run this command line via sudo find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; where /Your/Web/Root is actually the path to your webserver root folder = ie /Library/WebServer/Documents=20 then turn logging back on when your ready to trouble shoot your pages. = Use this command to find where all the error logs are: find /Your/Web/Root -name ErrorLog.txt Personally you I don't think error logging should be kept on = indefinitely. Its a troubleshooting aid and shouldn't be turned on = unless your actively using it.=20 On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > I can also report that turning off all error logging has helped my > situation. Now when I see 99.9% WebCatalog activity for extended > time, the system stays responsive. >=20 > Bill >=20 > On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul = wrote: >> Can you tell us what column 3, 4, and 6 are used for? >>=20 >> On Sat, Nov 26, 2011 at 7:25 AM, = wrote: >>> Based on what you copy here, the problem seems to be a RAM problem: = databases and templates are loaded in RAM by WebDNA, and there might be = other applications running on your server that could need lots of memory = (Safari is a good example). You can type "free" in your terminal to see = the avaiable RAM, check the swap usage (this would tremendously slow = things down) or even use your "Activity Monitor" application >>>=20 >>>=20 >>> Here is the .debug exemple, broken in lines to simplify the reading >>>=20 >>> The webdna.debug, activated by "Technical Support Information" >>>=20 >>> 1.- 11/18/08 >>> 2.- 14:20:09 >>> 3.- 11 >>> 4.- -944508928 >>> 5.- 024.183.098.016 >>> 6.- >>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) = Gecko/20050416 >>> 9.- login >>> 10.- password >>> 11.- = http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>> 13.- /var/www/html/ >>> 14.- = command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&SerialNumb= er2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25M%3A%25S= &ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&CenturyBreak=3D= 0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScript=3D0&Ca= cheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockSeconds=3D= 20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DShowPage%2C= +FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+NewCart= Search%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions=3D.tmp= l+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabaseExten= sions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath=3D0&In= secureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal=3D0&L= ogError=3D0&DisplayError=3D1 >>> 15.- = __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmccn=3D(refe= rral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.114012872= 0646497800.1222376773.1226506042.1226682779.28& >>> 16.- Host=3D = www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B%20U%3B%20PPC%20M= ac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko/20050416&Accept= =3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ctext/html%3Bq%3D= 0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&Accept-Language= =3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Accept-Charset=3D= ISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&Connection=3D= keep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalogEngine/Admi= n/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.utmcsr%3Dstor= e.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmcct%3D/defa= ult.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.1226506042.= 1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Content-Typ= e=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>=20 >>> The SignalCatcher.debug, activated by "Catching Terminate signal" = will provide the problematic code and the domain name: >>>=20 >>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive = SIGSEGV: >>> ContextName: [exclusivelock] >>> TemplatePath: = /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/processorders.tpl >>> Includefile: ^WebMerchant/DoPurchases.inc >>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>> [text]ordersFolder=3D../[lookup = db=3DSandBoxPrefs&lookInField=3Dpreference&value=3DOrdersFolder&returnFiel= d=3Dvalue][/text] >>> [text]completedFolder=3D../[lookup = db=3DSandBoxPrefs&lookInField=3Dpreference&value=3DCompletedF >>>=20 >>>=20 >>> - chris >>>=20 >>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>=20 >>>> Hi >>>>=20 >>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>> Apache has about 35 vhosts >>>>=20 >>>> As soon as the server gets a bit load (~100 concurrent connections) = and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds = to serve a page with WebDNA. >>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to use more than 160% .... or am I wrong? >>>>=20 >>>> Pages served directly from apache (no DNA) appear very quick. >>>>=20 >>>> In cases of heavy load I have the following lines in the console = log: >>>> 25.11.11 14:26:43 sioux WebDNA[210] Error Could not = establish connection with the module. >>>>=20 >>>>=20 >>>> And I've also seen the following lines, which makes me even more = nervous: >>>> 25.11.11 11:18:44 sioux com.apple.SystemStarter[36] = Notice *** set a breakpoint in malloc_error_break to debug >>>> 25.11.11 11:18:45 sioux com.apple.SystemStarter[36] = Notice WebCatalog(210,0xa047a540) malloc: *** error for object = 0xe0c970: pointer being freed was not allocated >>>> 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] = Notice sem_open failed: returned EMFILE: Too many open files >>>>=20 >>>> All the lines are repeated several times. >>>>=20 >>>>=20 >>>> How can I find out what's blocking WebCatalog? >>>> Is something wrong with my module? >>>>=20 >>>>=20 >>>> Thanks for any help >>>> Thierry >>>>=20 >>>> ______________________ >>>> mac&web gmbh >>>> thierry almy >>>> grabenstrasse 15 >>>> 8200 schaffhausen >>>> switzerland >>>> web www.mac-web.ch >>>>=20 >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>>=20 >>=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us "Mr. Robert Minor Jr."

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Authenticate (1997) [OT] Test (2003) Help! WebCat2 bug (1997) [WebDNA] test (2009) Frames and WebCat (1997) why start a new thread the official way, --- WAS: [WebDNA] Quick grep question (2009) [WebDNA] [OT] Spam reduction? (2009) Adding up line items. (2000) 'does not contain' operator needed ... (1997) I'm new be kind (1997) updating with ProductEditor (1998) SiteEdit Pro Update Announcement (1997) delete a record and ssl (2005) Case sensitivity and [showif] (1999) ListFiles (1998) Re[2]: Using [Include] Context (1999) Color options for items (1999) reading a email (2000) Requiring that certain fields be completed (1997) 2nd try:Webcat interfering with Webstar? (1998)