Re: [WebDNA] WebDNA slow processing
This WebDNA talk-list message is from 2011
It keeps the original formatting.
numero = 107741
interpreted = N
texte = I followed your advice and shut off the error logging. I had thought the errors we only appended to the file but they may have been consuming RAM and CPU. I will try the removal option as well and resume error logging only while trouble shooting. Thanks, Bill On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr.
wrote: > Bill if you want to clean up all those old error log files and start fres= h on your mac you can run this command line via sudo > > find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; > > where /Your/Web/Root is actually the path to your webserver root folder i= e /Library/WebServer/Documents > > then turn logging back on when your ready to trouble shoot your pages. Us= e this command to find where all the error logs are: > > find /Your/Web/Root -name ErrorLog.txt > > Personally you I don't think error logging should be kept on indefinitely= . Its a troubleshooting aid and shouldn't be turned on unless your actively= using it. > > On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > >> I can also report that turning off all error logging has helped my >> situation. =A0Now when I see 99.9% WebCatalog activity for extended >> time, the system stays responsive. >> >> Bill >> >> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wrot= e: >>> Can you tell us what column 3, 4, and 6 are used for? >>> >>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 w= rote: >>>> Based on what you copy here, the problem seems to be a RAM problem: da= tabases and templates are loaded in RAM by WebDNA, and there might be other= applications running on your server that could need lots of memory (Safari= is a good example). You can type "free" in your terminal to see the avaiab= le RAM, check the swap usage (this would tremendously slow things down) or = even use your "Activity Monitor" application >>>> >>>> >>>> Here is the .debug exemple, broken in lines to simplify the reading >>>> >>>> The webdna.debug, activated by "Technical Support Information" >>>> >>>> 1.- 11/18/08 >>>> 2.- 14:20:09 >>>> 3.- 11 >>>> 4.- -944508928 >>>> 5.- 024.183.098.016 >>>> 6.- >>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) G= ecko/20050416 >>>> 9.- login >>>> 10.- password >>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.t= pl >>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 13.- /var/www/html/ >>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&S= erialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25= M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centur= yBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScrip= t=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockS= econds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSho= wPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+= NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmcc= n=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.1= 140128720646497800.1222376773.1226506042.1226682779.28& >>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B= %20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko= /20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ct= ext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&A= ccept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acce= pt-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&= Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalo= gEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.ut= mcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmc= ct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.12= 26506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Con= tent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>> >>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0w= ill provide the problematic code and the domain name: >>>> >>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGSE= GV: >>>> ContextName: [EXCLUSIVELOCK] >>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/p= rocessorders.tpl >>>> Includefile: ^WebMerchant/DoPurchases.inc >>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&lookI= nField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&lo= okInField=3Dpreference&value=3DCompletedF >>>> >>>> >>>> - chris >>>> >>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>> >>>>> Hi >>>>> >>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, 6= GB RAM, OS 10.6.8, iTools 9.0.5i >>>>> Apache has about 35 vhosts >>>>> >>>>> As soon as the server gets a bit load (~100 concurrent connections) a= nd WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to = serve a page with WebDNA. >>>>> Since we have 8-Cores in the server, I guess WebDNA should be able to= use more than 160% .... or am I wrong? >>>>> >>>>> Pages served directly from apache (no DNA) appear very quick. >>>>> >>>>> In cases of heavy load I have the following lines in the console log: >>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Cou= ld not establish connection with the module. >>>>> >>>>> >>>>> And I've also seen the following lines, which makes me even more nerv= ous: >>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>> >>>>> All the lines are repeated several times. >>>>> >>>>> >>>>> How can I find out what's blocking WebCatalog? >>>>> Is something wrong with my module? >>>>> >>>>> >>>>> Thanks for any help >>>>> Thierry >>>>> >>>>> ______________________ >>>>> mac&web gmbh >>>>> thierry almy >>>>> grabenstrasse 15 >>>>> 8200 schaffhausen >>>>> switzerland >>>>> web =A0 www.mac-web.ch >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us > > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us >
Associated Messages, from the most recent to the oldest:
I followed your advice and shut off the error logging. I had thought the errors we only appended to the file but they may have been consuming RAM and CPU. I will try the removal option as well and resume error logging only while trouble shooting. Thanks, Bill On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. wrote: > Bill if you want to clean up all those old error log files and start fres= h on your mac you can run this command line via sudo > > find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; > > where /Your/Web/Root is actually the path to your webserver root folder i= e /Library/WebServer/Documents > > then turn logging back on when your ready to trouble shoot your pages. Us= e this command to find where all the error logs are: > > find /Your/Web/Root -name ErrorLog.txt > > Personally you I don't think error logging should be kept on indefinitely= . Its a troubleshooting aid and shouldn't be turned on unless your actively= using it. > > On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > >> I can also report that turning off all error logging has helped my >> situation. =A0Now when I see 99.9% WebCatalog activity for extended >> time, the system stays responsive. >> >> Bill >> >> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wrot= e: >>> Can you tell us what column 3, 4, and 6 are used for? >>> >>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 w= rote: >>>> Based on what you copy here, the problem seems to be a RAM problem: da= tabases and templates are loaded in RAM by WebDNA, and there might be other= applications running on your server that could need lots of memory (Safari= is a good example). You can type "free" in your terminal to see the avaiab= le RAM, check the swap usage (this would tremendously slow things down) or = even use your "Activity Monitor" application >>>> >>>> >>>> Here is the .debug exemple, broken in lines to simplify the reading >>>> >>>> The webdna.debug, activated by "Technical Support Information" >>>> >>>> 1.- 11/18/08 >>>> 2.- 14:20:09 >>>> 3.- 11 >>>> 4.- -944508928 >>>> 5.- 024.183.098.016 >>>> 6.- >>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) G= ecko/20050416 >>>> 9.- login >>>> 10.- password >>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.t= pl >>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 13.- /var/www/html/ >>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&S= erialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25= M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centur= yBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScrip= t=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockS= econds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSho= wPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+= NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmcc= n=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.1= 140128720646497800.1222376773.1226506042.1226682779.28& >>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B= %20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko= /20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ct= ext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&A= ccept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acce= pt-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&= Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalo= gEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.ut= mcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmc= ct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.12= 26506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Con= tent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>> >>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0w= ill provide the problematic code and the domain name: >>>> >>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGSE= GV: >>>> ContextName: [exclusivelock] >>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/p= rocessorders.tpl >>>> Includefile: ^WebMerchant/DoPurchases.inc >>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&lookI= nField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&lo= okInField=3Dpreference&value=3DCompletedF >>>> >>>> >>>> - chris >>>> >>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>> >>>>> Hi >>>>> >>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, 6= GB RAM, OS 10.6.8, iTools 9.0.5i >>>>> Apache has about 35 vhosts >>>>> >>>>> As soon as the server gets a bit load (~100 concurrent connections) a= nd WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to = serve a page with WebDNA. >>>>> Since we have 8-Cores in the server, I guess WebDNA should be able to= use more than 160% .... or am I wrong? >>>>> >>>>> Pages served directly from apache (no DNA) appear very quick. >>>>> >>>>> In cases of heavy load I have the following lines in the console log: >>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Cou= ld not establish connection with the module. >>>>> >>>>> >>>>> And I've also seen the following lines, which makes me even more nerv= ous: >>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>> >>>>> All the lines are repeated several times. >>>>> >>>>> >>>>> How can I find out what's blocking WebCatalog? >>>>> Is something wrong with my module? >>>>> >>>>> >>>>> Thanks for any help >>>>> Thierry >>>>> >>>>> ______________________ >>>>> mac&web gmbh >>>>> thierry almy >>>>> grabenstrasse 15 >>>>> 8200 schaffhausen >>>>> switzerland >>>>> web =A0 www.mac-web.ch >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us > > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us >
William DeVaul
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WebCat2 - Getting to the browser's username/password data (1997)
Re:listfiles-looking for slick solution (1997)
FYI: virus alert (1996)
WebCat2b15MacPlugin - showing [math] (1997)
.htaccess to make WebDNA serve HTML (2007)
Cart Numbers (1997)
can you reassign loop index? (1998)
Email Mac (2002)
Group search doesn't work. (1997)
Re:Listfiles (1998)
frames & carts (1997)
no global [username] or [password] displayed ... (1997)
setting line item numbers (1998)
WebCatalog NT beta 18 problem (1997)
WebCatalog Features (1997)
Summing fields (1997)
requiring form fields? (2000)
webcat NT (1998)
categories and subcategories (2004)
Bug or syntax error on my part? (1997)