Re: [WebDNA] WebDNA slow processing
This WebDNA talk-list message is from 2011
It keeps the original formatting.
numero = 107744
interpreted = N
texte = I removed one nested search so far. Are searches other than "eq" matches more expensive in terms of CPU and/or RAM? I have a "wn" that seems to take some time to run. Bill On Sat, Nov 26, 2011 at 7:29 PM, William DeVaul
wrote: > Looks like shutting off error reporting only does so much. =A0I have > more non-responsiveness from my server. =A0Pages take minutes to return > a result, if they even do so. > > I'll share what I learn. > > Bill > > On Sat, Nov 26, 2011 at 1:08 PM, William DeVaul wrote= : >> I followed your advice and shut off the error logging. =A0I had thought >> the errors we only appended to the file but they may have been >> consuming RAM and CPU. >> >> I will try the removal option as well and resume error logging only >> while trouble shooting. >> >> Thanks, >> Bill >> >> On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. >> wrote: >>> Bill if you want to clean up all those old error log files and start fr= esh on your mac you can run this command line via sudo >>> >>> find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; >>> >>> where /Your/Web/Root is actually the path to your webserver root folder= ie /Library/WebServer/Documents >>> >>> then turn logging back on when your ready to trouble shoot your pages. = Use this command to find where all the error logs are: >>> >>> find /Your/Web/Root -name ErrorLog.txt >>> >>> Personally you I don't think error logging should be kept on indefinite= ly. Its a troubleshooting aid and shouldn't be turned on unless your active= ly using it. >>> >>> On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: >>> >>>> I can also report that turning off all error logging has helped my >>>> situation. =A0Now when I see 99.9% WebCatalog activity for extended >>>> time, the system stays responsive. >>>> >>>> Bill >>>> >>>> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wr= ote: >>>>> Can you tell us what column 3, 4, and 6 are used for? >>>>> >>>>> On Sat, Nov 26, 2011 at 7:25 AM, =A0= wrote: >>>>>> Based on what you copy here, the problem seems to be a RAM problem: = databases and templates are loaded in RAM by WebDNA, and there might be oth= er applications running on your server that could need lots of memory (Safa= ri is a good example). You can type "free" in your terminal to see the avai= able RAM, check the swap usage (this would tremendously slow things down) o= r even use your "Activity Monitor" application >>>>>> >>>>>> >>>>>> Here is the .debug exemple, broken in lines to simplify the reading >>>>>> >>>>>> The webdna.debug, activated by "Technical Support Information" >>>>>> >>>>>> 1.- 11/18/08 >>>>>> 2.- 14:20:09 >>>>>> 3.- 11 >>>>>> 4.- -944508928 >>>>>> 5.- 024.183.098.016 >>>>>> 6.- >>>>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7)= Gecko/20050416 >>>>>> 9.- login >>>>>> 10.- password >>>>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs= .tpl >>>>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>>> 13.- /var/www/html/ >>>>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************= &SerialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%= 25M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Cent= uryBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScr= ipt=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&Deadloc= kSeconds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DS= howPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2= C+NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtension= s=3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDataba= seExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utm= ccn=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966= .1140128720646497800.1222376773.1226506042.1226682779.28& >>>>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%= 3B%20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gec= ko/20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2= Ctext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5= &Accept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Ac= cept-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D30= 0&Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCata= logEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.= utmcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cut= mcct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.= 1226506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&C= ontent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>>>> >>>>>> The SignalCatcher.debug, activated by "Catching Terminate signal" = =A0will provide the problematic code and the domain name: >>>>>> >>>>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIG= SEGV: >>>>>> ContextName: [EXCLUSIVELOCK] >>>>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant= /processorders.tpl >>>>>> Includefile: ^WebMerchant/DoPurchases.inc >>>>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db= ] >>>>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&loo= kInField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&= lookInField=3Dpreference&value=3DCompletedF >>>>>> >>>>>> >>>>>> - chris >>>>>> >>>>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>>>> >>>>>>> Hi >>>>>>> >>>>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz,= 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>>>>> Apache has about 35 vhosts >>>>>>> >>>>>>> As soon as the server gets a bit load (~100 concurrent connections)= and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds t= o serve a page with WebDNA. >>>>>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to use more than 160% .... or am I wrong? >>>>>>> >>>>>>> Pages served directly from apache (no DNA) appear very quick. >>>>>>> >>>>>>> In cases of heavy load I have the following lines in the console lo= g: >>>>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 C= ould not establish connection with the module. >>>>>>> >>>>>>> >>>>>>> And I've also seen the following lines, which makes me even more ne= rvous: >>>>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0= c970: pointer being freed was not allocated >>>>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>>>> >>>>>>> All the lines are repeated several times. >>>>>>> >>>>>>> >>>>>>> How can I find out what's blocking WebCatalog? >>>>>>> Is something wrong with my module? >>>>>>> >>>>>>> >>>>>>> Thanks for any help >>>>>>> Thierry >>>>>>> >>>>>>> ______________________ >>>>>>> mac&web gmbh >>>>>>> thierry almy >>>>>>> grabenstrasse 15 >>>>>>> 8200 schaffhausen >>>>>>> switzerland >>>>>>> web =A0 www.mac-web.ch >>>>>>> >>>>>>> --------------------------------------------------------- >>>>>>> This message is sent to you because you are subscribed to >>>>>>> the mailing list . >>>>>>> To unsubscribe, E-mail to: >>>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>>> Bug Reporting: support@webdna.us >>>>>> >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>>> >>>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>> >> >
Associated Messages, from the most recent to the oldest:
I removed one nested search so far. Are searches other than "eq" matches more expensive in terms of CPU and/or RAM? I have a "wn" that seems to take some time to run. Bill On Sat, Nov 26, 2011 at 7:29 PM, William DeVaul wrote: > Looks like shutting off error reporting only does so much. =A0I have > more non-responsiveness from my server. =A0Pages take minutes to return > a result, if they even do so. > > I'll share what I learn. > > Bill > > On Sat, Nov 26, 2011 at 1:08 PM, William DeVaul wrote= : >> I followed your advice and shut off the error logging. =A0I had thought >> the errors we only appended to the file but they may have been >> consuming RAM and CPU. >> >> I will try the removal option as well and resume error logging only >> while trouble shooting. >> >> Thanks, >> Bill >> >> On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. >> wrote: >>> Bill if you want to clean up all those old error log files and start fr= esh on your mac you can run this command line via sudo >>> >>> find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; >>> >>> where /Your/Web/Root is actually the path to your webserver root folder= ie /Library/WebServer/Documents >>> >>> then turn logging back on when your ready to trouble shoot your pages. = Use this command to find where all the error logs are: >>> >>> find /Your/Web/Root -name ErrorLog.txt >>> >>> Personally you I don't think error logging should be kept on indefinite= ly. Its a troubleshooting aid and shouldn't be turned on unless your active= ly using it. >>> >>> On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: >>> >>>> I can also report that turning off all error logging has helped my >>>> situation. =A0Now when I see 99.9% WebCatalog activity for extended >>>> time, the system stays responsive. >>>> >>>> Bill >>>> >>>> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wr= ote: >>>>> Can you tell us what column 3, 4, and 6 are used for? >>>>> >>>>> On Sat, Nov 26, 2011 at 7:25 AM, =A0= wrote: >>>>>> Based on what you copy here, the problem seems to be a RAM problem: = databases and templates are loaded in RAM by WebDNA, and there might be oth= er applications running on your server that could need lots of memory (Safa= ri is a good example). You can type "free" in your terminal to see the avai= able RAM, check the swap usage (this would tremendously slow things down) o= r even use your "Activity Monitor" application >>>>>> >>>>>> >>>>>> Here is the .debug exemple, broken in lines to simplify the reading >>>>>> >>>>>> The webdna.debug, activated by "Technical Support Information" >>>>>> >>>>>> 1.- 11/18/08 >>>>>> 2.- 14:20:09 >>>>>> 3.- 11 >>>>>> 4.- -944508928 >>>>>> 5.- 024.183.098.016 >>>>>> 6.- >>>>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7)= Gecko/20050416 >>>>>> 9.- login >>>>>> 10.- password >>>>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs= .tpl >>>>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>>> 13.- /var/www/html/ >>>>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************= &SerialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%= 25M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Cent= uryBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScr= ipt=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&Deadloc= kSeconds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DS= howPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2= C+NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtension= s=3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDataba= seExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utm= ccn=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966= .1140128720646497800.1222376773.1226506042.1226682779.28& >>>>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%= 3B%20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gec= ko/20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2= Ctext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5= &Accept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Ac= cept-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D30= 0&Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCata= logEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.= utmcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cut= mcct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.= 1226506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&C= ontent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>>>> >>>>>> The SignalCatcher.debug, activated by "Catching Terminate signal" = =A0will provide the problematic code and the domain name: >>>>>> >>>>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIG= SEGV: >>>>>> ContextName: [exclusivelock] >>>>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant= /processorders.tpl >>>>>> Includefile: ^WebMerchant/DoPurchases.inc >>>>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db= ] >>>>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&loo= kInField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&= lookInField=3Dpreference&value=3DCompletedF >>>>>> >>>>>> >>>>>> - chris >>>>>> >>>>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>>>> >>>>>>> Hi >>>>>>> >>>>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz,= 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>>>>> Apache has about 35 vhosts >>>>>>> >>>>>>> As soon as the server gets a bit load (~100 concurrent connections)= and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds t= o serve a page with WebDNA. >>>>>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to use more than 160% .... or am I wrong? >>>>>>> >>>>>>> Pages served directly from apache (no DNA) appear very quick. >>>>>>> >>>>>>> In cases of heavy load I have the following lines in the console lo= g: >>>>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 C= ould not establish connection with the module. >>>>>>> >>>>>>> >>>>>>> And I've also seen the following lines, which makes me even more ne= rvous: >>>>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0= c970: pointer being freed was not allocated >>>>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0= =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>>>> >>>>>>> All the lines are repeated several times. >>>>>>> >>>>>>> >>>>>>> How can I find out what's blocking WebCatalog? >>>>>>> Is something wrong with my module? >>>>>>> >>>>>>> >>>>>>> Thanks for any help >>>>>>> Thierry >>>>>>> >>>>>>> ______________________ >>>>>>> mac&web gmbh >>>>>>> thierry almy >>>>>>> grabenstrasse 15 >>>>>>> 8200 schaffhausen >>>>>>> switzerland >>>>>>> web =A0 www.mac-web.ch >>>>>>> >>>>>>> --------------------------------------------------------- >>>>>>> This message is sent to you because you are subscribed to >>>>>>> the mailing list . >>>>>>> To unsubscribe, E-mail to: >>>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>>> Bug Reporting: support@webdna.us >>>>>> >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>>> >>>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>> >> >
William DeVaul
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
New Plug-in and Type 11 errors (1997)
[WebDNA] Strange [url] character conversions (2010)
ShowNext (1997)
Uh...can someone help me out with the b10? (1997)
RE: IIS 4 (1998)
RE: Shopping Cart Questions (1998)
[OT] DOD again *MYSTERY SOLVED* (2003)
Word wrapping (1997)
Help!!!! (1997)
Delete file through browser (1999)
List Server (1999)
Linux Beta Question (maybe not just beta) (2000)
check out page (SSL) *still* not loading on Netscape 4.0+ (1999)
Omnibase file manipulation utility (1999)
purchase.log file (1997)
Writefile problem (1999)
WC Host List (2000)
upgrading (1997)
empty shopping cart message (1997)
Looking for a special Image Upload Script (2004)