Re: [WebDNA] WebDNA slow processing
This WebDNA talk-list message is from 2011
It keeps the original formatting.
numero = 107723
interpreted = N
texte = What does this error mean? 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] Notice = sem_open failed: returned EMFILE: Too many open files I have plenty of this in my console log? Is it possible that WebDNA stucks with one job and tons of others are = waiting to get processed until there are too many? Really, not a good situation ...... Thierry ______________________ mac&web gmbh thierry almy grabenstrasse 15 8200 schaffhausen switzerland web www.mac-web.ch Am 25.11.2011 um 16:52 schrieb William DeVaul: > I too am getting slammed. WebDNA regularly jumps to 99% and > eventually becomes non-responsive. I'm on version 6.x on RedHat. >=20 > I've been reviewing the .debug file. There are some columns that have > data and I'm unsure what the information reflects. It'd sure be great > if one of them was response time so I could spot problems, but > basically I see lots of search engines pulling the same template with > different parameters. >=20 > Is anyone willing to share a pre-parse and post-parse script > combination that would allow me to track response times easily? This > could help find the problem/processor consuming requests. >=20 > Can someone tell me what the columns in the debug file represent, > particularly the mysterious numbers and blank fields? >=20 > For columns, I see date, time, one mysterious number, a second > mysterious number, an IP address, a consistently blank column, a > template file path, user-agent string, three more consistently blank > columns, the document name, the documentroot (or site home directory), > URL parameters (everything after the ? in the URL), a blank column, a > request header. >=20 > It's hard to find a problem except that there've been so many = requests. >=20 > Thanks, > Bill >=20 >=20 >=20 > On Fri, Nov 25, 2011 at 9:53 AM, Thierry Almy
wrote: >> Daniel >> In the WebDNA prefs you can enable the logs, they are stored in the >> WebCatalogEngine in your CGI folder. >> Thierry >>=20 >> ______________________ >> mac&web gmbh >> thierry almy >> grabenstrasse 15 >> 8200 schaffhausen >> switzerland >> web www.mac-web.ch >>=20 >> Am 25.11.2011 um 15:07 schrieb Daniel Meola: >>=20 >> I am having the same issue on a server with similar specs, but using >> CentOS. >> Where I can find more information on error reporting for WebDNA (How = to turn >> it on, where the errors report to)? >> Thanks, >>=20 >> Daniel Meola >> 301-486-0901 >> daniel@knifecenter.com >>=20 >>=20 >> On Fri, Nov 25, 2011 at 8:48 AM, D Brooke wrote: >>>=20 >>> Hi Thierry, >>> Multiple cores will help with multiple requests (processes). It = won't >>> necessarily help with one request that is having problems. >>>=20 >>> My suggesting is to turn on the error reporting for WebDNA to see if = you >>> can correct some of the problems or isolate any issues. Chances are = that >>> your issue is code related... Either a problem with the code, or a = problem >>> with the efficiency of the code. >>>=20 >>> D. Brooke Mobile >>>=20 >>> On Nov 25, 2011, at 7:29 AM, Thierry Almy wrote: >>>=20 >>>> Hi >>>>=20 >>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB >>>> RAM, OS 10.6.8, iTools 9.0.5i >>>> Apache has about 35 vhosts >>>>=20 >>>> As soon as the server gets a bit load (~100 concurrent connections) = and >>>> WebDNA uses 110% to 160% of the processor, it takes up to 10 = seconds to >>>> serve a page with WebDNA. >>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to >>>> use more than 160% .... or am I wrong? >>>>=20 >>>> Pages served directly from apache (no DNA) appear very quick. >>>>=20 >>>> In cases of heavy load I have the following lines in the console = log: >>>> 25.11.11 14:26:43 sioux WebDNA[210] Error Could not >>>> establish connection with the module. >>>>=20 >>>>=20 >>>> And I've also seen the following lines, which makes me even more >>>> nervous: >>>> 25.11.11 11:18:44 sioux com.apple.SystemStarter[36] Notice >>>> *** set a breakpoint in malloc_error_break to debug >>>> 25.11.11 11:18:45 sioux com.apple.SystemStarter[36] Notice >>>> WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c970: = pointer >>>> being freed was not allocated >>>> 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] Notice >>>> sem_open failed: returned EMFILE: Too many open files >>>>=20 >>>> All the lines are repeated several times. >>>>=20 >>>>=20 >>>> How can I find out what's blocking WebCatalog? >>>> Is something wrong with my module? >>>>=20 >>>>=20 >>>> Thanks for any help >>>> Thierry >>>>=20 >>>> ______________________ >>>> mac&web gmbh >>>> thierry almy >>>> grabenstrasse 15 >>>> 8200 schaffhausen >>>> switzerland >>>> web www.mac-web.ch >>>>=20 >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>=20 >> --------------------------------------------------------- This = message is >> sent to you because you are subscribed to the mailing list . To = unsubscribe, >> E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug >> Reporting: support@webdna.us >>=20 >> --------------------------------------------------------- This = message is >> sent to you because you are subscribed to the mailing list . To = unsubscribe, >> E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug >> Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us
Associated Messages, from the most recent to the oldest:
What does this error mean? 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] Notice = sem_open failed: returned EMFILE: Too many open files I have plenty of this in my console log? Is it possible that WebDNA stucks with one job and tons of others are = waiting to get processed until there are too many? Really, not a good situation ...... Thierry ______________________ mac&web gmbh thierry almy grabenstrasse 15 8200 schaffhausen switzerland web www.mac-web.ch Am 25.11.2011 um 16:52 schrieb William DeVaul: > I too am getting slammed. WebDNA regularly jumps to 99% and > eventually becomes non-responsive. I'm on version 6.x on RedHat. >=20 > I've been reviewing the .debug file. There are some columns that have > data and I'm unsure what the information reflects. It'd sure be great > if one of them was response time so I could spot problems, but > basically I see lots of search engines pulling the same template with > different parameters. >=20 > Is anyone willing to share a pre-parse and post-parse script > combination that would allow me to track response times easily? This > could help find the problem/processor consuming requests. >=20 > Can someone tell me what the columns in the debug file represent, > particularly the mysterious numbers and blank fields? >=20 > For columns, I see date, time, one mysterious number, a second > mysterious number, an IP address, a consistently blank column, a > template file path, user-agent string, three more consistently blank > columns, the document name, the documentroot (or site home directory), > URL parameters (everything after the ? in the URL), a blank column, a > request header. >=20 > It's hard to find a problem except that there've been so many = requests. >=20 > Thanks, > Bill >=20 >=20 >=20 > On Fri, Nov 25, 2011 at 9:53 AM, Thierry Almy wrote: >> Daniel >> In the WebDNA prefs you can enable the logs, they are stored in the >> WebCatalogEngine in your CGI folder. >> Thierry >>=20 >> ______________________ >> mac&web gmbh >> thierry almy >> grabenstrasse 15 >> 8200 schaffhausen >> switzerland >> web www.mac-web.ch >>=20 >> Am 25.11.2011 um 15:07 schrieb Daniel Meola: >>=20 >> I am having the same issue on a server with similar specs, but using >> CentOS. >> Where I can find more information on error reporting for WebDNA (How = to turn >> it on, where the errors report to)? >> Thanks, >>=20 >> Daniel Meola >> 301-486-0901 >> daniel@knifecenter.com >>=20 >>=20 >> On Fri, Nov 25, 2011 at 8:48 AM, D Brooke wrote: >>>=20 >>> Hi Thierry, >>> Multiple cores will help with multiple requests (processes). It = won't >>> necessarily help with one request that is having problems. >>>=20 >>> My suggesting is to turn on the error reporting for WebDNA to see if = you >>> can correct some of the problems or isolate any issues. Chances are = that >>> your issue is code related... Either a problem with the code, or a = problem >>> with the efficiency of the code. >>>=20 >>> D. Brooke Mobile >>>=20 >>> On Nov 25, 2011, at 7:29 AM, Thierry Almy wrote: >>>=20 >>>> Hi >>>>=20 >>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB >>>> RAM, OS 10.6.8, iTools 9.0.5i >>>> Apache has about 35 vhosts >>>>=20 >>>> As soon as the server gets a bit load (~100 concurrent connections) = and >>>> WebDNA uses 110% to 160% of the processor, it takes up to 10 = seconds to >>>> serve a page with WebDNA. >>>> Since we have 8-Cores in the server, I guess WebDNA should be able = to >>>> use more than 160% .... or am I wrong? >>>>=20 >>>> Pages served directly from apache (no DNA) appear very quick. >>>>=20 >>>> In cases of heavy load I have the following lines in the console = log: >>>> 25.11.11 14:26:43 sioux WebDNA[210] Error Could not >>>> establish connection with the module. >>>>=20 >>>>=20 >>>> And I've also seen the following lines, which makes me even more >>>> nervous: >>>> 25.11.11 11:18:44 sioux com.apple.SystemStarter[36] Notice >>>> *** set a breakpoint in malloc_error_break to debug >>>> 25.11.11 11:18:45 sioux com.apple.SystemStarter[36] Notice >>>> WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c970: = pointer >>>> being freed was not allocated >>>> 25.11.11 11:47:12 sioux com.apple.SystemStarter[36] Notice >>>> sem_open failed: returned EMFILE: Too many open files >>>>=20 >>>> All the lines are repeated several times. >>>>=20 >>>>=20 >>>> How can I find out what's blocking WebCatalog? >>>> Is something wrong with my module? >>>>=20 >>>>=20 >>>> Thanks for any help >>>> Thierry >>>>=20 >>>> ______________________ >>>> mac&web gmbh >>>> thierry almy >>>> grabenstrasse 15 >>>> 8200 schaffhausen >>>> switzerland >>>> web www.mac-web.ch >>>>=20 >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >>=20 >> --------------------------------------------------------- This = message is >> sent to you because you are subscribed to the mailing list . To = unsubscribe, >> E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug >> Reporting: support@webdna.us >>=20 >> --------------------------------------------------------- This = message is >> sent to you because you are subscribed to the mailing list . To = unsubscribe, >> E-mail to: archives: http://mail.webdna.us/list/talk@webdna.us Bug >> Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us
Thierry Almy
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WebCat Error Log problem (2.0.1, acgi, Mac) (1997)
Re:E-Mailer (WebCatb15acgiMac) (1997)
WebCatalog for guestbook ? (1997)
Shopping cart now bad (1997)
Applescript, WebDNA, and PDF (1997)
no [search] with NT (1997)
Re[2]: WebCatalog on Linux (2000)
[countWords]? (1997)
New servers and new inline cache (1997)
[WebDNA] WebDNA on LiveCD ... (2008)
Mac Vs WindowsNT (1997)
HomePage Caution (1997)
Extracting URL (2007)
WebDNA on OS X Tiger (2006)
Searching multiple Databases (1997)
[.htm mappi]Search as error page (2002)
Google Sitemap generator (2005)
[WebDNA] Rewrite url (2013)
Hard Questions ? (1997)
Help name our technology! (1997)