Re: [WebDNA] Apple Server

This WebDNA talk-list message is from

2013


It keeps the original formatting.
numero = 110356
interpreted = N
texte = --Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Apr 25, 2013, at 11:20 AM, Paul Willis wrote: > I'm not convinced moving to Mac will fix this. >=20 > When we were still on Mac servers we had a similar situation with a = busy PHP/MySQL site (not Vbulletin though). It turned out to be a = combination of two main issues... >=20 > 1) MySQL would dump the expired query cache for a query that got a lot = of requests (as it should the data had been updated and the cache was = old) but it took too long to process and a queue of the same big query = quickly built up from which it could not recover, just as you describe. >=20 Interesting, but how did you resolve this if it was indeed causing a = slowdown? > 2) A slow query that would lock a table and cause the same avalanche = but of different queries. I know you looked at slow queries but you need = to separate out what is a real slow query and what are normal queries = just taking an age because the server is bogged down. In your slow query = log the problem should be one of the first queries that are logged just = before sit all goes haywire. We often spent the day watching live = queries using Sequel Pro or similar apps to pin it down I have started emptying the slow query log so that I can focus on the = first 1 or 2 in each occurrence. I have also 'minimized' my impacts by = reducing the keep alive times down to 1-2 seconds and controlling the = maxchilds to reasonable numbers.=20 Its still happening but only a couple times a day compared to the dozens = when it was kicking my ass. > Another option which might help (which we did) is to split the MySQL = off onto it's own server > Paul >=20 Also interesting, but if the problem was squarely on MYSQL, then I'm not = sure how having it separated would help all that much. Maybe free up a = few CPU ticks from apache. The move to OSX was as much about getting me into something I had more = experience with admittedly as anything else.=20 I am intrigued though that you were having similar issues.=20 What was your ultimate resolution? Did you find a bad query? Was it the = cache dump primarily? Or an overtaxed server? Chasing this thing has been like chasing shadows. You think you got it = and then 3 hrs later its back. >=20 > On 25 Apr 2013, at 15:23, Alex McCombie = wrote: >=20 >> Our box running webmin / Apache/ MYSQL / PHP which contains 5 = Vbulletin forums on it has been suffering from an ongoing and maddening = problem where seemingly random times the connections will suddenly start = stacking up until it maxes out and becomes unresponsive. It will go from = 5-15 requests to 150 (or whatever I assign the max to) in a matter of = minutes (or seconds depending on traffic) =85 all usually in a Waiting = for Connection state as if MYSQL is no longer responding.. but it = reports no locked tables. The slow query report turns out to be no help = because it shows queries that would normally be 1 second taking up to 60 = seconds each=85 which means that MYSQL is accepting the connections but = query time suddenly became insane. >>=20 >> Other than letting it sit unusable for 15-20 min, an apache restart = is needed to resolve the problem. No backup or update routines scan be = associated with it. >>=20 >> I have looked under every rock in the configuration, had the VB tech = people dig into it, and even hired TDS to come in and crawl through the = setup to do an optimization and find the issue. Nada=20 >>=20 >> Nobody has been able to. It's not a hardware issue as this is the = second box that I have tried and the problem followed it. >>=20 >> So at this point, I am daily convinced it must be something with = Webmin or Unbuntu itself.=20 >>=20 >>=20 >> Unfortunately I am a DBA/dev and not a network admin, but even my = server admin guys are stumped.=20 >>=20 >> The machine its currently on is: >> DELL POWEREDGE 2950 DUAL 5150 8GB MEM 4x 500GB SATA >> Processor is dual processor, dual core - Intel=AE Xeon=AE Processor = 5150=20 >> (4M Cache, 2.66 GHz, 1333 MHz FSB) >>=20 >> I serve about 3 million page views per month on it but have become a = slave to the damn thing. >>=20 >> So, I figured I would try and go back into an environment I was a bit = more familiar with .. OSX, though admittedly I really wanted a GUI to = manage thing and even though Webmin is capable of running on OSX, I = would rather look elsewhere for a management GUI. >>=20 >>=20 >> The sudden slowdowns are not associated with peak traffic, though = peak traffic makes the problem more likely to quickly escalate into an = unresponsive server.=20 >>=20 >>=20 >> Anyway.. thats my sad tale. Just looking to get the damn thing = running solid again. >>=20 >> At this point I am even considering hosting off site, which I have = done in a decade. If anyone has a setup to support this feel free to PM = me. If the pricing is right then maybe that can be something I try too. >>=20 >>=20 >>=20 >>=20 >>=20 >> On Apr 24, 2013, at 10:54 AM, Paul Willis wrote: >>=20 >>> I'd be interested to know what the PITA is with the Ubuntu box. We = have been moving from Apple servers to Ubuntu ever since the Xserve was = discontinued and have nothing but good things to say about them. >>>=20 >>> Paul >>>=20 >>>=20 >>> On 24 Apr 2013, at 15:15, Alex McCombie = wrote: >>>=20 >>>> Hmm, good to know. >>>> I am going to buy the OSX server app later this week and install it = on a test machine. If I can get the server app running with MYSQL/PHP & = DNA without a ton of hassle then I will go ahead and buy the hardware = for it and migrate of the PITA ubuntu box. >>>> :-) >>>>=20 >>>>=20 >>>> On Apr 24, 2013, at 9:33 AM, Donovan Brooke = wrote: >>>>=20 >>>>> HI Alex, >>>>> It's pretty easy these days: >>>>> Download: >>>>> http://dev.mysql.com/downloads/mysql/ >>>>>=20 >>>>> Docs (select your version at the left): >>>>> http://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html >>>>> =20 >>>>> =20 >>>>>> --- Original message ---=20 >>>>>> Subject: [WebDNA] Apple Server=20 >>>>>> From: Alex McCombie =20 >>>>>> To: =20 >>>>>> Date: Wednesday, 24/04/2013 8:04 AM >>>>>>=20 >>>>>> Long time no post=85=20 >>>>>>=20 >>>>>> Still doing everything on WebDNA. 6.0 windows. >>>>>>=20 >>>>>> Quick question though. >>>>>>=20 >>>>>> I currently have and Unbuntu box with Apache/MySQL and Webmin = running multiple forums. I want to move to an apple server for the same = thing. A mini would be fine based on the traffic. I would also like the = ability to have WebDNA on this box to keep me from having to go to = another box for DNA stuff. >>>>>>=20 >>>>>> But I am not really experienced with the OSX setup to allow = mysql. >>>>>>=20 >>>>>> Can someone point me to the right direction to read up on the = process? I don't mind digging in and figuring it out but wouldn't mind = herding from people that are doing it and what to watch out for. >>>>>>=20 >>>>>> Appreciated. >>>>>>=20 >>>>>> Second post coming about active directory. >>>>>>=20 >>>>>> thx >>>>>> Alex >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> Alex J. McCombie . Database Administrator >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>>=20 >>>>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug = Reporting:support@webdna.us >>>>=20 >>>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >>>=20 >>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >>=20 >> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252
On Apr 25, 2013, at 11:20 AM, Paul Willis <paul.willis@me.com> = wrote:

I'm = not convinced moving to Mac will fix this.

When we = were still on Mac servers we had a similar situation with a busy = PHP/MySQL site (not Vbulletin though). It turned out to be a = combination of two main issues...

1) MySQL = would dump the expired query cache for a query that got a lot = of requests (as it should the data had been updated and the cache was = old) but it took too long to process and a queue of the same big query = quickly built up from which it could not recover, just as you = describe.

Interesting, but = how did you resolve this if it was indeed causing a = slowdown?





2) A slow query that would lock a table and cause the same = avalanche but of different queries. I know you looked at slow = queries but you need to separate out what is a real slow query and what = are normal queries just taking an age because the server is bogged down. = In your slow query log the problem should be one of the first queries = that are logged just before sit all goes haywire. We often spent the day = watching live queries using Sequel Pro or similar apps to pin it = down
I have started emptying the slow query = log so that I can focus on the first 1 or 2 in each occurrence. I have = also 'minimized' my impacts by reducing the keep alive times down to 1-2 = seconds and controlling the maxchilds to reasonable = numbers. 

Its still happening but only a = couple times a day compared to the dozens when it was kicking my = ass.




Another option = which might help (which we did) is to split the MySQL off onto it's own = server
Paul

Also = interesting, but if the problem was squarely on MYSQL, then I'm not sure = how having it separated would help all that much. Maybe free up a few = CPU ticks from apache.


The move = to OSX was as much about getting me into something I had more experience = with admittedly as anything else. 

I am = intrigued though that you were having similar = issues. 

What was your ultimate = resolution? Did you find a bad query? Was it the cache dump primarily? = Or an overtaxed server?
Chasing this thing has been like = chasing shadows. You think you got it and then 3 hrs later its = back.









On 25 = Apr 2013, at 15:23, Alex McCombie <info@adventureskies.com> = wrote:

Our = box running webmin / Apache/ MYSQL / PHP which contains 5 Vbulletin = forums on it has been suffering from an ongoing and maddening problem = where seemingly random times the connections will suddenly start = stacking up until it maxes out and becomes unresponsive. It will go from = 5-15 requests to 150 (or whatever I assign the max to) in a matter of = minutes (or seconds depending on traffic) =85 all usually in a Waiting = for Connection state as if MYSQL is no longer responding.. but it = reports no locked tables. The slow query report turns out to be no help = because it shows queries that would normally be 1 second taking up to 60 = seconds each=85 which means that MYSQL is accepting the connections but = query time suddenly became insane.

Other than letting = it sit unusable for 15-20 min, an apache restart is needed to resolve = the problem. No backup or update routines scan be associated with = it.

I have looked under every rock in the = configuration, had the VB tech people dig into it, and even hired TDS to = come in and crawl through the setup to do an optimization and find the = issue. Nada 

Nobody has been able to. It's = not a hardware issue as this is the second box that I have tried and the = problem followed it.

So at this point, I am = daily convinced it must be something with Webmin or Unbuntu = itself. 


Unfortunately I am = a DBA/dev and not a network admin, but even my server admin guys are = stumped. 

The machine its currently on = is:
DELL POWEREDGE 2950 DUAL = 5150 8GB MEM 4x 500GB SATA
Processor is dual processor, = dual core - Intel=AE Xeon=AE Processor 5150 
(4M Cache, 2.66 GHz, 1333 MHz FSB)

I serve about 3 million page = views per month on it but have become a slave to the damn = thing.

So, I figured I would try and = go back into an environment I was a bit more familiar with .. = OSX, though admittedly I really wanted a GUI to manage thing and = even though Webmin is capable of running on OSX, I would rather look = elsewhere for a management GUI.


The sudden = slowdowns are not associated with peak traffic, though peak traffic = makes the problem more likely to quickly escalate into an unresponsive = server. 


Anyway.. thats my = sad tale. Just looking to get the damn thing running solid = again.

At this point I = am even considering hosting off site, which I have done in a decade. If = anyone has a setup to support this feel free to PM me. If the = pricing is right then maybe that can be something I try = too.





On = Apr 24, 2013, at 10:54 AM, Paul Willis <paul.willis@me.com> = wrote:

I'd = be interested to know what the PITA is with the Ubuntu box. We have been = moving from Apple servers to Ubuntu ever since the Xserve was = discontinued and have nothing but good things to say about = them.

Paul


On 24 = Apr 2013, at 15:15, Alex McCombie <info@adventureskies.com> = wrote:

Hmm, good to know.
I am = going to buy the OSX server app later this week and install it on a test = machine. If I can get the server app running with MYSQL/PHP & DNA = without a ton of hassle then I will go ahead and buy the hardware for it = and migrate of the PITA ubuntu = box.
:-)


On Apr 24, = 2013, at 9:33 AM, Donovan Brooke <dbrooke@webdna.us> = wrote:

HI Alex,
It's pretty easy these = days:
Download:
http://dev.mysql.com/downlo= ads/mysql/

Docs (select your version at the left):
h= ttp://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html
 
 
--- Original message --- 
Subject: [WebDNA] Apple Server 
From: Alex McCombie <info@adventureskies.com> 
To: <talk@webdna.us> 
Date: Wednesday, 24/04/2013 8:04 = AM

Long time no post=85 

Still doing = everything on WebDNA. 6.0 windows.

Quick question = though.

I currently have and Unbuntu box with Apache/MySQL and = Webmin running multiple forums. I want to move to an apple server for = the same thing. A mini would be fine based on the traffic. I would also = like the ability to have WebDNA on this box to keep me from having to go = to another box for DNA stuff.

But I am not really experienced = with the OSX setup to allow mysql.

Can someone point me to the = right direction to read up on the process? I don't mind digging in and = figuring it out but wouldn't mind herding from people that are doing it = and what to watch out for.

Appreciated.

Second post coming = about active directory.

thx
Alex



Alex J. = McCombie . Database = Administrator
---------------------------------------------------------=
This message is sent to you because you are subscribed to
the = mailing list <talk@webdna.us>.
To = unsubscribe, E-mail to: <talk-leave@webdna.us>
archi= ves: http://mail.webdna.us/l= ist/talk@webdna.us
Bug Reporting: support@webdna.us
--------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archive= s: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting:support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us
--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us
= --Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519-- Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] Apple Server (Paul Willis 2013)
  2. Re: [WebDNA] Apple Server (Alex McCombie 2013)
  3. Re: [WebDNA] Apple Server (Paul Willis 2013)
  4. Re: [WebDNA] Apple Server (Alex McCombie 2013)
  5. Re: [WebDNA] Apple Server (Paul Willis 2013)
  6. Re: [WebDNA] Apple Server (Alex McCombie 2013)
  7. Re: [WebDNA] Apple Server (Paul Willis 2013)
  8. Re: [WebDNA] Apple Server (Alex McCombie 2013)
  9. Re: [WebDNA] Apple Server (Donovan Brooke 2013)
  10. [WebDNA] Apple Server (Alex McCombie 2013)
--Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Apr 25, 2013, at 11:20 AM, Paul Willis wrote: > I'm not convinced moving to Mac will fix this. >=20 > When we were still on Mac servers we had a similar situation with a = busy PHP/MySQL site (not Vbulletin though). It turned out to be a = combination of two main issues... >=20 > 1) MySQL would dump the expired query cache for a query that got a lot = of requests (as it should the data had been updated and the cache was = old) but it took too long to process and a queue of the same big query = quickly built up from which it could not recover, just as you describe. >=20 Interesting, but how did you resolve this if it was indeed causing a = slowdown? > 2) A slow query that would lock a table and cause the same avalanche = but of different queries. I know you looked at slow queries but you need = to separate out what is a real slow query and what are normal queries = just taking an age because the server is bogged down. In your slow query = log the problem should be one of the first queries that are logged just = before sit all goes haywire. We often spent the day watching live = queries using Sequel Pro or similar apps to pin it down I have started emptying the slow query log so that I can focus on the = first 1 or 2 in each occurrence. I have also 'minimized' my impacts by = reducing the keep alive times down to 1-2 seconds and controlling the = maxchilds to reasonable numbers.=20 Its still happening but only a couple times a day compared to the dozens = when it was kicking my ass. > Another option which might help (which we did) is to split the MySQL = off onto it's own server > Paul >=20 Also interesting, but if the problem was squarely on MYSQL, then I'm not = sure how having it separated would help all that much. Maybe free up a = few CPU ticks from apache. The move to OSX was as much about getting me into something I had more = experience with admittedly as anything else.=20 I am intrigued though that you were having similar issues.=20 What was your ultimate resolution? Did you find a bad query? Was it the = cache dump primarily? Or an overtaxed server? Chasing this thing has been like chasing shadows. You think you got it = and then 3 hrs later its back. >=20 > On 25 Apr 2013, at 15:23, Alex McCombie = wrote: >=20 >> Our box running webmin / Apache/ MYSQL / PHP which contains 5 = Vbulletin forums on it has been suffering from an ongoing and maddening = problem where seemingly random times the connections will suddenly start = stacking up until it maxes out and becomes unresponsive. It will go from = 5-15 requests to 150 (or whatever I assign the max to) in a matter of = minutes (or seconds depending on traffic) =85 all usually in a Waiting = for Connection state as if MYSQL is no longer responding.. but it = reports no locked tables. The slow query report turns out to be no help = because it shows queries that would normally be 1 second taking up to 60 = seconds each=85 which means that MYSQL is accepting the connections but = query time suddenly became insane. >>=20 >> Other than letting it sit unusable for 15-20 min, an apache restart = is needed to resolve the problem. No backup or update routines scan be = associated with it. >>=20 >> I have looked under every rock in the configuration, had the VB tech = people dig into it, and even hired TDS to come in and crawl through the = setup to do an optimization and find the issue. Nada=20 >>=20 >> Nobody has been able to. It's not a hardware issue as this is the = second box that I have tried and the problem followed it. >>=20 >> So at this point, I am daily convinced it must be something with = Webmin or Unbuntu itself.=20 >>=20 >>=20 >> Unfortunately I am a DBA/dev and not a network admin, but even my = server admin guys are stumped.=20 >>=20 >> The machine its currently on is: >> DELL POWEREDGE 2950 DUAL 5150 8GB MEM 4x 500GB SATA >> Processor is dual processor, dual core - Intel=AE Xeon=AE Processor = 5150=20 >> (4M Cache, 2.66 GHz, 1333 MHz FSB) >>=20 >> I serve about 3 million page views per month on it but have become a = slave to the damn thing. >>=20 >> So, I figured I would try and go back into an environment I was a bit = more familiar with .. OSX, though admittedly I really wanted a GUI to = manage thing and even though Webmin is capable of running on OSX, I = would rather look elsewhere for a management GUI. >>=20 >>=20 >> The sudden slowdowns are not associated with peak traffic, though = peak traffic makes the problem more likely to quickly escalate into an = unresponsive server.=20 >>=20 >>=20 >> Anyway.. thats my sad tale. Just looking to get the damn thing = running solid again. >>=20 >> At this point I am even considering hosting off site, which I have = done in a decade. If anyone has a setup to support this feel free to PM = me. If the pricing is right then maybe that can be something I try too. >>=20 >>=20 >>=20 >>=20 >>=20 >> On Apr 24, 2013, at 10:54 AM, Paul Willis wrote: >>=20 >>> I'd be interested to know what the PITA is with the Ubuntu box. We = have been moving from Apple servers to Ubuntu ever since the Xserve was = discontinued and have nothing but good things to say about them. >>>=20 >>> Paul >>>=20 >>>=20 >>> On 24 Apr 2013, at 15:15, Alex McCombie = wrote: >>>=20 >>>> Hmm, good to know. >>>> I am going to buy the OSX server app later this week and install it = on a test machine. If I can get the server app running with MYSQL/PHP & = DNA without a ton of hassle then I will go ahead and buy the hardware = for it and migrate of the PITA ubuntu box. >>>> :-) >>>>=20 >>>>=20 >>>> On Apr 24, 2013, at 9:33 AM, Donovan Brooke = wrote: >>>>=20 >>>>> HI Alex, >>>>> It's pretty easy these days: >>>>> Download: >>>>> http://dev.mysql.com/downloads/mysql/ >>>>>=20 >>>>> Docs (select your version at the left): >>>>> http://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html >>>>> =20 >>>>> =20 >>>>>> --- Original message ---=20 >>>>>> Subject: [WebDNA] Apple Server=20 >>>>>> From: Alex McCombie =20 >>>>>> To: =20 >>>>>> Date: Wednesday, 24/04/2013 8:04 AM >>>>>>=20 >>>>>> Long time no post=85=20 >>>>>>=20 >>>>>> Still doing everything on WebDNA. 6.0 windows. >>>>>>=20 >>>>>> Quick question though. >>>>>>=20 >>>>>> I currently have and Unbuntu box with Apache/MySQL and Webmin = running multiple forums. I want to move to an apple server for the same = thing. A mini would be fine based on the traffic. I would also like the = ability to have WebDNA on this box to keep me from having to go to = another box for DNA stuff. >>>>>>=20 >>>>>> But I am not really experienced with the OSX setup to allow = mysql. >>>>>>=20 >>>>>> Can someone point me to the right direction to read up on the = process? I don't mind digging in and figuring it out but wouldn't mind = herding from people that are doing it and what to watch out for. >>>>>>=20 >>>>>> Appreciated. >>>>>>=20 >>>>>> Second post coming about active directory. >>>>>>=20 >>>>>> thx >>>>>> Alex >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> Alex J. McCombie . Database Administrator >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>>=20 >>>>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug = Reporting:support@webdna.us >>>>=20 >>>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >>>=20 >>> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >>=20 >> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252
On Apr 25, 2013, at 11:20 AM, Paul Willis <paul.willis@me.com> = wrote:

I'm = not convinced moving to Mac will fix this.

When we = were still on Mac servers we had a similar situation with a busy = PHP/MySQL site (not Vbulletin though). It turned out to be a = combination of two main issues...

1) MySQL = would dump the expired query cache for a query that got a lot = of requests (as it should the data had been updated and the cache was = old) but it took too long to process and a queue of the same big query = quickly built up from which it could not recover, just as you = describe.

Interesting, but = how did you resolve this if it was indeed causing a = slowdown?





2) A slow query that would lock a table and cause the same = avalanche but of different queries. I know you looked at slow = queries but you need to separate out what is a real slow query and what = are normal queries just taking an age because the server is bogged down. = In your slow query log the problem should be one of the first queries = that are logged just before sit all goes haywire. We often spent the day = watching live queries using Sequel Pro or similar apps to pin it = down
I have started emptying the slow query = log so that I can focus on the first 1 or 2 in each occurrence. I have = also 'minimized' my impacts by reducing the keep alive times down to 1-2 = seconds and controlling the maxchilds to reasonable = numbers. 

Its still happening but only a = couple times a day compared to the dozens when it was kicking my = ass.




Another option = which might help (which we did) is to split the MySQL off onto it's own = server
Paul

Also = interesting, but if the problem was squarely on MYSQL, then I'm not sure = how having it separated would help all that much. Maybe free up a few = CPU ticks from apache.


The move = to OSX was as much about getting me into something I had more experience = with admittedly as anything else. 

I am = intrigued though that you were having similar = issues. 

What was your ultimate = resolution? Did you find a bad query? Was it the cache dump primarily? = Or an overtaxed server?
Chasing this thing has been like = chasing shadows. You think you got it and then 3 hrs later its = back.









On 25 = Apr 2013, at 15:23, Alex McCombie <info@adventureskies.com> = wrote:

Our = box running webmin / Apache/ MYSQL / PHP which contains 5 Vbulletin = forums on it has been suffering from an ongoing and maddening problem = where seemingly random times the connections will suddenly start = stacking up until it maxes out and becomes unresponsive. It will go from = 5-15 requests to 150 (or whatever I assign the max to) in a matter of = minutes (or seconds depending on traffic) =85 all usually in a Waiting = for Connection state as if MYSQL is no longer responding.. but it = reports no locked tables. The slow query report turns out to be no help = because it shows queries that would normally be 1 second taking up to 60 = seconds each=85 which means that MYSQL is accepting the connections but = query time suddenly became insane.

Other than letting = it sit unusable for 15-20 min, an apache restart is needed to resolve = the problem. No backup or update routines scan be associated with = it.

I have looked under every rock in the = configuration, had the VB tech people dig into it, and even hired TDS to = come in and crawl through the setup to do an optimization and find the = issue. Nada 

Nobody has been able to. It's = not a hardware issue as this is the second box that I have tried and the = problem followed it.

So at this point, I am = daily convinced it must be something with Webmin or Unbuntu = itself. 


Unfortunately I am = a DBA/dev and not a network admin, but even my server admin guys are = stumped. 

The machine its currently on = is:
DELL POWEREDGE 2950 DUAL = 5150 8GB MEM 4x 500GB SATA
Processor is dual processor, = dual core - Intel=AE Xeon=AE Processor 5150 
(4M Cache, 2.66 GHz, 1333 MHz FSB)

I serve about 3 million page = views per month on it but have become a slave to the damn = thing.

So, I figured I would try and = go back into an environment I was a bit more familiar with .. = OSX, though admittedly I really wanted a GUI to manage thing and = even though Webmin is capable of running on OSX, I would rather look = elsewhere for a management GUI.


The sudden = slowdowns are not associated with peak traffic, though peak traffic = makes the problem more likely to quickly escalate into an unresponsive = server. 


Anyway.. thats my = sad tale. Just looking to get the damn thing running solid = again.

At this point I = am even considering hosting off site, which I have done in a decade. If = anyone has a setup to support this feel free to PM me. If the = pricing is right then maybe that can be something I try = too.





On = Apr 24, 2013, at 10:54 AM, Paul Willis <paul.willis@me.com> = wrote:

I'd = be interested to know what the PITA is with the Ubuntu box. We have been = moving from Apple servers to Ubuntu ever since the Xserve was = discontinued and have nothing but good things to say about = them.

Paul


On 24 = Apr 2013, at 15:15, Alex McCombie <info@adventureskies.com> = wrote:

Hmm, good to know.
I am = going to buy the OSX server app later this week and install it on a test = machine. If I can get the server app running with MYSQL/PHP & DNA = without a ton of hassle then I will go ahead and buy the hardware for it = and migrate of the PITA ubuntu = box.
:-)


On Apr 24, = 2013, at 9:33 AM, Donovan Brooke <dbrooke@webdna.us> = wrote:

HI Alex,
It's pretty easy these = days:
Download:
http://dev.mysql.com/downlo= ads/mysql/

Docs (select your version at the left):
h= ttp://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html
 
 
--- Original message --- 
Subject: [WebDNA] Apple Server 
From: Alex McCombie <info@adventureskies.com> 
To: <talk@webdna.us> 
Date: Wednesday, 24/04/2013 8:04 = AM

Long time no post=85 

Still doing = everything on WebDNA. 6.0 windows.

Quick question = though.

I currently have and Unbuntu box with Apache/MySQL and = Webmin running multiple forums. I want to move to an apple server for = the same thing. A mini would be fine based on the traffic. I would also = like the ability to have WebDNA on this box to keep me from having to go = to another box for DNA stuff.

But I am not really experienced = with the OSX setup to allow mysql.

Can someone point me to the = right direction to read up on the process? I don't mind digging in and = figuring it out but wouldn't mind herding from people that are doing it = and what to watch out for.

Appreciated.

Second post coming = about active directory.

thx
Alex



Alex J. = McCombie . Database = Administrator
---------------------------------------------------------=
This message is sent to you because you are subscribed to
the = mailing list <talk@webdna.us>.
To = unsubscribe, E-mail to: <talk-leave@webdna.us>
archi= ves: http://mail.webdna.us/l= ist/talk@webdna.us
Bug Reporting: support@webdna.us
--------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archive= s: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting:support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us

--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us
--------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: archives: http://mail.webdna.us/l= ist/talk@webdna.us Bug Reporting: support@webdna.us
= --Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519-- Alex McCombie

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

[convertchars] (2000) WebCat2b13MacPlugin - [math][date][/math] problem (1997) XML Woes (2004) Error: Permision deny. (2005) Enterprise Server (1998) WebDNA to PHP (2008) WebCatalog can't find database (1997) How to Display text in empty fields (1997) linetiems in thankyou.tpl (1997) Help! WebCat2 bug (1997) Signal Raised error (1997) [ENCRYPT seed=xxxxx] length (2000) Problems with SELECT MULTIPLE (1999) [WebDNA] DNA suffix (2008) flushdatabases (1997) Plugin vs. CGI (1998) Listserver problem (1997) Database Security (1998) [WriteFile] problems (1997) Re:Merging databases (1997)