2013

It keeps the original formatting.

wrote:> I'm not convinced moving to Mac will fix this.>=20> When we were still on Mac servers we had a similar situation with a =busy PHP/MySQL site (not Vbulletin though). It turned out to be a =combination of two main issues...>=20> 1) MySQL would dump the expired query cache for a query that got a lot =of requests (as it should the data had been updated and the cache was =old) but it took too long to process and a queue of the same big query =quickly built up from which it could not recover, just as you describe.>=20Interesting, but how did you resolve this if it was indeed causing a =slowdown?> 2) A slow query that would lock a table and cause the same avalanche =but of different queries. I know you looked at slow queries but you need =to separate out what is a real slow query and what are normal queries =just taking an age because the server is bogged down. In your slow query =log the problem should be one of the first queries that are logged just =before sit all goes haywire. We often spent the day watching live =queries using Sequel Pro or similar apps to pin it downI have started emptying the slow query log so that I can focus on the =first 1 or 2 in each occurrence. I have also 'minimized' my impacts by =reducing the keep alive times down to 1-2 seconds and controlling the =maxchilds to reasonable numbers.=20Its still happening but only a couple times a day compared to the dozens =when it was kicking my ass.> Another option which might help (which we did) is to split the MySQL =off onto it's own server> Paul>=20Also interesting, but if the problem was squarely on MYSQL, then I'm not =sure how having it separated would help all that much. Maybe free up a =few CPU ticks from apache.The move to OSX was as much about getting me into something I had more =experience with admittedly as anything else.=20I am intrigued though that you were having similar issues.=20What was your ultimate resolution? Did you find a bad query? Was it the =cache dump primarily? Or an overtaxed server?Chasing this thing has been like chasing shadows. You think you got it =and then 3 hrs later its back.>=20> On 25 Apr 2013, at 15:23, Alex McCombie =wrote:>=20>> Our box running webmin / Apache/ MYSQL / PHP which contains 5 =Vbulletin forums on it has been suffering from an ongoing and maddening =problem where seemingly random times the connections will suddenly start =stacking up until it maxes out and becomes unresponsive. It will go from =5-15 requests to 150 (or whatever I assign the max to) in a matter of =minutes (or seconds depending on traffic) =85 all usually in a Waiting =for Connection state as if MYSQL is no longer responding.. but it =reports no locked tables. The slow query report turns out to be no help =because it shows queries that would normally be 1 second taking up to 60 =seconds each=85 which means that MYSQL is accepting the connections but =query time suddenly became insane.>>=20>> Other than letting it sit unusable for 15-20 min, an apache restart =is needed to resolve the problem. No backup or update routines scan be =associated with it.>>=20>> I have looked under every rock in the configuration, had the VB tech =people dig into it, and even hired TDS to come in and crawl through the =setup to do an optimization and find the issue. Nada=20>>=20>> Nobody has been able to. It's not a hardware issue as this is the =second box that I have tried and the problem followed it.>>=20>> So at this point, I am daily convinced it must be something with =Webmin or Unbuntu itself.=20>>=20>>=20>> Unfortunately I am a DBA/dev and not a network admin, but even my =server admin guys are stumped.=20>>=20>> The machine its currently on is:>> DELL POWEREDGE 2950 DUAL 5150 8GB MEM 4x 500GB SATA>> Processor is dual processor, dual core - Intel=AE Xeon=AE Processor =5150=20>> (4M Cache, 2.66 GHz, 1333 MHz FSB)>>=20>> I serve about 3 million page views per month on it but have become a =slave to the damn thing.>>=20>> So, I figured I would try and go back into an environment I was a bit =more familiar with .. OSX, though admittedly I really wanted a GUI to =manage thing and even though Webmin is capable of running on OSX, I =would rather look elsewhere for a management GUI.>>=20>>=20>> The sudden slowdowns are not associated with peak traffic, though =peak traffic makes the problem more likely to quickly escalate into an =unresponsive server.=20>>=20>>=20>> Anyway.. thats my sad tale. Just looking to get the damn thing =running solid again.>>=20>> At this point I am even considering hosting off site, which I have =done in a decade. If anyone has a setup to support this feel free to PM =me. If the pricing is right then maybe that can be something I try too.>>=20>>=20>>=20>>=20>>=20>> On Apr 24, 2013, at 10:54 AM, Paul Willis wrote:>>=20>>> I'd be interested to know what the PITA is with the Ubuntu box. We =have been moving from Apple servers to Ubuntu ever since the Xserve was =discontinued and have nothing but good things to say about them.>>>=20>>> Paul>>>=20>>>=20>>> On 24 Apr 2013, at 15:15, Alex McCombie =wrote:>>>=20>>>> Hmm, good to know.>>>> I am going to buy the OSX server app later this week and install it =on a test machine. If I can get the server app running with MYSQL/PHP & =DNA without a ton of hassle then I will go ahead and buy the hardware =for it and migrate of the PITA ubuntu box.>>>> :-)>>>>=20>>>>=20>>>> On Apr 24, 2013, at 9:33 AM, Donovan Brooke =wrote:>>>>=20>>>>> HI Alex,>>>>> It's pretty easy these days:>>>>> Download:>>>>> http://dev.mysql.com/downloads/mysql/>>>>>=20>>>>> Docs (select your version at the left):>>>>> http://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html>>>>> =20>>>>> =20>>>>>> --- Original message ---=20>>>>>> Subject: [WebDNA] Apple Server=20>>>>>> From: Alex McCombie =20>>>>>> To: =20>>>>>> Date: Wednesday, 24/04/2013 8:04 AM>>>>>>=20>>>>>> Long time no post=85=20>>>>>>=20>>>>>> Still doing everything on WebDNA. 6.0 windows.>>>>>>=20>>>>>> Quick question though.>>>>>>=20>>>>>> I currently have and Unbuntu box with Apache/MySQL and Webmin =running multiple forums. I want to move to an apple server for the same =thing. A mini would be fine based on the traffic. I would also like the =ability to have WebDNA on this box to keep me from having to go to =another box for DNA stuff.>>>>>>=20>>>>>> But I am not really experienced with the OSX setup to allow =mysql.>>>>>>=20>>>>>> Can someone point me to the right direction to read up on the =process? I don't mind digging in and figuring it out but wouldn't mind =herding from people that are doing it and what to watch out for.>>>>>>=20>>>>>> Appreciated.>>>>>>=20>>>>>> Second post coming about active directory.>>>>>>=20>>>>>> thx>>>>>> Alex>>>>>>=20>>>>>>=20>>>>>>=20>>>>>> Alex J. McCombie . Database Administrator>>>>>> --------------------------------------------------------->>>>>> This message is sent to you because you are subscribed to>>>>>> the mailing list .>>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us>>>>>> Bug Reporting: support@webdna.us>>>>>=20>>>>> --------------------------------------------------------- This =message is sent to you because you are subscribed to the mailing list . =To unsubscribe, E-mail to: archives: =http://mail.webdna.us/list/talk@webdna.us Bug =Reporting:support@webdna.us>>>>=20>>>> --------------------------------------------------------- This =message is sent to you because you are subscribed to the mailing list . =To unsubscribe, E-mail to: archives: =http://mail.webdna.us/list/talk@webdna.us Bug Reporting: =support@webdna.us>>>=20>>> --------------------------------------------------------- This =message is sent to you because you are subscribed to the mailing list . =To unsubscribe, E-mail to: archives: =http://mail.webdna.us/list/talk@webdna.us Bug Reporting: =support@webdna.us>>=20>> --------------------------------------------------------- This =message is sent to you because you are subscribed to the mailing list . =To unsubscribe, E-mail to: archives: =http://mail.webdna.us/list/talk@webdna.us Bug Reporting: =support@webdna.us>=20> --------------------------------------------------------- This message =is sent to you because you are subscribed to the mailing list . To =unsubscribe, E-mail to: archives: =http://mail.webdna.us/list/talk@webdna.us Bug Reporting: =support@webdna.us--Apple-Mail=_5E3A8BAF-8B7F-45E1-B6AE-AD7A6CF71519Content-Transfer-Encoding: quoted-printableContent-Type: text/html;charset=windows-1252

On Apr 25, 2013, at 11:20 AM, Paul Willis <paul.willis@me.com> =wrote:

I'm =not convinced moving to Mac will fix this.

When we =were still on Mac servers we had a similar situation with a busy =PHP/MySQL site (not Vbulletin though). It turned out to be a =combination of two main issues...

1) MySQL =would dump the expired query cache for a query that got a lot =of requests (as it should the data had been updated and the cache was =old) but it took too long to process and a queue of the same big query =quickly built up from which it could not recover, just as you =describe.

Interesting, but =how did you resolve this if it was indeed causing a =slowdown?

2) A slow query that would lock a table and cause the same =avalanche but of different queries. I know you looked at slow =queries but you need to separate out what is a real slow query and what =are normal queries just taking an age because the server is bogged down. =In your slow query log the problem should be one of the first queries =that are logged just before sit all goes haywire. We often spent the day =watching live queries using Sequel Pro or similar apps to pin it =down

I have started emptying the slow query =log so that I can focus on the first 1 or 2 in each occurrence. I have =also 'minimized' my impacts by reducing the keep alive times down to 1-2 =seconds and controlling the maxchilds to reasonable =numbers.

Its still happening but only a =couple times a day compared to the dozens when it was kicking my =ass.

Another option =which might help (which we did) is to split the MySQL off onto it's own =server
Paul

Also =interesting, but if the problem was squarely on MYSQL, then I'm not sure =how having it separated would help all that much. Maybe free up a few =CPU ticks from apache.

The move =to OSX was as much about getting me into something I had more experience =with admittedly as anything else.

I am =intrigued though that you were having similar =issues.

What was your ultimate =resolution? Did you find a bad query? Was it the cache dump primarily? =Or an overtaxed server?

Chasing this thing has been like =chasing shadows. You think you got it and then 3 hrs later its =back.

On 25 =Apr 2013, at 15:23, Alex McCombie <info@adventureskies.com> =wrote:

Our =box running webmin / Apache/ MYSQL / PHP which contains 5 Vbulletin =forums on it has been suffering from an ongoing and maddening problem =where seemingly random times the connections will suddenly start =stacking up until it maxes out and becomes unresponsive. It will go from =5-15 requests to 150 (or whatever I assign the max to) in a matter of =minutes (or seconds depending on traffic) =85 all usually in a Waiting =for Connection state as if MYSQL is no longer responding.. but it =reports no locked tables. The slow query report turns out to be no help =because it shows queries that would normally be 1 second taking up to 60 =seconds each=85 which means that MYSQL is accepting the connections but =query time suddenly became insane.

Other than letting =it sit unusable for 15-20 min, an apache restart is needed to resolve =the problem. No backup or update routines scan be associated with =it.

I have looked under every rock in the =configuration, had the VB tech people dig into it, and even hired TDS to =come in and crawl through the setup to do an optimization and find the =issue. Nada

Nobody has been able to. It's =not a hardware issue as this is the second box that I have tried and the =problem followed it.

So at this point, I am =daily convinced it must be something with Webmin or Unbuntu =itself.

Unfortunately I am =a DBA/dev and not a network admin, but even my server admin guys are =stumped.

The machine its currently on =is:
DELL POWEREDGE 2950 DUAL =5150 8GB MEM 4x 500GB SATA
Processor is dual processor, =dual core - Intel=AE Xeon=AE Processor 5150
(4M Cache, 2.66 GHz, 1333 MHz FSB)

I serve about 3 million page =views per month on it but have become a slave to the damn =thing.

So, I figured I would try and =go back into an environment I was a bit more familiar with .. =OSX, though admittedly I really wanted a GUI to manage thing and =even though Webmin is capable of running on OSX, I would rather look =elsewhere for a management GUI.

The sudden =slowdowns are not associated with peak traffic, though peak traffic =makes the problem more likely to quickly escalate into an unresponsive =server.

Anyway.. thats my =sad tale. Just looking to get the damn thing running solid =again.

At this point I =am even considering hosting off site, which I have done in a decade. If =anyone has a setup to support this feel free to PM me. If the =pricing is right then maybe that can be something I try =too.

On =Apr 24, 2013, at 10:54 AM, Paul Willis <paul.willis@me.com> =wrote:

I'd =be interested to know what the PITA is with the Ubuntu box. We have been =moving from Apple servers to Ubuntu ever since the Xserve was =discontinued and have nothing but good things to say about =them.

Paul

On 24 =Apr 2013, at 15:15, Alex McCombie <info@adventureskies.com> =wrote:

Hmm, good to know.
I am =going to buy the OSX server app later this week and install it on a test =machine. If I can get the server app running with MYSQL/PHP & DNA =without a ton of hassle then I will go ahead and buy the hardware for it =and migrate of the PITA ubuntu =box.
:-)

On Apr 24, =2013, at 9:33 AM, Donovan Brooke <dbrooke@webdna.us> =wrote:

HI Alex,
It's pretty easy these =days:
Download:
http://dev.mysql.com/downlo=ads/mysql/

Docs (select your version at the left):
h=ttp://dev.mysql.com/doc/refman/5.7/en/macosx-installation.html

--- Original message ---
Subject: [WebDNA] Apple Server
From: Alex McCombie <info@adventureskies.com>
To: <talk@webdna.us>
Date: Wednesday, 24/04/2013 8:04 =AM

Long time no post=85

Still doing =everything on WebDNA. 6.0 windows.

Quick question =though.

I currently have and Unbuntu box with Apache/MySQL and =Webmin running multiple forums. I want to move to an apple server for =the same thing. A mini would be fine based on the traffic. I would also =like the ability to have WebDNA on this box to keep me from having to go =to another box for DNA stuff.

But I am not really experienced =with the OSX setup to allow mysql.

Can someone point me to the =right direction to read up on the process? I don't mind digging in and =figuring it out but wouldn't mind herding from people that are doing it =and what to watch out for.

Appreciated.

Second post coming =about active directory.

thx
Alex

Alex J. =McCombie . Database =Administrator
---------------------------------------------------------=
This message is sent to you because you are subscribed to
the =mailing list <talk@webdna.us>.
To =unsubscribe, E-mail to: <talk-leave@webdna.us>
archi=ves: http://mail.webdna.us/l=ist/talk@webdna.us
Bug Reporting: support@webdna.us
--------------------------------------------------------- This message =is sent to you because you are subscribed to the mailing list . To =unsubscribe, E-mail to: archive=s: http://mail.webdna.us/l=ist/talk@webdna.us Bug Reporting:support@webdna.us

---------------------------------------------------------This message is sent to you because you are subscribed tothe mailing list .To unsubscribe, E-mail to: archives: http://mail.webdna.us/l=ist/talk@webdna.usBug Reporting: support@webdna.us

---------------------------------------------------------This message is sent to you because you are subscribed tothe mailing list .To unsubscribe, E-mail to: archives: http://mail.webdna.us/l=ist/talk@webdna.usBug Reporting: support@webdna.us