Re: [WebDNA] backup / mirror website & databases
This WebDNA talk-list message is from 2018
It keeps the original formatting.
numero = 114193
interpreted = N
texte = 1796 Donovan, thanks for your suggestions!=C2=A0 Greatly appreciated. Steve On 04/19/2018 11:39 PM, Donovan Brooke wrote: > Well, I=E2=80=99m not a genius when it comes to server plans, but here = are my thoughts... In general I don=E2=80=99t see any problems with that = plan other than i don=E2=80=99t think it=E2=80=99s quite standard practic= e and maybe a little unnecessarily complicated?? However, if ensuring tha= t you don=E2=80=99t lose more than an hours activity is your main goal, m= aybe you have right idea. > > I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snaps= hots. So, here is an alternative idea: > > RAID 5 (or whatever raid you prefer) > > Hypervisor os running on extra SSD. > > Nightly snapshots > > Daily backups (then whatever longer-term and/or offsite strategies you = decide) > > Then you could look into VM replication options of the specific hypervi= zer you are using(to possibly address the shorter period of loss of data= ). > > That last part I don=E2=80=99t know much about... but remember, if you = are backing stuff up every hour, cracked files will get copied over to...= so in the event of not catching a crack in time, having a second cracked= server won=E2=80=99t help much. > > It=E2=80=99s nice to have a series of (one-button) snapshots.. over a l= ength of time (fitting in with your backup strategy), to fall back on if = needed. > > You could bypass the complicated replication part and do more snapshots= .... but the creation of them does impede on performance. > > > D. Brooke Mobile > >> On Apr 19, 2018, at 4:36 PM, webdna
= wrote: >> >> Hi Donovan, >> >> In the past I've had 2 physical servers running. A primary and a backu= p. They were joined by Gluster so that in the event the primary went down= for some reason the backup took over without the need of downtime to res= tore from the last nightly backup that would be missing current days acti= vity. >> >> My 2 most powerful servers (16GB RAM & dual quad core processors) are = getting old. I've recently upgraded drives to SSD's, replaced power supp= lies and batteries. I want to only have 1 powered up and the other to be = a cold spare. >> >> I want to run 2 virutal web servers running on one physical server. On= e serving to the public and the other running and be an up to date copy a= nd in the event something such as a hack occurred on the primary virtual = server where I could just change the IP address in the router to send all= web traffic to the backup server's IP. >> >> I would like to have rsync run once every hour so the process time wil= l be minimal and the most data that would be lost would be the last hour.= Then after the 1:00AM rsync have a script create a tar backup file of th= e directories and databases located on the backup server to a directory o= n a NAS as the days backup. >> >> Do you see any issues with this? >> >> Thanks, >> Steve >> >> >> >> >> >>> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >>> It shouldn=E2=80=99t be necessary... but i think ultimately it depend= s on your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D back= ups, their could be a performance impact, and at that point, you may want= to consider RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D= backups? >>> >>> D. Brooke Mobile >>> >>>> On Apr 19, 2018, at 12:03 PM, webdna wrote: >>>> >>>> Hi Donovan, >>>> >>>> I've been using rsync but the guy who used to help me with my server= s insisted I had to stop webdna first so the databases were not being wri= tten to and then run rsync. Once files were synced DNA was restarted. Is = it not necessary to stop WebDNA during the sync process ? >>>> >>>> Also, could you comment on this: >>>>> In the "User Submitted Tips & Tricks" section there is an example t= o >>>>> backup databases by a simple [COPYFILE]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>> Thanks! >>>> >>>> >>>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>>> If all you want is a backup, One option is an RSYNC script. >>>>> >>>>> From the man page: >>>>> DESCRIPTION >>>>> Rsync is a fast and extraordinarily versatile file copy= ing tool. It can copy locally, to/from another host over any remote shel= l, or >>>>> to/from a remote rsync daemon. It offers a large number of= options that control every aspect of its behavior and permit very flex= ible >>>>> specification of the set of files to be copied. It is = famous for its delta-transfer algorithm, which reduces the amount of data= sent >>>>> over the network by sending only the differences between th= e source files and the existing files in the destination. Rsync is wid= ely >>>>> used for backups and mirroring and as an improved copy comm= and for everyday use. >>>>> >>>>> Rsync finds files that need to be transferred using a "quic= k check" algorithm (by default) that looks for files that have changed in= size >>>>> or in last-modified time. Any changes in the other preserv= ed attributes (as requested by options) are made on the destination = file >>>>> directly when the quick check indicates that the file=E2=80= =99s data does not need to be updated. >>>>> >>>>> >>>>> There are other paid versions of backup utilities, but this one is = free. >>>>> >>>>> Donovan >>>>> >>>>> >>>>> >>>>>> On 2018-04-18 19:11, webdna wrote: >>>>>> Hi All, >>>>>> >>>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>>> databases in real time if possible. >>>>>> >>>>>> In the "User Submitted Tips & Tricks" section there is an example = to >>>>>> backup databases by a simple [COPYFILE]: >>>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>>> ?? Does the example Lock the databases while being copied or is it >>>>>> assumed the databases are not currently in use? >>>>>> >>>>>> I've previously had 2 physical servers running using Gluster in ou= r >>>>>> DMZ. I want to only have one physical machine running and having >>>>>> backups or synched copies of the site and databases reside on a NA= S or >>>>>> a server within our LAN. >>>>>> >>>>>> Thanks! >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list talk@webdna.us >>>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>>> Bug Reporting: support@webdna.us >>>> --=20 >>>> Steve Raslevich >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --=20 Steve Raslevich --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
Associated Messages, from the most recent to the oldest:
1796 Donovan, thanks for your suggestions!=C2=A0 Greatly appreciated. Steve On 04/19/2018 11:39 PM, Donovan Brooke wrote: > Well, I=E2=80=99m not a genius when it comes to server plans, but here = are my thoughts... In general I don=E2=80=99t see any problems with that = plan other than i don=E2=80=99t think it=E2=80=99s quite standard practic= e and maybe a little unnecessarily complicated?? However, if ensuring tha= t you don=E2=80=99t lose more than an hours activity is your main goal, m= aybe you have right idea. > > I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snaps= hots. So, here is an alternative idea: > > RAID 5 (or whatever raid you prefer) > > Hypervisor os running on extra SSD. > > Nightly snapshots > > Daily backups (then whatever longer-term and/or offsite strategies you = decide) > > Then you could look into VM replication options of the specific hypervi= zer you are using(to possibly address the shorter period of loss of data= ). > > That last part I don=E2=80=99t know much about... but remember, if you = are backing stuff up every hour, cracked files will get copied over to...= so in the event of not catching a crack in time, having a second cracked= server won=E2=80=99t help much. > > It=E2=80=99s nice to have a series of (one-button) snapshots.. over a l= ength of time (fitting in with your backup strategy), to fall back on if = needed. > > You could bypass the complicated replication part and do more snapshots= .... but the creation of them does impede on performance. > > > D. Brooke Mobile > >> On Apr 19, 2018, at 4:36 PM, webdna = wrote: >> >> Hi Donovan, >> >> In the past I've had 2 physical servers running. A primary and a backu= p. They were joined by Gluster so that in the event the primary went down= for some reason the backup took over without the need of downtime to res= tore from the last nightly backup that would be missing current days acti= vity. >> >> My 2 most powerful servers (16GB RAM & dual quad core processors) are = getting old. I've recently upgraded drives to SSD's, replaced power supp= lies and batteries. I want to only have 1 powered up and the other to be = a cold spare. >> >> I want to run 2 virutal web servers running on one physical server. On= e serving to the public and the other running and be an up to date copy a= nd in the event something such as a hack occurred on the primary virtual = server where I could just change the IP address in the router to send all= web traffic to the backup server's IP. >> >> I would like to have rsync run once every hour so the process time wil= l be minimal and the most data that would be lost would be the last hour.= Then after the 1:00AM rsync have a script create a tar backup file of th= e directories and databases located on the backup server to a directory o= n a NAS as the days backup. >> >> Do you see any issues with this? >> >> Thanks, >> Steve >> >> >> >> >> >>> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >>> It shouldn=E2=80=99t be necessary... but i think ultimately it depend= s on your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D back= ups, their could be a performance impact, and at that point, you may want= to consider RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D= backups? >>> >>> D. Brooke Mobile >>> >>>> On Apr 19, 2018, at 12:03 PM, webdna wrote: >>>> >>>> Hi Donovan, >>>> >>>> I've been using rsync but the guy who used to help me with my server= s insisted I had to stop webdna first so the databases were not being wri= tten to and then run rsync. Once files were synced DNA was restarted. Is = it not necessary to stop WebDNA during the sync process ? >>>> >>>> Also, could you comment on this: >>>>> In the "User Submitted Tips & Tricks" section there is an example t= o >>>>> backup databases by a simple [copyfile]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>> Thanks! >>>> >>>> >>>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>>> If all you want is a backup, One option is an RSYNC script. >>>>> >>>>> From the man page: >>>>> DESCRIPTION >>>>> Rsync is a fast and extraordinarily versatile file copy= ing tool. It can copy locally, to/from another host over any remote shel= l, or >>>>> to/from a remote rsync daemon. It offers a large number of= options that control every aspect of its behavior and permit very flex= ible >>>>> specification of the set of files to be copied. It is = famous for its delta-transfer algorithm, which reduces the amount of data= sent >>>>> over the network by sending only the differences between th= e source files and the existing files in the destination. Rsync is wid= ely >>>>> used for backups and mirroring and as an improved copy comm= and for everyday use. >>>>> >>>>> Rsync finds files that need to be transferred using a "quic= k check" algorithm (by default) that looks for files that have changed in= size >>>>> or in last-modified time. Any changes in the other preserv= ed attributes (as requested by options) are made on the destination = file >>>>> directly when the quick check indicates that the file=E2=80= =99s data does not need to be updated. >>>>> >>>>> >>>>> There are other paid versions of backup utilities, but this one is = free. >>>>> >>>>> Donovan >>>>> >>>>> >>>>> >>>>>> On 2018-04-18 19:11, webdna wrote: >>>>>> Hi All, >>>>>> >>>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>>> databases in real time if possible. >>>>>> >>>>>> In the "User Submitted Tips & Tricks" section there is an example = to >>>>>> backup databases by a simple [copyfile]: >>>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>>> ?? Does the example Lock the databases while being copied or is it >>>>>> assumed the databases are not currently in use? >>>>>> >>>>>> I've previously had 2 physical servers running using Gluster in ou= r >>>>>> DMZ. I want to only have one physical machine running and having >>>>>> backups or synched copies of the site and databases reside on a NA= S or >>>>>> a server within our LAN. >>>>>> >>>>>> Thanks! >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list talk@webdna.us >>>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>>> Bug Reporting: support@webdna.us >>>> --=20 >>>> Steve Raslevich >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --=20 Steve Raslevich --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
webdna
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WebCat2b14MacPlugIn - [include] doesn't hide the search string (1997)
serial number generation (1997)
Carts & cookies (1999)
emailer (1997)
4.51 Triggers (2003)
[WebDNA] Processor Maxing out (2010)
Need relative path explanation (1997)
Summary search -- speed (1997)
[WebDNA] Ubuntu 14.04 LTS / Apache 2.4 (2014)
textarea data entry and display (2000)
synching databases on multiple servers (1997)
Multiple catalog databases and showcart (1997)
Re:Searching for ALL / empty form field *the FINAL answer* (1997)
math on date? (1997)
WebCat ignoring Shopping Cart Folder (2001)
Pithy questions on webcommerce & siteedit (1997)
unable to launch acgi in WebCat (1997)
Re:PCS Customer submissions ? (1997)
WebCatalog Mac 2.1b3 (1997)
Weird problems with [SHOWIF]s (1997)