MLtek on Facebook        MLtek on Twitter

We have recently signed up to CrowdReviews.com and we would really appreciate it if you could take a few minutes to leave us some feedback. All reviews are visible to everyone, and your review will be given particular weight if you can verify it with your LinkedIn profile.

 

 

ArchiverFS - Archiving to the Cloud

Product Home | Pricing | Download | Documentation | Release Notes | Customers

How to setup ArchiverFS to archive to the cloud

Before starting:

ArchiverFS is capable of integrating with most cloud storage offerings. Before deciding to setup cloud archiving there are a couple of items that have to be considered:

- How much data do you want to archive?

- How fast is your internet connectivity?

- How large are the largest files that users may want to access via seamless links?

All three of these items are crucial to the performance of the archiving solution. First files will need to be migrated to the archive storage accross the local internet connection, and then when users want to access those archived files they will need to be recalled over it.

If you are able to migrate everything that hasn't been used in 3 years to archive storage, then as a guide we recommend you allow for 75% of your total file system to be archived. Obviously the exact percentage will vary, and you can always turn up or down the age settings as required.

First we recommend that you calculate how long it will take to migrate 75% of your file system to cloud storage over the local internet connection. This is a simple calculation, but remember not to mix up MB's (MegaBytes) and Mb's (MegaBits). File system size will normally be calculated in MB's, and line speed will normally be calculated in Mb's. Divide Mb's by 8 to convert to MB's.

Next you should establish what the largest size archived file is that your users will typically need to access, and work out how long it will take a user to open that size file of file over the internet connection. You can set size limits on files to be archived, which may help if there are a small number of files that are significantly larger than the average.

 If your files are particularly large, if the internet connection isn't fast enough or if it will take a realy long time to migrate all your files to cound storage then you may be better off using stand alone storage on site like a NAS device.

As long as you are happy to proceed and all the above numbers add up, setting up archiving is quite simple.

Archiving over a VPN:

Once you have your cloud VM up and running with a Windows OS you can setup your site-to-site VPN. Almost all cloud providers will let you configure a site-to-site VPN between your cloud provision and your on-site infrastructure. This VPN is crucial, it will allow connectivity between your cloud service and your internal infrastructure, it is accross this VPN that files will be transfered and retrieved.

When configuring outbound connetions for your VPN you need to ensure that the server ArchiverFS will run on has access to it, and also ensure that all of your workstations can access it. When a workstation click on a link left behind by ArchiverFS all of the IO goes directly from the workstation to the archive server, it doesn't go via the ArchiverF server.

Then when configuring the inbound connections you need to ensure the cloud archive server can connect to at least one domain controller on your network. The cloud server will need to be a member of your domain if you want to maintain permisisons (we are assuming you do).

Once you have setup your VPN and configured any firewall rules you should be able to join your cloud server to your domain as a member server. Next, create a test share on your archive server and ensure both the ArchiverFS server and your users can access the new test share over the VPN.

Once you have configured and tested your cloud server and VPN you should work through the User Guide or the Quick Setup Guide to complete the setup.

Archiving to Amazon Glacier

Amazon Glacier offers almost unparrelled per GB storage costs, they are roughly on par with a locally deployed NAS device (depends heavily on the specific device, service life, etc). Amazon Glacier is a fantastic product, but there is one problem.

It is difficult to integrate Amazon Glacier with on premis services. At the time of writing, you can only interact with it via the Amazon Glacier via the Amazon console or via the HTTP API.

There is no way to directly share Amazon Glacier storage to the network, or mount Glacier storage to a VM as a volume. Lucklily there are ways round this.

Amazon Storage Gateway (https://aws.amazon.com/storagegateway/) allows you to present Amazon storage volumes to your local network as if they were hosted on your local on-site servers. In addition, you can setup policies to move old files from your Amazon storage volumes to Glacier storage automatically.

In principal this would allow you to deploy an Amazon Storage Gateway on site and use it to present an Amazon storage volume to the local network. This local volume can then be used as archive storage for one or more archive jobs, and as long as shortcuts aren't used in place of archived files the archived files can be automatically migrated to Amazon Glacier.

Getting further help:

If you have any further questions then pleae don't hesitate to contact us via [email protected]