Data Archiving Workflow

How to Virtualize your Storage ?

Nodeum provide a feature to virtualize Secondary Storages as NAS, Cloud, Object or Tape Storages.

This feature provides a virtual file system which is accessible through different standard protocols : SMB, NFS and S3. All data stay accessible by any users who have the rights & privileges.

Furthermore, enterprise authorizations and authentifications mechanisms can be configured to control and secure the access to the data per users or groups.

Best Practicse to Virtualize the Secondary Storage

Here are the different steps to provide this Virtualize feature on top of your Secondary Storages :

Define a Container which will be available as entry point for end-users through their favorite protocols. The Container required to have a local caching enabled. This caching will allow be used in any interactions between end-users and the Secondary Storage.
Configure the Secondary Storage (NAS, Cloud, Tape) where you want to have the contents move down.
Define a Data Archiving or Active Archive Workflow to schedule the data movements from the Container Cache to the Secondary Storage.
End-users keep the access to any files stored in the Container even the one moved down to the elected Secondary Storage. They need to add new content into this space, they just have to drop files in the Container, they need to read data, they just have to click on the files, and automatically the system will recover the data and copy back the data to the cache space.
Leverage the Catalog, to monitor and to track your data lifecycle across the different Storage.

Definition

Nodeum provides embedded Data Archiving or Active archive workflow.

It’s archive a collection of data which can be move from a high cost primary storage to a secondary tier of storage. The data are deleted or not from the primary storage and the data has to stay accessible from time to time. Active archives store data that is not read-write intensive but can be modified or read from time to time. This data is generally stored on less expensive and less expensive storage media, such as tapes or cheaper disks. An active archive includes functionality to transparently move data between storage tiers (disk - tape - cloud) so that applications or users can access it directly.

In which case you can use it?

Move less used data to secondary storage tiers (disk - tape - cloud) and keep the data accessible from a container by any authorized users

Complete virtualization of the Storage

The virtualization covers the Primary Storage until the Secondary Storage. All data has mount as a file system and you keep access by any users who have the rights & privileges.

Here is the different steps to Virtualize your Storage :

Create a Container
Configure Your Primary Storage
Configure Your Secondary Storage Configuration (NAS, Cloud, Tape)
Create an Active Archive Workflow to manage the data movement between Primary Storage and Secondary Storage
See your data on the File System or in the Catalog.

This workflow is to facilite and automate the classification of your Secondary Storage that you have as:

NAS
Object Storage - Cloud
Tape

To automate this classification, it's very easy, Follow these steps :

Go to Workflow definition and choose Data Archiving, complete the form , and define the information about your data policies.

The first parameters to configure are the name and some comments about the Task.

Fill in the following information:

Name: Describe the name of the Task.
Comments: Insert comments about the Task.

3. Select Copy or Move as Task Action

4. Choose the source you want move or copy.

In this case the source has to be :

Container

5. Select and add the data you want to move or copy

6. Choose the destination where you want classify the data. In this case the destination can be :

Cloud Pool
Nas Pool
Tape Pool

7. Define Filters to refine the selection of data

8. Schedule the Task

You can choose different type of schedule :

Schedule Option	Definition
Automatic	Task will be run automatically every five minutes.
Schedule	X Minute X Hour X Day at x times X Week at x Day and x times X Day per Month at X times
Manual	No Schedule defined. You must launch the task manually after the creation

9. Define Other Options

Priority: If multiple tasks are running simultaneously, tasks with higher priority will be run first. You can choose Priority 1 until Max. 10.
Run with Parallel Processing: Run task with parallelism for initialization, processing and finalization.

Report Complete File List: Display all Files processed in the report, not only the ones that were processed during the current execution (ok, uptodate and error).

💡If you don't see the uptodate file, doesn't select this option

Check integrity of data transfers : Select MD5 or CRC-32

Task Metadata: Select a metadata you want associate to the task

💡Don't forget to create Metadata in the Configuration metadata panel (Business Files Metada or Task Metadata)

💡❗The data restoration process automatically selects as the destination, the container for which data belong.

Related Categories

Workflow

Subscribe to Email Updates