Subscribe to Email Updates

    Workflow | 6 min read

    Data Archiving Workflow

    How to Virtualize your Storage ?

    Nodeum provide a feature to virtualize Secondary Storages as NAS, Cloud, Object or Tape Storages.

    This feature provides a virtual file system which is accessible through different standard protocols : SMB, NFS and S3. All data stay accessible by any users who have the rights & privileges.

    Furthermore, enterprise authorizations and authentifications mechanisms can be configured to control and secure the access to the data per users or groups.

    Best Practicse to Virtualize the Secondary Storage

    Here are the different steps to provide this Virtualize feature on top of your Secondary Storages :

    • Define a Container which will be available as entry point for end-users through their favorite protocols. The Container required to have a local caching enabled. This caching will allow be used in any interactions between end-users and the Secondary Storage.
    • Configure the Secondary Storage (NAS, Cloud, Tape) where you want to have the contents move down.
    • Define a Data Archiving or Active Archive Workflow to schedule the data movements from the Container Cache to the Secondary Storage.
    • End-users keep the access to any files stored in the Container even the one moved down to the elected Secondary Storage. They need to add new content into this space, they just have to drop files in the Container, they need to read data, they just have to click on the files, and automatically the system will recover the data and copy back the data to the cache space.
    • Leverage the Catalog, to monitor and to track your data lifecycle across the different Storage.

    Definition  

    Nodeum provides embedded Data Archiving or Active archive workflow.

    It’s archive a collection of data which can be move from a high cost primary storage to a secondary tier of storage. The data are deleted or not from the primary storage and the data has to stay accessible from time to time. Active archives store data that is not read-write intensive but can be modified or read from time to time. This data is generally stored on less expensive and less expensive storage media, such as tapes or cheaper disks. An active archive includes functionality to transparently move data between storage tiers (disk - tape - cloud) so that applications or users can access it directly.

    In which case you can use it?

    Move less used data to secondary storage tiers (disk - tape - cloud) and keep the data accessible from a container by any authorized users

    Complete virtualization of the Storage

    The virtualization covers the Primary Storage until the Secondary Storage.  All data has mount as a file system and you keep access by any users who have the rights & privileges.

    Here is the different steps to Virtualize your Storage :

    1. Create a Container  
    2. Configure Your Primary Storage
    3. Configure Your Secondary Storage Configuration (NAS, Cloud, Tape)
    4. Create an Active Archive Workflow to manage the data movement between Primary Storage and Secondary Storag
    5. See your data on the File System or in the Catalog.

    This workflow is to facilite and automate the classification of your Secondary Storage that you have as:

    • NAS
    • Object Storage - Cloud
    • Tape

    To automate this classification, it's very easy, Follow these steps : 

    Go to Workflow definition and choose Data Archiving, complete the form , and define the information about your data policies.

    The first parameters to configure are the name and some comments about the Task.

    Fill in the following information:

    • Name: Describe the name of the Task.
    • Comments: Insert comments about the Task.

    3. Select Copy or Move as Task Action

    4. Choose the source you want move or copy

    In this case the source has to be :

    • Container 

    5. Select and add the data you want to move or copy

    6. Choose the destination where you want classify the data.  In this case the destination can be :

    • Cloud Pool
    • Nas Pool
    • Tape Pool

    7. Define Filters to refine the selection of data

    8. Schedule the Task

    You can choose different type of schedule :

    Schedule Option Definition
    Automatic Task will be run automatically every five minutes.
    Schedule

    X Minute

    X Hour

    X Day at x times

    X Week at x Day and x times

    X Day per Month at X times

    Manual No Schedule defined.  You must launch the task manually after the creation

    9. Define Other Options

    • Priority: If multiple tasks are running simultaneously, tasks with higher priority will be run first.  You can choose Priority 1 until Max. 10.
    • Run with Parallel ProcessingRun task with parallelism for initialization, processing and finalization.
    • Report Complete File List: Display all Files processed in the report, not only the ones that were processed during the current execution (ok, uptodate and error).  

    💡If you don't see the uptodate file, doesn't select this option

    • Check integrity of data transfers : Select MD5 or CRC-32
    • Task Metadata: Select a metadata you want associate to the task

    💡Don't forget to create Metadata in the Configuration metadata panel (Business Files Metada or Task Metadata)

     

    💡❗The data restoration process automatically selects as the destination, the container for which data belong.

     

     

     

    Related Categories

    Workflow

    You may also like:

    Workflow Best Practice

    Best Practice - Workflow Multi copies on tape

    HOW TO PROCEED TO IMPLEMENT SPECIFIC WORKFLOWS WHEN DEALING WITH MULTI TAPE COPIES ? In this following blog, we are look...

    Workflow Settings Best Practice

    Primary Storage

    Definition Primary storage is the type of storage and technologies used to store and retain digital information that is ...

    Workflow Tape Library management

    Maintenance task

    Nodeum provides differents task of maintenance dedicated for tape Library. We can create task for : Tape Rehydratation T...

    Let Us Know What You Thought about this Post.

    Put your Comment Below.

    Learn and grow with award-winning support and a thriving community behind you.

    Get the free version