Skip to end of metadata
Go to start of metadata

A View Inside the Datomizer® Vaults

Data AtomsTM are anonymously stored within a set of storage nodes. Transformed data blocks are scattered to different servers using parallel channels, which multiplies data transfer speed. This also makes data interception impossible.

The vault snapshots, data blocks and Data AtomsTM, described below, form a graph of related data objects.

Datomizer® uses a fast, key-value pair-based, graph database to access various information about the state of the system. These include finding:

 

  • The latest valid vault snapshot
  • The closest snapshot for rollback
  • Data blocks that need repairing

Inside a Data AtomTM

Typical Data AtomsTM contain:

  • Storage nodes configuration
  • Vault configuration
  • A link to active vault snapshot
  • The current state of data blocks used for snapshot

Replication

A full system configuration is replicated to each Storage Node on a regular basis. This ensures the Datomia® system can survive the underlying virtual machine server outage without losing any data. The whole system state can also be restored if the VM data is destroyed.

Vault snapshots include the following metadata:

 

  • A list of the data blocks used
  • Checksums for verifying data blocks integrity
  • A base snapshot image
  • Blocks delta overlaid over base vault snapshot
  • A link to previous vault snapshot used

NFS File Sharing Services

Datamizer® uses Linux servers to provide a powerful NFS server to NFS clients.

NFS v3 and v4 are supported, including the full range of NFS export security and other options. Datomizer® NFS Server has been tuned and optimized for maximum throughput and performance, so web application servers and other NFS clients operate at maximum speed.

Datomizer® Vault Options

You can select from a range of vault types configured to different application requirements. For example, you can create vaults for file storage, archiving and deep archiving. In the near future, you’ll also be able to create vaults optimized for running block-based databases, video imaging and image storage applications.

All the vaults come with Datomizer data protection security and performance. 

The Global File System Vault

The Global File System vault option (also known as the Datomia® File System) provides a high performance cloud storage file system with unlimited storage capacity. You would use the Global File System vault when you needed unlimited storage capacity accessible from different geographical areas. This option is ideal for web servers requiring large storage capacity for images and videos, and fast performance. 

Your data can be stored across multiple cloud centers, and be part of a single file system that can be accessed almost instantaneously from other members of the cluster located in other geographical regions. For example, your data could be stored in multiple Datomizer® vault clusters, using a Microsoft Azure data center in Ireland, an AWS data center in Virginia and an on-premises data center in Singapore.

The Active Archive Vault

The Active Archive vault option provides long term storage of data that is compressed and deduplicated.  All the data is compressed automatically. This option is for when you need low storage costs and can tolerate moderate retrieval speeds. This is ideal for fast backups, as well as archives that may need to be retrieved from time to time.  

The Active Archive vault requires a connection to the internet.

The Deep Archive Vault

The Deep Archive vault offers you lower storage cost compared to Active Archive vault. It is ideal if your data is rarely retrieved, and data retrieval times are less important.

This vault uses Amazon Glacier cloud storage, and it provides long term storage of data that is compressed and deduplicated.  All the data is compressed automatically. The Deep Archive vault requires a connection to the internet. 

Windows File Sharing / CIFS

Windows file sharing via CIFS protocol provides file sharing with Windows servers and Windows clients, including Windows 7/8, Windows XP and other Windows-compatible devices. An unlimited number of file shares are supported. 

The underlying Samba filesystem storage is managed by Btrfs, extending snapshots, cloning, multi-tier caching, data compression, deduplication and other Btrfs features to CIFS shares. Samba can be configured to authenticate using Active Directory user accounts, and Windows users and groups can be mapped to Linux users and groups. Flexible access controls can be configured on a per share basis.

Btrfs File System

Datomizer CIFS provides the advanced features of Btrfs, combined with the proven, flexible Samba server.

The NFS file system provides snapshots, clones, caching, compression, deduplication and more.

Underlying NFS data storage is managed by Btrfs, which adds the following features to Datomizer NAS server:

  • Snapshots
  • Cloning
  • Multi-tier Caching
  • Data Compression
  • Data Deduplication

Linux user and group identities can be mapped using standard Linux-based identity management. NFS file and directory ownership and permissions operate as expected.

Linux User, Group Permissions and Flexible Authentication Support

Security restrictions can be used to restrict NFS client access by host and IP address range, using any Linux-supported authentication method.

iSCSI Server

The Datomizer® iSCSI interface provides advanced block level storage management with a high-performance iSCSI Server. iSCSI benefits from multi-tier read caching, as well as write-cache options to boost write IOPS. Since the underlying iSCSI LUN storage is managed by Btrfs copy-on-write file system, LUNs are thin-provisioned, insuring no performance penalties.

In addition, Datomizer®’s enhanced iSCSI includes the following Btrfs features[1]:

  • Snapshots
  • Clones
  • Caching
  • Compression
  • Extending snapshots
  • Multi-tier caching
  • Data compression
  • Data Deduplication

Datomia® RESTful HTTPS Interface API

The Datomia® RESTful HTTPS interface API to its object storage system allows for fast, easy access to files from users anywhere in the world.

The Datomia® File System Emulator

The Datomia® file system emulator with Smart Cache, in conjunction with 10x faster data transfer speeds, compensates for the common object storage drawbacks. 

Traditional object storage has significantly slower throughput, compared to a traditional file system. This is partially due to its requirement to perform I/O operations on a single entity as an atomic unit.

The other big drawback of object storage is data consistency is achieved very slowly. Whenever you update a file, you may have to wait until the change is propagated to all of the replicas before requests will return the latest version. This makes object storage unsuitable for data that changes frequently.

Datomia® solves this by creating promptly accessible Data AtomsTM, allowing quick recreation of requested blocks by NAS storage. It's also a great fit for all the data that doesn't change much, such as backups, archives, video and audio files and virtual machine images.

POSIX Compliance

Unlike other object storage solutions, Datomizer® encodes metadata into Data AtomsTM and simplifies implementation architecture, without losing POSIX file system structure and relationships.

The Datomia® file system emulator offers all the features of POSIX file systems. For example:

  • Hierarchical structure of files and directories
  • Attributes of files like uid, gid, access mask, access time, modification time, change time support for symlinks, hardlinks, etc.
  • Access control lists
  • Extended attributes

Semantics of access rights in the Datomia® file system simulator are precisely the same as in other POSIX file systems (for example: ext or xfs). This makes it compatible with all applications that can use a local hard drive as their storage.

Datomizer® Firewall Support

Datomizer® is configured to readily support traversal through static firewall ports. This provides convenience of configuration, plus increased network security and access control.

 


[1] For more information on Btrfs, see https://en.wikipedia.org/wiki/Btrfs

  • No labels