Skip to end of metadata
Go to start of metadata

A View Inside the Datomizer® Vaults

Data AtomsTM are anonymously stored within a set of storage nodes. Transformed data blocks are scattered to different servers using parallel channels, which multiplies data transfer speed. This also makes data interception impossible.

The vault snapshots, data blocks and Data AtomsTM, described below, form a graph of related data objects.

Datomizer® uses a fast, key-value pair-based, graph database to access various information about the state of the system. These include finding:

 

  • The latest valid vault snapshot
  • The closest snapshot for rollback
  • Data blocks that need repairing

Inside a Data AtomTM

Typical Data AtomsTM contain:

  • Storage nodes configuration
  • Vault configuration
  • A link to active vault snapshot
  • The current state of data blocks used for snapshot

Replication

A full system configuration is replicated to each Storage Node on a regular basis. This ensures the Datomia® system can survive the underlying virtual machine server outage without losing any data. The whole system state can also be restored if the VM data is destroyed.

Vault snapshots include the following metadata:

 

  • A list of the data blocks used
  • Checksums for verifying data blocks integrity
  • A base snapshot image
  • Blocks delta overlaid over base vault snapshot
  • A link to previous vault snapshot used

NFS File Sharing Services

Datamizer® uses Linux servers to provide a powerful NFS server to NFS clients.

NFS v3 and v4 are supported, including the full range of NFS export security and other options. Datomizer® NFS Server has been tuned and optimized for maximum throughput and performance, so web application servers and other NFS clients operate at maximum speed.

Windows File Sharing / CIFS

Windows file sharing via CIFS protocol provides file sharing with Windows servers and Windows clients, including Windows 7/8, Windows XP and other Windows-compatible devices. An unlimited number of file shares are supported. 

The underlying Samba filesystem storage is managed by Btrfs, extending snapshots, cloning, multi-tier caching, data compression, deduplication and other Btrfs features to CIFS shares. Samba can be configured to authenticate using Active Directory user accounts, and Windows users and groups can be mapped to Linux users and groups. Flexible access controls can be configured on a per share basis.

Btrfs File System

Datomizer CIFS provides the advanced features of Btrfs, combined with the proven, flexible Samba server.

The NFS file system provides snapshots, clones, caching, compression, deduplication and more.

Underlying NFS data storage is managed by Btrfs, which adds the following features to Datomizer NAS server:

  • Snapshots
  • Cloning
  • Multi-tier Caching
  • Data Compression
  • Data Deduplication

Linux user and group identities can be mapped using standard Linux-based identity management. NFS file and directory ownership and permissions operate as expected.

Linux User, Group Permissions and Flexible Authentication Support

Security restrictions can be used to restrict NFS client access by host and IP address range, using any Linux-supported authentication method.

iSCSI Server

The Datomizer® iSCSI interface provides advanced block level storage management with a high-performance iSCSI Server. iSCSI benefits from multi-tier read caching, as well as write-cache options to boost write IOPS. Since the underlying iSCSI LUN storage is managed by Btrfs copy-on-write file system, LUNs are thin-provisioned, insuring no performance penalties.

In addition, Datomizer®’s enhanced iSCSI includes the following Btrfs features[1]:

  • Snapshots
  • Clones
  • Caching
  • Compression
  • Extending snapshots
  • Multi-tier caching
  • Data compression
  • Data Deduplication

Datomia® RESTful HTTPS Interface API

The Datomia® RESTful HTTPS interface API to its object storage system allows for fast, easy access to files from users anywhere in the world.

The Datomia® File System Emulator

The Datomia® file system emulator with Smart Cache, in conjunction with 10x faster data transfer speeds, compensates for the common object storage drawbacks. 

Traditional object storage has significantly slower throughput, compared to a traditional file system. This is partially due to its requirement to perform I/O operations on a single entity as an atomic unit.

The other big drawback of object storage is data consistency is achieved very slowly. Whenever you update a file, you may have to wait until the change is propagated to all of the replicas before requests will return the latest version. This makes object storage unsuitable for data that changes frequently.

Datomia® solves this by creating promptly accessible Data AtomsTM, allowing quick recreation of requested blocks by NAS storage. It's also a great fit for all the data that doesn't change much, such as backups, archives, video and audio files and virtual machine images.

POSIX Compliance

Unlike other object storage solutions, Datomizer® encodes metadata into Data AtomsTM and simplifies implementation architecture, without losing POSIX file system structure and relationships.

The Datomia® file system emulator offers all the features of POSIX file systems. For example:

  • Hierarchical structure of files and directories
  • Attributes of files like uid, gid, access mask, access time, modification time, change time support for symlinks, hardlinks, etc.
  • Access control lists
  • Extended attributes

Semantics of access rights in the Datomia® file system simulator are precisely the same as in other POSIX file systems (for example: ext or xfs). This makes it compatible with all applications that can use a local hard drive as their storage.

Datomizer® Firewall Support

Datomizer® is configured to readily support traversal through static firewall ports. This provides convenience of configuration, plus increased network security and access control.

 


[1] For more information on Btrfs, see https://en.wikipedia.org/wiki/Btrfs

  • No labels