DEDUPLICATION TECHNOLOGY

Deduplication Technology

Deduplication Technology

Introduction

Data deduplication technology came in the market five years ago, but became the most widely used and promoted only in 2007 among the vendors in the portfolio are in the decision to maintain the availability of data deduplication technology are integrated and presented in the regional market, include the following: EMC, 2007, "EMC Avamar: Backup with global deduplication"), Symantec, NetApp, HP, Data Domain, FalconStor. In addition to the above, Russia is also moving solutions company Diligent Technologies, through its OEM partners - Hitachi Data Systems. IBM, In April 2008 Diligent Technologies was acquired by IBM, which also decided to join the general trend. Diligent completion of integration of technology into the Tivoli Storage Manager and other products are expected by the end of summer 2008 According to representatives of HDS, no change in the sales of its policy-making, using technology Diligent, in the near future (Yueh, 2008).

Discussion

Most IT departments are faced with a choice, either to establish specialized memory device Islands deduplication, deduplication or perform using the software for backup. On the question of which approach is easier there is no unequivocal answer. Nevertheless, we can give is several recommendations (Wibowo, 2008).

By using specialized devices deduplication, now is the most common method of de-duplication, backup all data sent to a dedicated server, and it is satisfied deduplication. In this case, users can replace or complement the established target backup system with minimal changes to the general methodology of back-copying. Since deduplication is performed on a dedicated device, it does not lead to an increase in the load on the backup clients or media servers, and it simplifies operations such as replication. This method is not only the most common, but also the most developed. Its use means faster installation and fewer requirements for servicing (Yueh, 2008).

When using the software, the system includes a backup deduplication in a list of other tasks that are performed either on the backup client or on the media servers. Run-tion data deduplication before sending them to the target system will reduce the amount of data; co-torye must pass through the network. This idea is similar to the implementation of data compression program, and, among other things, data deduplication is almost always includes a data compression. Since deduplication is a relative expensive operation, it is likely slowing down the operations of back-copying, so you may need to add new servers or storage systems specialist. This can increase system cost and complexity of integration (Osuna, 2011).

In certain circumstances it may be approached any of the above approaches. In order to decide which one best suits your situation; identify the critical elements of the system, utilization of their media servers, as well as the level of integration, which will be justified in this situation (Wibowo, 2008).

Development of Deduplicating Technology

A common prerequisite for the development of methods for de-duplication is the desire to minimize the ever-increasing amount of data that is required to reserve in order to maintain their availability and, therefore, TSO these ...