Will New Object Storage Protocol Mean the End For POSIX?

guest · Oct 4, 2020

New Object Storage Protocol Could Mean the End for POSIX
Object storage now has an mmap function similar to POSIX. That means the processing and scalability limitations of POSIX become the new bottleneck
October 2, 2020
https://www.enterprisestorageforum....ge-protocol-could-mean-the-end-for-posix.html

POSIX has been the standard file system interface for Unix-based systems (which includes Linux) since its launch more than 30 years ago. Its usefulness in processing data in the user address space, or memory, has given POSIX-compliant file systems and storage a commanding presence in applications like deep learning that require significant data processing. The POSIX-compliant Lustre file system, for example, powers most supercomputers, and POSIX's dominance continues down market too.

POSIX has its limits, though and features like statefulness, prescriptive metadata, and strong consistency become a performance bottleneck as I/O requests multiply and data scales, limiting the scalability of POSIX-compliant systems.

Object storage is ideal for very large data stores and is widely used in cloud computing, but until now, POSIX has had one advantage: the mmap() protocol [...]
With mmap_obj() that advantage is no more and now object storage can also process data in the user space.
Click to expand...

As storage systems exceed billions of files, POSIX scalability and performance limitations could mean that object storage becomes the preferred option now that it has the ability to process data in the user space.
NVMeOF and mmap change the game
But what if there were a much faster, more scalable way to access data in object storage?

Non-Volatile Memory Express over Fabrics (NVMeOF) is a relatively new technology in which fabrics refers to network fabric and a device connected to a computer network allows data to be transferred into that device, such as an SSD.
NVMeOF could also provide higher compute power for data centers.
Click to expand...

In a time where data centers and cloud infrastructure must rapidly scale to meet demands for data storage and processing, accessing object storage through memory mapping could be an unparalleled way to accelerate data center performance.
Click to expand...

Log in or Sign up

Will New Object Storage Protocol Mean the End For POSIX?

guest Guest

Log in or Sign up

Will New Object Storage Protocol Mean the End For POSIX?

guest Guest

Useful Searches