Testing data and metadata backends with ClawIO
H.G Labrador

Date: January 2016
Publisher: CS3: Cloud Storage Services for Novel Applications and Workflows
Location: Zürich, Switzerland
Links: VIDEO


Abstract

Open Source Cloud Sync and Share software provides synchronisation layer on top of a variety of backend storages such as local filesystems and object storage. In case of some software stacks, such as ownCloud, a SQL database is used to support the synchronisation requirements. We tested how different technology stacks impact the ownCloud HTTP-based Synchronisation Protocol. Efficiency and scalability analysis was performed based on benchmarking results. The results have been produced using the ClawIO framework prototype.

ClawIO is a Cloud Synchronisation Benchmarking Framework. The software provides a base architecture to stress different storage solutions against different cloud synchronisation protocols. Such architecture is based on the IETF Storage Sync draft specification and CERN EOS. The synchronisation logic is divided into control and data servers. This separation is done by the use of highly-decoupled micro services connected to each other using high performance communication protocols such a gRPC and HTTP/2.