Rucio - Scientific Data Management

Time 2021-11-20 08:05:38

Web Name: Rucio - Scientific Data Management

WebSite: http://rucio.cern.ch

ID:240372

Keywords:

Scientific,Rucio,Management,Data,

Description:

keywords:
description:
Rucio helps you to manage your community's data

Built on more than a decade of experience, Rucio serves the data needs of modern scientific experiments.
Large amounts of data, countless numbers of files, heterogeneous storage systems, globally distributed data centres, monitoring and analytics. All coming together in modular solution to fit your needs.
Find all the details in this journal article!

Extremely scalable

Need to search through billions of files? Need to transfer petabytes of data? Rucio has got you covered. Our largest installation for the ATLAS Experiment is responsible for more than 450 Petabytes of data, stored in a billion files, distributed over 120 data centres globally, and orchestrating an Exabyte of data access and transfer per year.

Policy-driven

Declarative data management allows you to say what you want, and let Rucio figure out the details how to do it. Manage your data with expressive statements. Three copies of my file on different continents, and have one backup on tape? Automatically remove it once its access popularity goes to zero? No problem.

Insights and analytics

Follow your data evolution over time, so you can keep control. From the popularity of your files, to the storage space and tape accounting of your data centres. Fully integrated with Graphite, ElasticSearch, and Hadoop.

FAIR

Rucio supports the FAIR data principles that promote maximal use of research data!

Features?
Smart namespace

Organise your files in datasets and containers, create virtual overlaps, distribute them by scope, or attach important metadata.

Storage support

Rucio connects your existing storage, and you can easily add new and different ones. Even tapes, cloud-based storage, or supercomputers. We want you to have choice and not lock you down to a single solution.

Easy integration

Existing applications and workflow systems can be integrated easily through our open libraries and REST servers. Rucio will not disrupt your experiment's workflows.

Authentication and authorisation

The classic username/password, x509 certificates with proxy support, GSS/Kerberos, SSH public keys, OpenID Connect, and SAML are all supported.

Monitoring

Directly integrated with ElasticSearch and Graphite, so you will never lose track of your data. Follow system performance from a single file to the global overview.

Open source powered

Robust code written in the Python language, unit-tested, PEP-certified. Deploy with pip or containers. It's free as in freedom (Apache v2) and open source!

Consistency

Data loss happens every day, and Rucio is prepared. Smart consistency and recovery mechanisms help you not to lose your data!.

Proven track record

Originally built to withstand the requirements of the high-energy physics experiment ATLAS, Rucio is scalable and robust; But also serving smaller communities, Rucio makes a scientist's life easier.

Get in touch

We are always happy to chat. You can drop us a mail and we will reply as quickly as possible.

Contact the developers Post to the mailing list
GitHub Slack Email Website template by: HTML5 UP Background image by: CERN

TAGS:Scientific Rucio Management Data 

<<< Thank you for your visit >>>

Websites to related :
Big UP Productions | Groundbreak

　　keywords:
description:
Home Landing 2021 Big UP Productions has joined forces with Sender Films to continue our work on feature documentaries, co

IDEA 2019 Miami FL, March 25-28,

　　keywords:
description:IDEA 2019 Miami FL, March 25-28, 2019: The worlds premier event for nonwovens and engineered fabrics
IDEA 2019 Exhi

Cuyo Islands Weblog | Just anoth

　　keywords:
description:Just another WordPress.com weblog
Home Cuyo Island, Palawan,PhilippinesEvery person we meet in our life has a purpose. Some ar

eSIM iPhone XS, XR and Pixel 3 D

　　keywords:
description:KnowRoaming eSIM for iPhone and Pixel 3 allows you to activate a cellular plan without SIM card. It is delivered to the device b

HOME | AlphaGA

　　keywords:
description:
 HOMEDISTRICT OFFICERSCHAPTER INVOICECONVENTIONVendor FormCBERGEORGIA TAG INTIATIVEADACCHAPTER DIRECTORYCHAPTE

Green River Valley Museum

　　keywords:
description:
Home

Lonelybrand.com : Brand Marketin

　　keywords:
description:lonelybrand delivers the latest brand marketing news for CMOs, with daily updates on social, content, mobile and other online ma

Long Way

　　keywords:
description:

98.1 Pearl FM Radio - Pearl of t

　　keywords:
description:Updated St.Maarten News, Caribbean News & Latest Music Worldwide.
Skip to content

Shanghai MBA Network

　　keywords:
description:
Mission: Our mission is to facilitate our members’ social, professional and philanthropic development. Home About SHMBA

ads

Hot Websites

WHY YOU SHOULD Be listed

Matt Cutts, a software engineer and former head of the web spam team at Google, stated back in 2012 that "spammy directories" are disregarded while those who "excercise editorial discretion" worth it. Even though countless business directories litter the internet, they won't all offer a positive change. Don't take unneeded risks and suggest your website to one that Google loves!

Email: liunxqq$$$126.com ($$$=@) ie websites |