Backup storage: What’s the best solution for my Python library?

413315 pts.
Tags:
Backup storage
Python
My partner is working on a project in which he's writing a data processing library in Python that's going to read data from different sources into memory, manipulate it, and export it into different formats. I'm helping him load the data but some of the datasets are really large (over 4 gigs). So we're looking for an open source library for backup storage that can deal with these large datasets. It also needs to be able to deal with the data structure (add, rename, etc) and should support fast iteration. It also needs to be able to add missing values. Does anyone have a good suggestion?

Answer Wiki

Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Discuss This Question:  

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

Thanks! We'll email you when relevant content is added and updated.

Following

Share this item with your network: