Backup storage: What’s the best solution for my Python library?

350300 pts.
Tags:
Backup storage
Python
My partner is working on a project in which he's writing a data processing library in Python that's going to read data from different sources into memory, manipulate it, and export it into different formats. I'm helping him load the data but some of the datasets are really large (over 4 gigs). So we're looking for an open source library for backup storage that can deal with these large datasets. It also needs to be able to deal with the data structure (add, rename, etc) and should support fast iteration. It also needs to be able to add missing values. Does anyone have a good suggestion?

Answer Wiki

Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Discuss This Question:  

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.

Following