Review options to manage disk space

[Bridg109]

Proposal

With all of these datasets our data storage will be rather large. Even more so if we plan to archive old data sets. Review and consider options to reduce the storage space required
-Downloaded dataset storage

• conversion to parquet or other super compressed file size
• deleting datasets after load to DB
• archiving datasets on separate storage device after load
• delete unused parts of downloaded dataset (ie dailymed pics)

-Database Storage options

• column storage database implementation
• column data type management to reduce size

Rationale

Storage costs money