some physics researchers in our institute have to ...
# randome
elect
11/29/2023, 4:53 PMsome physics researchers in our institute have to share in their group some final and intermediate simulation results up to ~5GB. Metadata and input simulation have to be indexable and searchable... what choices do we have?
I was thinking, as a start, maybe using the self hosted Gitlab (with LFS storage) within the institute in order to have some blazing fast upload/download speeds with some distributed vcs..
y
Yogeshvu
11/30/2023, 12:53 AMYou may want to explore lakefs and dvc projects
👍 1
e
elect
11/30/2023, 7:50 AMthanks for the head up, interesting
elect
11/30/2023, 8:40 AMan interesting read
https://lakefs.io/blog/dvc-vs-git-vs-dolt-vs-lakefs/