im not convinced you are working with large databa...
# datascience
j
im not convinced you are working with large databases frequently from your comments. there is no simple option to harvest diverse legacy production database into some shiny new faster BI platform, that's consulting golden-handcuffs snake-oil. how would you move a 300 gigabyte relational database to bigquery or amazon for instance?
a
I am not doing "traditional" data sceince. We seldom have huge data sets like few TB, but the data is binary, non-uniform and is not required to be sorted.
j
I'm not a data scientist by trade either, i just appear to have a proficient grasp of how to work with limited knowledge and resources for POC's mostly. the BIGGEST RED FLAG in any solution i have ever encountered is the part where python is doing any algorithm of any kind.
👍 1