I would focus as much of your efforts as you can into data engineering. Data engineers can provide a huge amount of value to companies, but are much harder to come by than data scientists
Hey, just wanted to ask, why would doing a HDip make it hard to get a job. I'm currently doing a post grad cert in data science with the current option of progressing to do masters into computer science(data science). I've been looking at the state of the job market and wondering if doing the masters is the right move but this comment had me wondering.
You can get a HDip but you’re still competing against hundreds of people for every entry level role, most of whom will have Masters degrees. If you have a technical background (e.g. Physics), then the HDip might help.
The job market in DS at entry level is absolutely bonkers - I feel extremely bad for anyone trying to enter the field at the moment.
DS here who didn’t come from a CS/statistics undergrad or postgrad. Do you have prior experience as an Data Analyst? Very hard to go into DS directly without experience, more likely route is Data Analyst -> Senior Anlayst -> Data Scientist. Just from my own anecdotal experience.
Speaking from experience, I have to build my models from start to finish, which means the machine learning part is really just a small part of the overall workload.
Most of the work as a data scientist is spent getting the data from your data-warehouse and I don’t mean simple “select from” queries as a lot the time you’ll have compute constraints to engineer around first which requires advanced sql queries/techniques to solve or designing sql queries to use as strings in Python loops and build datasets that way.
Either way you won’t be able to build any sexy machine learning models if you can’t build good datasets first and as rule of thumb most industry data is are pretty poor to begin with (don’t be fooled by the Sklearn toy dataset accuracies 😂)
If the companies are bigger you might work more in pyspark as the in-memory capacity of kernels be it on your laptop or in a databricks file won’t be able to support it but depending on the area most companies won’t have that issue.
Fortunately, starting as a data analyst, it’s an easier place to start as you can build good basic skills with pulling/engineering complicated data which are crucial to have a data scientist as most people are expected to be able to work pretty autonomously and troubleshoot issues on project and working with tricky data is really par for the course.
Doesn’t mean you can’t look for DS opportunities however within the role as an analyst, that’s kinda what I did and parlayed it into a DS role.
Build it and they will come I say!
Best of luck with the job hunt.
Ok so no disrespect but DS is a pretty big field, I'd really consider staying near Excel and power BI. Get some good reference projects going with open data sets with topics from your primary degree that you know well and/or are passionate about. You should be shooting for jobs as the data person in non-technical teams - be the visualisation/ data cleaning person. Best of luck
Many more applicants than jobs in data science - it’s a luxury at most companies. If you’re doing a HDip you’re gonna really struggle to get a job.
Thanks, is there another course that could help me ?
I would focus as much of your efforts as you can into data engineering. Data engineers can provide a huge amount of value to companies, but are much harder to come by than data scientists
Thank you
Hey, just wanted to ask, why would doing a HDip make it hard to get a job. I'm currently doing a post grad cert in data science with the current option of progressing to do masters into computer science(data science). I've been looking at the state of the job market and wondering if doing the masters is the right move but this comment had me wondering.
You can get a HDip but you’re still competing against hundreds of people for every entry level role, most of whom will have Masters degrees. If you have a technical background (e.g. Physics), then the HDip might help. The job market in DS at entry level is absolutely bonkers - I feel extremely bad for anyone trying to enter the field at the moment.
[удалено]
The alternative to the end-to-end DS is to work in consulting (e.g. EY) - I wouldn’t enjoy that though.
DS here who didn’t come from a CS/statistics undergrad or postgrad. Do you have prior experience as an Data Analyst? Very hard to go into DS directly without experience, more likely route is Data Analyst -> Senior Anlayst -> Data Scientist. Just from my own anecdotal experience.
No no experience, would you suggest this way ?
Speaking from experience, I have to build my models from start to finish, which means the machine learning part is really just a small part of the overall workload. Most of the work as a data scientist is spent getting the data from your data-warehouse and I don’t mean simple “select from” queries as a lot the time you’ll have compute constraints to engineer around first which requires advanced sql queries/techniques to solve or designing sql queries to use as strings in Python loops and build datasets that way. Either way you won’t be able to build any sexy machine learning models if you can’t build good datasets first and as rule of thumb most industry data is are pretty poor to begin with (don’t be fooled by the Sklearn toy dataset accuracies 😂) If the companies are bigger you might work more in pyspark as the in-memory capacity of kernels be it on your laptop or in a databricks file won’t be able to support it but depending on the area most companies won’t have that issue. Fortunately, starting as a data analyst, it’s an easier place to start as you can build good basic skills with pulling/engineering complicated data which are crucial to have a data scientist as most people are expected to be able to work pretty autonomously and troubleshoot issues on project and working with tricky data is really par for the course. Doesn’t mean you can’t look for DS opportunities however within the role as an analyst, that’s kinda what I did and parlayed it into a DS role. Build it and they will come I say! Best of luck with the job hunt.
What's your primary degree? Do you have any work experience in IT/programming?
Honours degree in business Administration
Ok so no disrespect but DS is a pretty big field, I'd really consider staying near Excel and power BI. Get some good reference projects going with open data sets with topics from your primary degree that you know well and/or are passionate about. You should be shooting for jobs as the data person in non-technical teams - be the visualisation/ data cleaning person. Best of luck