There are plenty of clichés about data and its likeness to oil. But it’s far from easy to get value from data. Companies are creating more data than ever before. At our current pace, 2.5 quintillion bytes of data are created every day. Companies went from pulling data solely from their CRM and ERP systems to pulling data from dozens or hundreds of data sources simultaneously. Creating data pipelines for all of these data sources is expensive and difficult to maintain. Data engineers are often stretched thin, between constantly updating API connections, to building new pipelines for every data source. Without access to this data, analysts and data scientists cannot provide key insights for organizational stakeholders. But, in the last decade, software solutions have emerged that can pull data from many different data sources without requiring companies to build infrastructure manually. These managed, low-code platforms increase efficiency and time-to-insights, while freeing engineers to work on more important projects. SnowflakeDB https://www.snowflake.com/ Rivery https://rivery.io/ If you enjoyed this video, check out some of my other top videos. What Skills Do Data Engineers Need? https://www.youtube.com/watch?v=LgSHaOvNodA Data Engineering Project Ideas https://youtu.be/LJkVvNWlO0g If you want to learn more about machine learning, check out DataCamps Machine Learining Course https://bit.ly/3BeLEml If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consults on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=x9T2fmuVzk0

As companies look to incorporate AI and ML into their data strategies and roadmaps, there is a new opportunity to refocus on data quality. Regardless of how fancy or sophisticated a company's AI model might be, poor data quality will make the outputs of these models useless at best, and misleading and company destroying at worst. So, as your company is rolling out its internally developed LLM or implementing a dynamic pricing model, it’s a great time to review your data quality strategy. The first key point to cover is that data quality is not limited to one pillar, like accuracy. But instead, several key pillars need to be considered when developing your data quality system. Again, special thanks to decube for sponsoring this video! If you're looking to improve your data quality you can check out the link below https://bit.ly/3Sndk1B If you enjoyed this video, check out some of my other top videos. Top Courses To Become A Data Engineer https://www.youtube.com/watch?v=kW8_l57w74g What Is The Modern Data Stack - Intro To Data Infrastructure Part 1 https://www.youtube.com/watch?v=-ClWgwC0Sbw If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/subscribe Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=wvUiRHd47M0

Many of you have asked me to review your resumes. As a thank you for helping me blow past 5k and being active members of the community, I wanted to look through and give some comments. I got multiple resumes and I do think I reviewed everyone that I got ( I apologize if I missed them). Again, I don't think I can say thank you enough. Honestly, back in March I just wanted to hit 2k and now we are over 6k! So let's keep it up. I have so many videos I want to make and share with you guys! Also, here is a link to the data engineering roadmap I reference in the video. With links and everything! https://drive.google.com/file/d/13U2jrqXGDOIRuM1alAd43aqUT6qieMF0/view Wherever you are in your data engineering journey. Good luck! So good luck with your DE career. And here are some more resources you may enjoy: What Skills Do Data Engineers Need? https://www.youtube.com/watch?v=LgSHaOvNodA&t=0s Data Engineering Project Ideas https://youtu.be/LJkVvNWlO0g If you want to learn more about data engineering, check out Google's Data Engineering Course * https://bit.ly/3c3woxu If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ 0:00 Intro 2:00 Resume 1 4:58 Resume 2 6:40 Resume 3 8:00 Resume 4 10:50 Thank You 11:17 Resume 5 14:06 Resume 6 Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consults on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=b-fSLdkZVxE

What python libraries should data engineers know? Here is a list from beginner to advanced! If you enjoyed this video, check out some of my other top videos. Top Courses To Become A Data Engineer In 2022 https://www.youtube.com/watch?v=kW8_l57w74g What Is The Modern Data Stack - Intro To Data Infrastructure Part 1 https://www.youtube.com/watch?v=-ClWgwC0Sbw If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/subscribe Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=LBs7w770RQM