با برنامه Player FM !
164: I built an entire data pipeline in 30 minutes using only AI (no code required)
Manage episode 488399565 series 3610716
Today, we'll create an entire data pipeline from scratch without writing a single line of code! Using Keboola MCP server and ClaudeAI, we’ll extract data from my FindADataJob.com RSS feed, transform it, load it into Google BigQuery, and visualize it with Streamlit. This is the future of data engineering!
Keboola MCP Integration:
https://mcp.connection.us-east4.gcp.keboola.com/sse
I Analyzed Data Analyst Jobs to Find Out What Skills You ACTUALLY Need
https://www.youtube.com/watch?v=lo3VU1srV1E&t=212s
💌 Join 10k+ aspiring data analysts & get my tips in your inbox weekly 👉 https://www.datacareerjumpstart.com/newsletter
🆘 Feeling stuck in your data journey? Come to my next free "How to Land Your First Data Job" training 👉 https://www.datacareerjumpstart.com/training
👩💻 Want to land a data job in less than 90 days? 👉 https://www.datacareerjumpstart.com/daa
👔 Ace The Interview with Confidence 👉 https://www.datacareerjumpstart.com/interviewsimulator
⌚ TIMESTAMPS
00:00 - Introduction
00:54 - Definition of Basic Data Engineering Terms
02:26 - Keboola MCP and Its Capabilities
07:48 - Extracting Data from RSS Feed
12:43 - Transforming and Cleaning the Data
19:19 - Aggregating and Analyzing Data
23:19 - Scheduling and Automating the Pipeline
25:04 - Visualizing Data with Streamlit
🔗 CONNECT WITH AVERY
🎥 YouTube Channel: https://www.youtube.com/@averysmith
🤝 LinkedIn: https://www.linkedin.com/in/averyjsmith/
📸 Instagram: https://instagram.com/datacareerjumpstart
🎵 TikTok: https://www.tiktok.com/@verydata
💻 Website: https://www.datacareerjumpstart.com/
Mentioned in this episode:
🌞 Summer Cohort of DAA
Join the Summer Cohort of DAA and become an analyst by the end of summer! Be sure to check out our current deal to save BIG! See you in class!
https://www.datacareerjumpstart.com/daa
💙 Thank you for subscribing & leaving a review
Thanks to YOU we recently became the most popular data podcast out there. Thank you so much for listening. If you haven't subscribed yet, hit subscribe. It costs $0. If you enjoy the show, leave us a 5-star rating on Spotify or Apple. It helps people like you find the show AND it helps us land better guests. Thank you so much for your support.
165 قسمت
164: I built an entire data pipeline in 30 minutes using only AI (no code required)
Data Career Podcast: Helping You Land a Data Analyst Job FAST
Manage episode 488399565 series 3610716
Today, we'll create an entire data pipeline from scratch without writing a single line of code! Using Keboola MCP server and ClaudeAI, we’ll extract data from my FindADataJob.com RSS feed, transform it, load it into Google BigQuery, and visualize it with Streamlit. This is the future of data engineering!
Keboola MCP Integration:
https://mcp.connection.us-east4.gcp.keboola.com/sse
I Analyzed Data Analyst Jobs to Find Out What Skills You ACTUALLY Need
https://www.youtube.com/watch?v=lo3VU1srV1E&t=212s
💌 Join 10k+ aspiring data analysts & get my tips in your inbox weekly 👉 https://www.datacareerjumpstart.com/newsletter
🆘 Feeling stuck in your data journey? Come to my next free "How to Land Your First Data Job" training 👉 https://www.datacareerjumpstart.com/training
👩💻 Want to land a data job in less than 90 days? 👉 https://www.datacareerjumpstart.com/daa
👔 Ace The Interview with Confidence 👉 https://www.datacareerjumpstart.com/interviewsimulator
⌚ TIMESTAMPS
00:00 - Introduction
00:54 - Definition of Basic Data Engineering Terms
02:26 - Keboola MCP and Its Capabilities
07:48 - Extracting Data from RSS Feed
12:43 - Transforming and Cleaning the Data
19:19 - Aggregating and Analyzing Data
23:19 - Scheduling and Automating the Pipeline
25:04 - Visualizing Data with Streamlit
🔗 CONNECT WITH AVERY
🎥 YouTube Channel: https://www.youtube.com/@averysmith
🤝 LinkedIn: https://www.linkedin.com/in/averyjsmith/
📸 Instagram: https://instagram.com/datacareerjumpstart
🎵 TikTok: https://www.tiktok.com/@verydata
💻 Website: https://www.datacareerjumpstart.com/
Mentioned in this episode:
🌞 Summer Cohort of DAA
Join the Summer Cohort of DAA and become an analyst by the end of summer! Be sure to check out our current deal to save BIG! See you in class!
https://www.datacareerjumpstart.com/daa
💙 Thank you for subscribing & leaving a review
Thanks to YOU we recently became the most popular data podcast out there. Thank you so much for listening. If you haven't subscribed yet, hit subscribe. It costs $0. If you enjoy the show, leave us a 5-star rating on Spotify or Apple. It helps people like you find the show AND it helps us land better guests. Thank you so much for your support.
165 قسمت
All episodes
×به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.