Home
Feed

Extend

Hashnode Pro
Hashnode for Agents

Resources

The foreword
Hashnode gql skill

Buildful - AI coding agent that delivers frontier-level results at a fraction of the cost Bug0 - The AI-native e2e QA regression testing Hackathons Changelog Brand @hashnode on X Hashnode on LinkedIn Support - hello+support@hashnode.com Code of Conduct Terms Privacy Sitemap

Sign in

Search Hashnode

Search posts, tags, users, and pages

@sdw-online

Stephen David-Williams

@sdw-online·London, England, United Kingdo·Joined December 2022

Data Engineer

About

I am a developer with 5+ years of data engineering experience in the financial + professional services sector.

Feel free to drop a message for any questions!

https://medium.com/@sdw-online

Available for

Nothing here yet.

Stephen David-Williams's blogs

Stephen's blogstephendavidwilliams.com38 posts

Articles Comments

Use data contracts to automate data workflows - part 2

Preface📖 In part 1, we explained what a data contract is why we need them, and what a typical one contains In this blog, we dive into a demo to explore how they actually work so we can process data safer, faster and effectively. Goal🎯 The data...

Dec 30, 2024 · 14 min readstephendavidwilliams.com

Use data contracts to automate data workflows - part 1

Preface 📚 I’ve actually written a post on data contracts before, so have a quick scan here if you want to see a project I created on them using Python, AWS S3 and other libraries (like Selenium and Soda). What is a contract? 🤔 Let’s first talk abou...

Dec 24, 2024 · 12 min readstephendavidwilliams.com

REST API to MySQL database using Python

Preface💫 In the previous blog post to this, we created a data pipeline that scrapes football data from a website and loads it to an AWS S3 bucket as a CSV file, all through Python. This time, we’ll be sending HTTP requests to a REST API endpoint, fo...

Mar 3, 2024 · 13 min readstephendavidwilliams.com

Create a web scraping pipeline with Python using data contracts

Preface 💫 This is a practical end-to-end data pipeline demo to show what a data project incorporating data contracts looks like. We’ll be scraping the Premier League table standings for the 2023/24 season, as of 13th February 2024 (the date this art...

Feb 13, 2024 · 24 min readstephendavidwilliams.com

For 2024…

🤨 What? If your goal is to learn Python and how it applies to data engineering and analytics scenarios for 2024, my goal is to help you with that. For 2024, I’ll be prioritizing more video content to show you multiple ways to use Python (as well as ...

Dec 31, 2023 · 2 min readstephendavidwilliams.com

About

I am a developer with 5+ years of data engineering experience in the financial + professional services sector.

Feel free to drop a message for any questions!

https://medium.com/@sdw-online

Available for

Nothing here yet.

Stephen David-Williams's blogs

Stephen's blogstephendavidwilliams.com38 posts