Simple Openweather API Service using FastAPI and MinIO Object Storage — Docker Version

Hello, it’s been a long time since my last Data Engineering article in December. I got my first overseas remote project, which is a challenging opportunity. Sorry for making that sound like an excuse so that I am not updating my Medium for two months hehe

Actually, I would like to continue my article by giving a tutorial about batch processing. But I figured it might be interesting if I sliced up a whole part of Data Engineering into a few pieces instead of telling them from upstream to downstream. Then, at a certain point, we could combine a couple of them to produce an intact architecture.

I will start this series by showing how to create an API service using FastAPI. The API service will deploy using Docker, Google Cloud Run, and Google Cloud Functions. The last two will be covered in my next article. At the moment, I’m still learning AWS; App Runner and Lambda are also interesting to try. We’ll see later.

So, before moving on to the main course, I will introduce FastAPI. It is a cutting-edge web framework for building APIs with Python. It uses Python-type hints to automatically generate API documentation and endpoints, making it simple to create and maintain the API. Due to asynchronous programming and features like dependency injection and authentication, FastAPI can handle a large number of requests with a small number of threads. It’s also super fast, thanks to Pydantic, which is used for data validation and…