Python Multiprocessing Example

In the last post we saw what are the differences between Multiprocessing and Multithreading in Python3 and the code sample which uses concurrent.futures library for crawling URLs in separate threads. Here we...

Python Example Multithreading with Concurrent Futures

Before we start you should understand the difference between Multiprocessing and Multithreading. To keep things simple I just put this quick comparison here. Multiprocessing + Great for CPU bound applications + Takes advantage of...

Python displaced Java to become the second most popular programming language!

Python has become the second most popular programming language after JavaScript, according to a January 2021 RedMonk report. Previously, this position was confidently held for a long time by Java, but...

Get List of Files in Specific AWS Bucket

First, you have to be very careful when trying to get list of objects from AWS S3 bucket because potentially there might be millions or billions of files, so you might...

GitHub Actions: Deployment to EKS with Kustomize

If your code is on GitHub you simply must use GitHub Actions for CI/CD. GitHub Actions syntax is very intuitive and simple. I guarantee that once you get familiar with GitHub Actions...

Python S3 Multipart File Upload with Metadata and Progress Indicator

Recently I was working on implementation of a Python tool that uploads hundreds of large files to AWS S3.  The tool requirements are: Ability to upload very large filesSet metadata for each uploaded...