Apache Kafka
-
AWS open source newsletter #211
Jun 28, 2025 | 35 minute read
Edition #211 - June 2025 Welcome to issue #211 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. I was super humbled by AWS Hero Lee Gilmore earlier this month, who gave this newsletter a shoutout - thank you! (and make sure you check out his own newsletter, the Serverless Advocate Newsletter). Please please please take 1 minute to complete this short survey - feedback is a gift, and your gifts help keep this newsletter going in the right direction.
- oss-newsletter
- aws open source
- Apache Airflow
- MWAA
- Swift
- Amazon Q CLI
- Cedar
- GNOME
- Strands Agents
- Valkey
- CDK
- Pydantic
- Kyverno
- OPA Gatekeeper
- Karpenter
- Kubernetes
- Amazon EKS
- Apache Kafka
- Apache Iceberg
- Trino
- Apache Flink
- Amazon EMR
- Apache Spark
- HBase
- RocksDB
- OpenLineage
- dbt
- MySQL
- MariaDB
- PostgreSQL
- RabbitMQ
- AWS Amplify
- Tanstack
- Amazon Linux 2023
- .NET Aspire
- OpenSearch
- AWS Tools for PowerShell
- Prometheus
- Mountpoint for Amazon S3
- OpenZFS
- Powertools for AWS Lambda
- Red Hat Enterprise Linux
-
AWS open source newsletter #210
May 30, 2025 | 30 minute read
Edition #210 - May 2025 Welcome to issue #210 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. As always, this edition has more great new projects to check out, which include: a couple of projects for those of you looking for tools that can help you with cost optimisation, a new security threat modelling tool that uses the power of generative AI, an experimental Python SDK that offers async support, a nice UI testing tool (that will warm your spirits), and of course the now obligatory collection of MCP projects - that said, don’t miss those as I think you are going to love these, including some that have been contributed by a member of the AWS Community.
- oss-newsletter
- aws open source
- AWS Lambda Powertools
- MCP
- arctic
- Strands
- AWS CDK
- Apache Airflow
- MWAA
- Valkey
- KRO
- Kubernetes
- Amazon EKS
- Finch
- Spring
- Localstack
- Karpenter
- Apache Spark
- openCypher
- PostgreSQL
- MariaDB
- MySQL
- Apache Iceberg
- PyIceberg
- LangChain
- RabbitMQ
- AWS Amplify
- AWS Distro for OpenTelemetry
- Amazon Linux
- Prometheus
- Apache Kafka
- OpenSearch
- Slurm
- AWS Parallel Computing
- CrewAI
- Lustre
- AWS Neuron
- AWS Amplify
-
AWS open source newsletter #209
Apr 29, 2025 | 23 minute read
Edition #209 - April 2025 Welcome to issue #209 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I am publishing this from the AWS Summit London, and it has been great to speak to so many of the AWS community about open source - it is very much alive and thriving, so thank you all! As always, in this edition we have more great new projects to check out, which include a bumper selection of the current hot topic that is Model Context Protocol (MCP).
- oss-newsletter
- aws open source
- Ruby
- Apache Airflow
- MWAA
- Amazon EKS
- Kubernetes
- Bottlerocket
- Karpenter
- PostgreSQL
- Apache Iceberg
- Apache OFBiz
- Apache Flink
- Prometheus
- Grafana
- AWS Amplify
- Spring Boot
- LangChain
- Valkey
- LangGraph
- MLFlow
- AuthZen
- Amazon Corretto
- AWS CDK
- Apache Kafka
- memecachd
- AWS ParallelCluster
- Amazon Linux
- Swift
-
AWS open source newsletter #208
Mar 28, 2025 | 24 minute read
Edition #208 - March 2025 Welcome to issue #208 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include an experimental profiler for your serverless Java applications, a bunch of cool projects around Model Context Protocol (MCP), an interesting project around extracting insights from your observation data, projects to help you with your AWS storage services, an interesting project for those of you exploring chaos engineering, some nice generative AI projects that help you explore your code base, and to finish, the usual round up of demo projects which you should go check out.
-
AWS open source newsletter #207
Feb 28, 2025 | 25 minute read
Edition #207 - February 2025 Welcome to issue #207 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include real time analysis of your client calls to AWS APIs, a dashboard for all your AWS Health Events, an EBS analysis tool, a SIEM tool that allows you to query your AWS events, a really cool AI Coding Assistant powered by Amazon Bedrock, a really great demo of how to implement an MCP server, running WhispherX on AWS Lambda, and more!
- oss-newsletter
- aws open source
- kro
- AWS CDK
- OpenTelemetry
- Kubernetes
- Amazon EKS
- dstack
- GraphRAG
- FFMpeg
- ArgoCD
- Terragrunt
- OpenTofu
- Django
- PostgreSQL
- Apache Kafka
- Amazon Linux
- Apache Flink
- Apache Airflow
- MWAA
- Apache Spark
- MySQL
- Qonto
- Prometheus
- Amazon EMR
- Apache Iceberg
- OpenSearch
- Valkey
- AWS Amplify
- Lustre
- InfluxDB
- Cedar
- Aider
-
AWS open source newsletter #206
Jan 27, 2025 | 23 minute read
Edition #206 Happy New Year and welcome to issue #206 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As this is the first edition post re:Invent, you will find a lot of content showcasing all the new open source stuff that AWS has released, so there is plenty of really cool stuff to get stuck into - whether you are cloud native and want to know more about Amazon EKS Auto Mode, or more a data guru that is super excited about Apache Iceberg support in Amazon S3 Tables.
- oss-newsletter
- aws open source
- AWS CDK
- Cedar
- Swift
- Apache Iceberg
- Valkey
- Kubernetes
- Amazon EKS
- Karpenter
- OpenShift
- ROSA
- Bottlerocket
- TensorFlow
- Triton
- MySQL
- PostgreSQL
- MariaDB
- InfluxDB
- Apache Kafka
- Amazon EMR
- Apache Spark
- dbt
- OpenZFS
- AWS Amplify
- Grafana
- OpenSearch
- Apache ActiveMQ
- Powertools for AWS Lambda
- Backstage
- Apache Flink
- Prometheus
-
AWS open source newsletter #205
Nov 30, 2024 | 26 minute read
Welcome to issue #205 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This will be the last edition of 2024, but looking forward to coming back in 2025 with more great open source project and content. As always, we have more great new projects to check out, which include a project that simplifies how you manage complex Kubernetes resource configurations, a library to accelerate open source analytics using Amazon S3, a look at a GraphRAG project, a project that helps NodeJS developers make it easier to make use of some advanced Amazon Aurora capabilities, an ESLinting tool for AWS CDK, and more.
- oss-newsletter
- aws open source
- AWS CDK
- Amazon EKS
- Kubernetes
- Apache Iceberg
- Dapr
- Lustre
- kro
- Projen
- ComfyUI
- Finch
- Open Cybersecurity Schema Framework
- OCSF
- PostgreSQL
- Amazon EMR
- Apache Cassandra
- MySQL
- HBase
- AWS Amplify
- Apache XTable
- Mountpoint for Amazon S3
- Valkey
- Apache Airflow
- MWAA
- Bottlerocket
- Apache Kafka
- Apache Flink
-
AWS open source newsletter #204
Oct 22, 2024 | 25 minute read
Edition #204 Welcome to issue #204 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Apologies for the long wait since the last edition, I will have to do better. Thanks for the lovely messages and feedback I have received over the past few weeks, this edition is for you! As always, we have more great new projects to check out, which include projects that surface up your AWS costs in Home Assistant, a tool that you can use to ask questions about your code base that uses generative AI, a git large file storage (LFS) extension that lets you use Amazon S3, and a handy network cost calculator.
- oss-newsletter
- aws open source
- Home Assistant
- Godot
- Valkey
- Keycloak
- Apache Airflow
- MWAA
- PostgreSQL
- deequ
- Kubernetes
- ArgoCD
- OTEL
- Grafana
- Spring Boot
- Amazon Corretto
- ROSA
- OpenShift
- Kubecost
- Amazon Linux 2023
- Karpenter
- MySQL
- MariaDB
- Apache Flink
- Apache Kafka
- OpenZFS
- InfluxDB
- AWS Parallel Cluster
- Lustre
- Prometheus
- Finch
- Ubuntu
- Cedar
-
AWS open source newsletter #203
Aug 27, 2024 | 28 minute read
Welcome to the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition, #203. Projects to check out include: how you can proxy OpenAI requests through Amazon Bedrock, security tools that help you stay one step ahead of bad actors, a way of implementing CDK Pipelines in a less opinionated way, a tool that helps you validate your AWS IAM policies, a toolkit to help get you started with good practices when creating CloudFormation templates, some demo code that demonstrate how you can implement zero downtime updates to your applications, as well as some really cool demos and use cases of generative AI in action (too many to mention, so check them all out!
- oss-newsletter
- aws open source
- Langfuse
- Steampipe
- Ray
- Apache Spark
- AWS Amplify
- Flutter
- Valkey
- O3DE
- AWS CDK
- LangChain
- Kubernetes
- Amazon EKS
- Argo Workflows
- OpenTofu
- Bottlerocket
- Karpenter
- OpenTelemetry
- Apache Flink
- Apache Pinot
- Apache Kafka
- openCypher
- Apache Iceberg
- Apache Airflow
- MWAA
- MySQL
- PostgreSQL
- Deequ
- OCSF
- GraphStorm
- OpenShift
- Amazon EMR
- ActiveMQ
- Red Hat Enterprise Linux
- Cedar
-
AWS open source newsletter #202
Jul 22, 2024 | 20 minute read
Edition #202 Welcome to the AWS open source newsletter, issue #202. In this edition, I share more new projects (thank you for those of you that have sent them through) which include a project to help you monitor your data pipelines, the open sourced AWS Secrets Manager agent, a really cool new framework for managing multi generative AI agents, a couple of interesting projects to help manage your AWS accounts, a repo that provides CloudFormation snippets, and a few demo applications including one I put together that shows how you can use the Amazon Bedrock Converse API to summarise Hacker News comments.
- oss-newsletter
- aws open source
- PostgreSQL
- OpenSearch
- Cedar
- Kubernetes
- Amazon EKS
- OpenShift
- ROSA
- PHP
- Flyway
- LiteLLM
- GraphRAG
- Valkey
- Finch
- Dask
- Cilium
- Apache Kafka
- Grafana
- Prometheus
- AWS CDK
- Trusted Language Extensions for PostgreSQL
- MySQL
- MariaDB
- InfluxDB
- Apache Solr
- Apache Flink
- MLflow
- Notation
- Amazon Linux 2023
- RabbitMQ
-
AWS open source newsletter #201
Jul 10, 2024 | 28 minute read
Edition #201 Welcome to the AWS open source newsletter, issue #201, your trusted source for the very best open source on AWS content. This weeks new projects for you to practice your four freedoms include generative AI infused projects to help you generate your docs, streamline the setting up of your AWS resources, a new experimental framework for building document based workflows, and a cool demo that showcases how you can use generative AI to help translate American Sign Language.
- oss-newsletter
- aws open source
- PHP
- Apache Airflow
- MWAA
- Node.js
- LLRT
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- eksctl
- Valkey
- LangChain
- Project Lakechain
- AWS Amplify
- Itsio
- Apache Iceberg
- Apache Kafka
- Apache Cassandra
- PyTorch
- Apache httpd
- Babelfish for Aurora PostgreSQL
- Apache Flink
- PostgreSQL
- MySQL
- OpenSearch
- OpenZFS
- Amazon Linux
- FreeRTOS
- RabbitMQ
- AWS ParallelCluster
- Open Container Initiative
- Smithy
- Cedar
- sbt
-
AWS open source newsletter #200
Jun 24, 2024 | 20 minute read
Edition #200 Welcome to a milestone edition of this newsletter, number #200!! Wow, it feels like quite an achievement. Before diving into this newsletter, a big thank you for sticking with me. Time has flown by so quickly, and am looking forward to the next 100. As I have done in a few of the previous milestone issues, I wanted to share a few interesting stats from sharing open source projects with you over the past few years.
-
AWS open source newsletter #199
Jun 10, 2024 | 18 minute read
Edition #199 Welcome to issue #199 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I cannot believe that we are one issue away from a pretty significant milestone. I would love to hear from some of the regular readers of this newsletter to find any highlights they have had, or perhaps things they have found that have been pretty significant.
-
AWS open source newsletter #198
May 28, 2024 | 25 minute read
Edition #198 Welcome to issue #198 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. In this issue we feature new projects that provide integration of .NET Aspire with AWS resources, an automated data discovery tool to find data in your AWS environments, a tool to help incorporate good practices when building SaaS solutions, a cost allocation dashboard for your Kubernetes workloads, a project that might help you mitigate costs around Internet Gateway, and a few generative AI demos around food, news, and social media which you should definitely check out.
- oss-newsletter
- aws open source
- Aspire
- Kubernetes
- Amazon EKS
- Leapp
- OpenTelemetry
- AWS CDK
- llrt
- Valkey
- PostgreSQL
- InfluxDB
- High Performance Software Foundation
- Karpenter
- Multus
- Kata
- Grafana
- Prometheus
- Apache Flink
- Zingg
- Apache Hudi
- Apache Iceberg
- MySQL
- Apache Tomcat
- WordPress
- AWS Amplify
- Apache Airflow
- MWAA
- OpenSearch
- Apache Kafka
- Bottlerocket
- Amazon EMR
-
AWS open source newsletter #194
Apr 3, 2024 | 21 minute read
Edition #194 Welcome to issue #194 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Due to travelling and speaking commitments, regular readers will have noticed that I slipped up and missed a week. Normal service has been resumed, and as always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms.
-
AWS open source newsletter #193
Mar 18, 2024 | 16 minute read
Edition #193 Welcome to issue #193 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Sadly I will be missing the fun at KubeCon in Paris, but if you are attending, make sure to check out the AWS booth - I had a sneak peak at what you can expect, and there is going to be some great demos being shown, a lot of our open source folk will be there.
-
AWS open source newsletter #190
Feb 26, 2024 | 15 minute read
Edition #190 Welcome to issue #190 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that can help you keep on top of your cost optimisation, a tool to help you automate Well Architected reviews, a tool to help you map out your RDS instances, as well as sample projects and demos.
-
AWS open source newsletter #189
Feb 18, 2024 | 14 minute read
Edition #189 Welcome to issue #189 of the AWS open source newsletter, the newsletter where we search high and low to provide you with the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that help you find your RDS instances, automate tasks from your online Chime calls, a very nice visual file browser for your Amazon S3 buckets, a tool to help you track and manage copying files from your S3 storage buckets, an active-active multi region cluster solution for Redis, and more!
-
AWS open source newsletter #185
Jan 22, 2024 | 13 minute read
Edition #185 Welcome to issue #185 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that allow you to export your Partyrock applications, a tool to help you reduce hallucinations in your large language models, a new client for Redis, a tool to help you access the AWS Partner Network, as well as sample projects that look at how you can use large langue models to build a new reader and building pipelines using Cloudformation.
-
AWS open source newsletter #182
Dec 11, 2023 | 24 minute read
December 11th, 2023 - Instalment #182 Welcome to #182 of the AWS open source newsletter, the place for all your AWS and open source needs. This is a special re:Invent packed edition of this newsletter, attempting to catch up and cover all the main talking points, sessions, and announcements. Whilst there is a lot of content to go through, I know that many of you will still be wanting to know about new projects you can try out, and the good news is that we have plenty.
- oss-newsletter
- aws open source
- Redis
- Go
- MLFlow
- MySQL
- PostgreSQL
- MariaDB
- dbt
- OpenRewrite
- Amazon Corretto
- Amazon EMR
- lakeFS
- Apache Kafka
- Memecached
- Grafana
- GraphQL
- Code-OSS
- Rust
- Kotlin
- FreeRTOS
- Prometheus
- Kubernetes
- Amazon EKS
- OpenZFS
- OpenSearch
- AWS Distro for OpenTelemetry
- AWS CDK
- Powertools for Lambda
- Jupyter
- cdk8s
-
AWS open source newsletter #181
Nov 27, 2023 | 20 minute read
November 27th, 2023 - Instalment #181 Welcome to #181 of the AWS open source newsletter, the place for all your AWS and open source needs. As some of you will know, this is re:Invent week, where many of my colleagues and tens of thousands of developers will be congregating to learn about Cloud, and hopefully discover plenty of open source goodness too. If you are going, make sure to visit the open source booth in the Expo floor.
- oss-newsletter
- aws open source
- Griptape
- PyTorch
- AWS Amplify
- NextJS
- WordPress
- OpenJDK
- Amazon Corretto
- PostgreSQL
- OpenSearch
- SnapStart
- Kong
- AWS Copilot
- MySQL
- dbt
- Apache Hudi
- Apache Flink
- Kubernetes
- Amazon EKS
- Kali
- Karpenter
- Istio
- LangChain
- Pinecone
- Amazon EMR
- Apache Spark
- Prometheus
- Lustre
- OpenZFS
- Apache Kafka
- Lambda PowerTuning
-
AWS open source newsletter #180
Nov 20, 2023 | 20 minute read
November 20th, 2023 - Instalment #180 Welcome to #180 of the AWS open source newsletter, the place for all your AWS and open source needs. As we ramp up to re:Invent, it is good to see that pre:Invent is giving us plenty of open source goodies. In this weeks newsletter, we have some of those in the way of new projects such as res and aws-iatk, but we also have lots of really great content too.
- oss-newsletter
- aws open source
- Ragna
- ezsmdeploy
- SnapStart
- GraalVM
- Amazon Corretto
- Amazon EMR
- Apache Airflow
- LangChain
- AWS Copilot
- Karpenter
- MWAA
- Grafana
- Prometheus
- Amazon EKS
- Kubernetes
- Apache Flink
- Apache Kafka
- Avro
- Apache Cassandra
- Apache Spark
- Red Hat Linux
- Amazon Linux 2023
- NodeJS
- AWS Amplify
- Redis
- MySQL
- PostgreSQL
- eksctl
- MapLibre
- Overture Maps
-
AWS open source newsletter #177
Oct 30, 2023 | 19 minute read
October 30th, 2023 - Instalment #177 Welcome to #177 of the AWS open source newsletter, the Halloween special. You will find no tricks in this edition, only treats, with more new projects for you to check out and content that are a feast for your eyes. This weeks new projects include a tool to help you easily deploy vector databases on Kubernetes, an observability toolkit, a tool to help you benchmark network latency, as well as lots of new demos on generative AI.
- oss-newsletter
- aws open source
- Bottlerocket
- KubeArmor
- NGINX
- Wordpress
- Milvus
- Falcon-40B
- JupyterHub
- Dask
- Flux GitOps
- Crossplane
- Kubernetes
- Amazon EKS
- Babelfish for Aurora PostgreSQL
- PostgreSQL
- Linux
- Apache Hive
- Apache Spark
- Apache Kafka
- Apache Hudi
- Delta Lake
- Apache Iceberg
- OpenSearch
- Dremio
- OpenShift
- OpenCLIP
- Apache Airflow
- MWAA
- Amazon Corretto
- OpenJDK
- AWS CDK
-
AWS open source newsletter #175
Oct 16, 2023 | 25 minute read
October 16th, 2023 - Instalment #175 Welcome to #175 of the AWS open source newsletter, back after recharging in the wonderful countyside of Yorkshire. I am publishing this weeks newsletter from Raleigh, North Carolina. All Things Open is happening this week, and you will catch me at the AWS booth where I will be showing off some cool open source stuff (Cedar, Apache Airflow, and a few others), and I also have a talk on Tuesday.
- oss-newsletter
- aws open source
- Redis
- MariaDB
- and PostgreSQL
- Cloud Native Operational Excellence
- CNOE
- Crossplane
- Apache Airflow
- MWAA
- Apache Flink
- Amazon EMR
- Powertools for AWS Lambda
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- AWS Distributed OpenTelemetry(ADOT)
- Karpenter
- CoreDNS
- etcd
- Istio
- SUSE
- AWS-LC
- Spring Boot
- SOCI
- Apache Kafka
- Amazon Corretto
- AWS CDK
- Amazon Linux
- Bottlerocket
- cdk8s
- AWS Amplify
- Stable Diffusion
- NextJS
-
AWS open source newsletter #174
Sep 18, 2023 | 18 minute read
September 18th, 2023 - Instalment #174 Welcome to #174 of the AWS open source newsletter, which will be the last one for a couple of weeks as I take some time off to recharge. I will be back in early October with more open source goodness, but in the meantime, you still have this edition packed with open source goodness. This weeks new projects include a Rust tool to help you keep your CloudFormation stacks up to date, a tool to help upload files to Amazon S3, a generative AI tool that aims to help you review and detect IAM configuration issues, an updated JDBC driver for connecting to Amazon Aurora, and more.
-
AWS open source newsletter #173
Sep 11, 2023 | 22 minute read
September 11th, 2023 - Instalment #173 Welcome to #173 of the AWS open source newsletter, bringing you all the news and latest projects for AWS developers. This weeks new projects include a Golang based SDK for kernel eBPF operations, a project that helps you to optimise your network performance, a couple of projects for Apache Flink users, as well as a handful of different tools and demos featuring open source technologies helping to drive innovation in generative AI.
-
AWS open source newsletter #169
Aug 14, 2023 | 26 minute read
August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications.
- oss-newsletter
- aws open source
- OpenSearch
- AWS CDK
- Juypter AI
- dbt
- Apache Airflow
- Managed Workflows for Apache Airflow
- MWAA
- Cedar
- cfnguard
- Grafana
- Prometheus
- Apache Kafka
- Amazon Timestream
- Open Cybersecurity Schema Framework
- OCSF
- AWS Lambda Web Adapter
- Smithy
- Apache Spark
- Linux
- Amazon Linux
- AWS ParallelCluster
- PostgreSQL
- Spring Boot
- Amazon EKS
- Kubernetes
- Mountpoint for Amazon S3
- MySQL
- Lustre
- OpenZFS
- Redis
- Amazon EMR
- Karpenter
- Seekable OCI
- SOCI
- Firecracker
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #161
Jun 19, 2023 | 19 minute read
June 19th, 2023 - Instalment #161 Welcome to #161 of the AWS open source newsletter, and another week for fresh, new open source projects and code for you to practice your four freedoms. This weeks projects include tools that will help you create temporary elevated credentials, a new Java library that provides methods for encrypting and decrypting cryptographic materials, an AWS DynamoDB wrapper for Node/TypeScript developers, and a solution to help you find and visualise data assets.
- oss-newsletter
- aws open source
- Falcon
- AWS CDK
- Keycloak
- Cedar
- FreeRTOS
- Apache Airflow
- MWAA
- Apache Spark
- Amazon EMR
- Apache Hudi
- Apache Iceberg
- and Delta Lake
- Apache Flink
- OpenChatkit
- Kubernetes
- Pinniped
- Kubecost
- Karpenter
- ONNX
- Apache Kafka
- Babelfish for Aurora PostgreSQL
- AWS Amplify
- Next.js
- OpenSearch
- Flux
- ArgoCD
- KVM
-
AWS open source newsletter #160
Jun 12, 2023 | 17 minute read
June 12th, 2023 - Instalment #160 Welcome to #160 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you build data workflows, Terraform modules to help you incorporate temporary elevated access controls, integrating Tailscale to change your traffic flows, a neat AWS Lambda debugging tool, Go bindings for Cedar, and more.
-
AWS open source newsletter #157
May 22, 2023 | 19 minute read
May 22nd, 2023 - Instalment #157 Welcome Hello and welcome to the AWS open source newsletter, #157. Apologies for the lack of newsletter last week, but hopefully this week will make up for that as we have a bumper selection of great open source content for you. This weeks new projects include repos that help you get OpenEMR up and running (“host-openemr-on-aws-fargate”), two new security related open source projects that you definitely need to check out, (“cedar” and “snapchange”), integration of clickstream analytics using Swift (“clickstream-swift”), deployment of Backstage to serve up access to your AWS resources, (“app-development-for-backstage-io-on-aws”), a tool to help you clean up ecs tasks definitions (“aws-ecs-task-definition-cleanup”) and many more.
-
AWS open source newsletter #156
May 8, 2023 | 21 minute read
May 8th, 2023 - Instalment #156 Welcome Hello and welcome to the AWS open source newsletter, #156, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. So what do we have for you this week? Coming up later in this newsletter we have projects such as “sustainability-scanner” helps you check your Cloudformation templates against sustainability good practices, “synthtable” helps you create synthetic data for different use cases, “neptune-gremlin-client” a Java based Gremlin client, “s3zipper” a tool to quickly download entire S3 buckets, “chataws” a nice demo of how you can use ChatGPT to aid your AWS deployments, and plenty of other great projects.
-
AWS open source newsletter #155
Apr 29, 2023 | 20 minute read
May 1st, 2023 - Instalment #155 Welcome Hello and welcome to the AWS open source newsletter, #155, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. This week’s new projects include “aws-cloudformation-controller-for-flux” provides a way to use flux to orchestrate your CloudFormation deployments, “threat-composer” is a nice React based tool to help you create Threat Models for your systems and applications, “cdk-integ-tests-sample” a tool to allow you to do integration tests with your CDK stacks (these three were all featured in the latest episode of Build on Open Source, you can watch it here), “iam-access-key-report” generates reports from your AWS accounts about your AWS access keys, “personalize-kafka-connector” provides an integration into Apache Kafka for this AWS service, and more!
-
AWS open source newsletter #153
Apr 17, 2023 | 19 minute read
April 17th, 2023 - Instalment #153 Welcome Hello and welcome to the AWS open source newsletter, #153 as featured in the latest episode of Build on Open Source (S2E5) . We have lots of great projects for you this week, with a strong chatGPT influence. “pg_gpt”, “cw-logs-insights-gpt”, and “aiws” all integrate chatGPT to help you do different things on AWS, “semantic-search-aws-docs” is a very interesting demo on how to build a more coherent search for your documentation, “aws-chime-chat-demo” a very nice demo using the Chime SDK, “ckia” is an open source AWS Trusted Advisor tool, “AWS_ED” helps you keep your local IP in sync with external DNS records, “cfnctl” provides a Terraform like cli experience to CloudFormation, and more!
-
AWS open source newsletter #149
Mar 19, 2023 | 14 minute read
March 20th, 2023 - Instalment #149 Welcome Hello and welcome to edition #149 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. I hope some of you were able to catch this episode reviewed on our last Build on Open Source livestream. If not, you can catch the replay here. This week we have projects such “mountpoint-s3”, “s3-access-for-squash”, and “amazon-s3-tar-tool” which provide some useful tools for managing your files on S3, “aws-serverless-ai-stories” a creative masterclass in storytelling, “earthquake-notifier” a serverless solution to keep you alerted and ready, and more!
-
AWS open source newsletter #148
Mar 12, 2023 | 17 minute read
March 13th, 2023 - Instalment #148 Welcome Hello and a warm welcome to edition #148 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. This week we have projects such as “iam-ape” a tool to help you grapple with your IAM policies, “amazon-emr-cli” a nice command line tool to package and deploy your Spark jobs on Amazon EMR, “duckdb-athena-extension” that helps you import data from Amazon Athena into DuckDB, “terraform-aws-email-files-dropped-in-s3” a helpful tool to easily email you attachments automatically, “cloud-queue-for-quantum-devices” a tool to help Quantum researchers across the world, “aws-private-ca-matter-infrastructure” a sample reference architecture for setting up a secure, private certificate authority, “aws-sam-cli-java-examples” will help you deploy your Java apps via AWS SAM, “mpartman” a PostgreSQL partition manager, “aws-do-pcluster” simplifying how to run AWS ParallelCluster, “staticwebsite-cli” a very nice too to help you easily deploy static web sites, and more!
-
AWS open source newsletter #147
Mar 6, 2023 | 14 minute read
March 6th, 2023 - Instalment #147 Welcome Welcome to edition #147 of the AWS open source newsletter, featured in the latest episode of Build on Open Source. This week we have new projects such as “metahub” and “savings-estimator” that we looked at in closer detail on the Build on Open Source livestream, “aws-iot-core-credential-provider-session-helper” a Python library to help simplify working with AWS IoT, “traffic-inspection-architectures-aws-cloud-wan” code that provides examples of different network architectures and how to do traffic inspection, “neptune-export” a tool to help you export your data in Amazon Neptune, “aws-organizations-tool” a command line tool to help you configure AWS Organisations, “sagemaker-external-repo-access” a nice reference architecture for Amazon Sagemaker, “aws-cdk-cfn-hook” a Python CDK app that will get you up and running quickly working with Cloudformation template hooks, and more!
- oss-newsletter
- aws open source
- Kubernetes
- OpenSearch
- Ubuntu
- Vault
- FreeRTOS
- AWS SAM
- MySQL
- MariaDB
- PostgreSQL
- AWS Lambda Powertools
- Debezium
- Apache Kafka
- Kafka Connect
- Apache Spark
- Apache Hudi
- DeltaStreamer
- Apicurio Registry
- Apache Iceberg
- FFMpeg
- Prometheus
- Babelfish for Amazon Aurora PostgreSQL
- Redis
- Mastadon
- Amazon EMR
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #140
Jan 9, 2023 | 19 minute read
January 9th, 2023 - Instalment #140 Welcome Happy New Year and welcome to the first AWS open source newsletter of 2023, edition #140. If you have not already checked it out, I put together a short retrospective summary of 2022 in the post, AWS open source newsletter - 2022 in review. There are some interesting facts and figures in there. I am also taking time to collect feedback from readers to help shape where this newsletter goes in 2023.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- Next.js
- AWS SDK for Java
- AWS ParallelCluster
- Docker
- MariaDB
- Amazon EKS
- Kubernetes
- MQTT
- ArgoCD
- AWS Distro for OpenTelemetry
- Prometheus
- DAMON
- Crossplane
- Log4Shell
- .NET
- Apache Spark
- Apache Kafka
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache NiFi
- Delta Lake
- OpenShift
- Redis
- Red Hat Enterprise Linux
- SUSE Linux Enterprise Server
- Ubuntu Pro
- AWS Copilot
- RabbitMQ
- Apache Airflow
- Rust
- Terraform
- Amazon EMR
- Apache ShardingSphere-Proxy
-
AWS open source news and updates #138
Dec 12, 2022 | 24 minute read
December 12th, 2022 - Instalment #138 Welcome Welcome to the AWS open source newsletter, edition #138. After a week off due to re:Invent, this edition is packed with content on many of the open source related announcements. As always, we have a great line up of new projects for you to practice your four freedoms on. In no particular order, we have projects like “eks-node-viewer”, a nice visualisation tool for your Amazon EKS clusters, “pg_tle” a great new project to make your PostgreSQL environments safer, “dyna53” a fun project that finally turns Amazon Route 53 into a database, “dynamodb-mass-migrations” a tool to help you migrate to Amazon DynamoDB, “visual-asset-management-system” a very nice digital asset management tool, “fast-differential-privacy” implement differential privacy in your PyTorch models, “migration-hadoop-to-emr-tco-simulator” a handy total cost of ownership calculator for Amazon EMR, “realtime-toxicity-detection” a tool to help you stay on top of your online communities, “functionclarity” a very cool tool to check the integrity of your serverless functions before executing, and many more.
- oss-newsletter
- aws open source
- Rez
- Terraform
- PostgreSQL
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Amazon EMR
- Apache Iceberg
- Apache Spark
- OpenZFS
- Ray
- MySQL
- Kubernetes
- Apache Kafka
- Open Invention Network
- AWS IoT Greengrass
- Ray
- Modin
- Amazon Corretto
- Firecracker
- DeeQu
- Open Cybersecurity Schema Framework
- ocsf
- AWS SDK for pandas
- Amazon Braket
- Yocto
- Log4shell
- MQTT
- Redis
- AWS CDK
- AWS Amplify
-
AWS open source news and updates #137
Nov 25, 2022 | 30 minute read
November 25th, 2022 - Instalment #137 Welcome Welcome to the AWS open source newsletter, edition #137. As it is re:Invent next week, I will be publishing the newsletter early as I am heading out on Monday. I will be in Las Vegas talking with open source Builders, hanging out on the Open Source Kiosk in the AWS Village, and doing some talks. If you are coming, I would love to meet some of you, so get in touch.
- oss-newsletter
- aws open source
- re:Invent
- GraphQL
- Grafana
- Prometheus
- AWS Toolkits for JetBrains
- AWS Toolkits for VS Code
- AWS Amplify
- NodeJS
- MariaDB
- PostgreSQL
- Flutter
- React
- Apache Iceberg
- Apache Airflow
- Apache Flink
- Apache ShardingSphere
- AutoGluon
- AWS ParallelCluster
- Kubeflow
- NGINX
- Finch
- Amazon EMR
- Trino
- Apache Hudi
- O3DE
- Apache Kafka
- OpenSearch
- MLFlow
-
AWS open source news and updates #136
Nov 21, 2022 | 20 minute read
November 21st, 2022 - Instalment #136 Welcome Welcome to the AWS open source newsletter, edition #136, as featured on the latest episode of Build on Open Source. This week we feature new projects including “dynamoit” a JavaFX gui for Amazon DynamoDB, “building-apache-kafka-connectors”, “msk-config-providers”, and “msk-serverless-data-pipeline” projects to help make your life easier when working with Apache Kafka, “stowrs-to-s3” a tool for working with STOWRS data on AWS, “aws-device-lobby” a tool to make onboarding devices into AWS IoT Core easier, “aws-graviton-run-confidential-ml-workloads-using-nitro-enclaves” a nice example of how you can do Confidential Computing for machine learning use cases, “aws-hpc-builder” a tool to help you manage your open source HPC tools, and many more.
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #133
Oct 28, 2022 | 18 minute read
October 28th, 2022 - Instalment #133 Welcome Welcome to the AWS open source newsletter, edition #133. This week has been all about KubeCon, and there were some important announcements from AWS. If you missed these, I have tried to capture the important ones here, but I want to start off with probably my favourite which was the announcement during Nate Taber keynote on some of the investments we are providing to CNCF and OpenSSF.
-
AWS open source news and updates #131
Oct 17, 2022 | 17 minute read
October 17th, 2022 - Instalment #131 Welcome to the AWS open source newsletter, edition #131. This week’s new projects include “metahub”, a command line way to interact with AWS Security Hub, “somod” a framework for creating micro applications in serverless, “terraform-aws-guardduty-multiaccount” a Terraform module to help you automate your AWS Guard Duty configuration, “aws-glue-cdk-cicd” a sample project to automate the creation data pipelines using AWS Glue, “go-kafka-event-source” an Apache Kafka client in Go, “project-tools” a tool to help you get insights from your GitHub repo, “eks-event-watcher” a command line tool to tail your Amazon EKS logs, “listmonk-based-edm-solution” an example of how to deploy this open source mailing list tool, and many more.
-
AWS open source news and updates #130
Oct 10, 2022 | 17 minute read
October 10th, 2022 - Instalment #130 Welcome Welcome to the AWS open source newsletter, edition #130. This newsletter was featured in the Build on Open Source episode four, which you can check out here if you missed it. New projects for you to practice your open source four freedoms this week include “grucloud” a new infrastructure as code tool with some nice features, “stepfunctions-sdk-autocomplete” a VSCode plugin for all you AWS Step Functions fans, “AWS_Billing_Overage_Shutdown” a very new repo that has some code to help you automate shutting down resources on alerts, “aws-secrets-manager-github-action” if you are using GitHub Actions, this one is for you, “meta-aws”, tools and recipes for those using and building with Yocto, “data-on-eks” a number of sample solutions to configure self managed open source data analytics tools, “cql-replicator” a tool to help you migrate from self managed Apache Cassandra to Amazon Keyspaces, “ec2-imagebuilder-ami-lifecycle” provides some new capabilities for those building AMIs, and many more.
-
AWS open source news and updates #122
Jul 29, 2022 | 14 minute read
July 29th, 2022 - Instalment #122 Welcome Welcome back to my regular readers and hello to new readers, I hope you will enjoy and come back again to the AWS open source newsletter episode #122. This week we have another great collection of community and AWS related open source tools, demos and samples for you to practice your open source four freedoms. “rds_auto_encrypt” helps you encrypt your Amazon RDS databases, “middy-profiler” is an interesting looking tool to help you understand performance characteristics of your AWS Lambda functions, “simpleiot” is a very nice looking IoT framework to help simplify how you can onboard devices into AWS IoT, “aws-secrets-manager-hybrid-secret-replication-from-hashicorp-vault” (bit of a mouthful to say that one) helps you synchronise your secrets across different secret providers, “automated-forensic-orchestrator-for-amazon-ec2” is a very nice reference solution for automating some of your operational security activities, and we have several other projects for you to dive deep into.
-
AWS open source news and updates #121
Jul 22, 2022 | 15 minute read
July 22nd, 2022 - Instalment #121 Welcome to regular and new readers alike, to the AWS open source newsletter episode #121. Am super excited about this weeks new projects, including a number of AWS CDK related projects so if you are a fan of AWS CDK then make sure you check them all out. We feature projects such as “openrolesanywhere”, a proof of concept client for the recently released AWS IAM Roles Anywhere, “amazon-redshift-odbc-driver” an open source ODBC driver for Amazon Redshift, “spot-interruption-simulation” a very handy tool to help you test and simulate spot interuptions for your EC2 workloads, “magento-ecs-cdk” a quick way to deploy a scalable Magento environment, “using-rekognition-to-detect-sounds” a very interesting project that will help you hear sounds from your pictures (yes, you did not read that wrong!
-
AWS open source news and updates #113
May 20, 2022 | 15 minute read
May 13th, 2022 - Instalment #113 Newsletter #113. A little later than usual this week thanks to KubeCon, #113 of the AWS open source newsletter provides you with yet more new open source projects. “aws-iam-utils” is a Python library to help you work with IAM, “iot-app-kit” is a new IoT visualisation framework, “s3pathlib-project” that provides the Pythonic objective oriented programming (OOP) interface to manipulate AWS S3 object / directory, “collaboration-chambers-on-aws” which is a cool and very comprehensive project to help you do Scale-Out Computing on AWS, and many more!
-
AWS open source news and updates #107
Apr 4, 2022 | 17 minute read
April 4th, 2022 - Instalment #107 Newsletter #107. Welcome to edition #107 of the AWS open source newsletter, and we have a bumper edition this week packed with more great new open source projects and content for you to consume. Topics featured this week include optimising open source big data tools, developer tooling, case studies and we even some some great open source content for .NET core developers. This weeks projects include a really nice handy browser plugin called “aws-search-extension”, that lets you search and find developer information from the AWS docs, a tool that will help you detect whether you have configured or using dockershim in your Kubernetes clusters, a library to help you integrate Amazon Cognito in your Laravel PHP applications, and plenty more developer tools and sample projects.
-
AWS open source news and updates #105
Mar 20, 2022 | 15 minute read
March 21st, 2022 - Instalment #105 Newsletter #105. Welcome to edition #105 of the AWS open source news and updates, where we bring you the latest open source projects, posts, events, and much more. This weeks new projects include the latest work in progress from AWS Hero Ian Mckay, “iamfast” is an AWS IAM policy generation tool that is in early stages but promises to be very useful indeed. “iasql-engine” is a tool that models cloud infrastructure as data, “ssm-patch-portal” provides a nice gui front end to simplify patching with AWS System Manager, a new crowdsource guide that contains learning resources for AWS, a business intelligence platform built using open source technologies from the NHS, and many more.
-
AWS open source news and updates #103
Mar 7, 2022 | 15 minute read
March 7th, 2022 - Instalment #103 Newsletter #103. Welcome to edition #103 of the AWS open source news and updates. This weeks featured new open source projects include botocove (a decorator that helps you run your functions across your AWS accounts easily), functionless (a TypeScript plugin that transforms TypeScript code into Service-to-Service integrations), replibyte (a tool to replicate your PostgreSQL data), aws-security-bulletin-alert (notifies you of new AWS Security Bulletins) and sends out E-Mail notifications via Amazon SES), and many more.
-
AWS open source news and updates #99
Feb 7, 2022 | 12 minute read
Feb 7th, 2022 - Instalment #99 Newsletter #99. While Nena gave you 99 red balloons, I give you the latest version of the AWS open source news letter. This week we feature more great new open source projects including a project to help you with drift detection in your CloudFormation stacks, new Terraform modules, an open-source prometheus exporter, some AWS CDK resources and sample projects and more. This weeks AWS and Community posts cover PostgreSQL, Apache Airflow, AWS CDK, Redis, GraphQL, Apollo GraphQL, Kubernetes, AWS EKS and more.