Apache Iceberg
-
AWS open source newsletter #211
Jun 28, 2025 | 35 minute read
Edition #211 - June 2025 Welcome to issue #211 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. I was super humbled by AWS Hero Lee Gilmore earlier this month, who gave this newsletter a shoutout - thank you! (and make sure you check out his own newsletter, the Serverless Advocate Newsletter). Please please please take 1 minute to complete this short survey - feedback is a gift, and your gifts help keep this newsletter going in the right direction.
- oss-newsletter
- aws open source
- Apache Airflow
- MWAA
- Swift
- Amazon Q CLI
- Cedar
- GNOME
- Strands Agents
- Valkey
- CDK
- Pydantic
- Kyverno
- OPA Gatekeeper
- Karpenter
- Kubernetes
- Amazon EKS
- Apache Kafka
- Apache Iceberg
- Trino
- Apache Flink
- Amazon EMR
- Apache Spark
- HBase
- RocksDB
- OpenLineage
- dbt
- MySQL
- MariaDB
- PostgreSQL
- RabbitMQ
- AWS Amplify
- Tanstack
- Amazon Linux 2023
- .NET Aspire
- OpenSearch
- AWS Tools for PowerShell
- Prometheus
- Mountpoint for Amazon S3
- OpenZFS
- Powertools for AWS Lambda
- Red Hat Enterprise Linux
-
AWS open source newsletter #210
May 30, 2025 | 30 minute read
Edition #210 - May 2025 Welcome to issue #210 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. As always, this edition has more great new projects to check out, which include: a couple of projects for those of you looking for tools that can help you with cost optimisation, a new security threat modelling tool that uses the power of generative AI, an experimental Python SDK that offers async support, a nice UI testing tool (that will warm your spirits), and of course the now obligatory collection of MCP projects - that said, don’t miss those as I think you are going to love these, including some that have been contributed by a member of the AWS Community.
- oss-newsletter
- aws open source
- AWS Lambda Powertools
- MCP
- arctic
- Strands
- AWS CDK
- Apache Airflow
- MWAA
- Valkey
- KRO
- Kubernetes
- Amazon EKS
- Finch
- Spring
- Localstack
- Karpenter
- Apache Spark
- openCypher
- PostgreSQL
- MariaDB
- MySQL
- Apache Iceberg
- PyIceberg
- LangChain
- RabbitMQ
- AWS Amplify
- AWS Distro for OpenTelemetry
- Amazon Linux
- Prometheus
- Apache Kafka
- OpenSearch
- Slurm
- AWS Parallel Computing
- CrewAI
- Lustre
- AWS Neuron
- AWS Amplify
-
AWS open source newsletter #209
Apr 29, 2025 | 23 minute read
Edition #209 - April 2025 Welcome to issue #209 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I am publishing this from the AWS Summit London, and it has been great to speak to so many of the AWS community about open source - it is very much alive and thriving, so thank you all! As always, in this edition we have more great new projects to check out, which include a bumper selection of the current hot topic that is Model Context Protocol (MCP).
- oss-newsletter
- aws open source
- Ruby
- Apache Airflow
- MWAA
- Amazon EKS
- Kubernetes
- Bottlerocket
- Karpenter
- PostgreSQL
- Apache Iceberg
- Apache OFBiz
- Apache Flink
- Prometheus
- Grafana
- AWS Amplify
- Spring Boot
- LangChain
- Valkey
- LangGraph
- MLFlow
- AuthZen
- Amazon Corretto
- AWS CDK
- Apache Kafka
- memecachd
- AWS ParallelCluster
- Amazon Linux
- Swift
-
AWS open source newsletter #208
Mar 28, 2025 | 24 minute read
Edition #208 - March 2025 Welcome to issue #208 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include an experimental profiler for your serverless Java applications, a bunch of cool projects around Model Context Protocol (MCP), an interesting project around extracting insights from your observation data, projects to help you with your AWS storage services, an interesting project for those of you exploring chaos engineering, some nice generative AI projects that help you explore your code base, and to finish, the usual round up of demo projects which you should go check out.
-
AWS open source newsletter #207
Feb 28, 2025 | 25 minute read
Edition #207 - February 2025 Welcome to issue #207 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include real time analysis of your client calls to AWS APIs, a dashboard for all your AWS Health Events, an EBS analysis tool, a SIEM tool that allows you to query your AWS events, a really cool AI Coding Assistant powered by Amazon Bedrock, a really great demo of how to implement an MCP server, running WhispherX on AWS Lambda, and more!
- oss-newsletter
- aws open source
- kro
- AWS CDK
- OpenTelemetry
- Kubernetes
- Amazon EKS
- dstack
- GraphRAG
- FFMpeg
- ArgoCD
- Terragrunt
- OpenTofu
- Django
- PostgreSQL
- Apache Kafka
- Amazon Linux
- Apache Flink
- Apache Airflow
- MWAA
- Apache Spark
- MySQL
- Qonto
- Prometheus
- Amazon EMR
- Apache Iceberg
- OpenSearch
- Valkey
- AWS Amplify
- Lustre
- InfluxDB
- Cedar
- Aider
-
AWS open source newsletter #206
Jan 27, 2025 | 23 minute read
Edition #206 Happy New Year and welcome to issue #206 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As this is the first edition post re:Invent, you will find a lot of content showcasing all the new open source stuff that AWS has released, so there is plenty of really cool stuff to get stuck into - whether you are cloud native and want to know more about Amazon EKS Auto Mode, or more a data guru that is super excited about Apache Iceberg support in Amazon S3 Tables.
- oss-newsletter
- aws open source
- AWS CDK
- Cedar
- Swift
- Apache Iceberg
- Valkey
- Kubernetes
- Amazon EKS
- Karpenter
- OpenShift
- ROSA
- Bottlerocket
- TensorFlow
- Triton
- MySQL
- PostgreSQL
- MariaDB
- InfluxDB
- Apache Kafka
- Amazon EMR
- Apache Spark
- dbt
- OpenZFS
- AWS Amplify
- Grafana
- OpenSearch
- Apache ActiveMQ
- Powertools for AWS Lambda
- Backstage
- Apache Flink
- Prometheus
-
AWS open source newsletter #205
Nov 30, 2024 | 26 minute read
Welcome to issue #205 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This will be the last edition of 2024, but looking forward to coming back in 2025 with more great open source project and content. As always, we have more great new projects to check out, which include a project that simplifies how you manage complex Kubernetes resource configurations, a library to accelerate open source analytics using Amazon S3, a look at a GraphRAG project, a project that helps NodeJS developers make it easier to make use of some advanced Amazon Aurora capabilities, an ESLinting tool for AWS CDK, and more.
- oss-newsletter
- aws open source
- AWS CDK
- Amazon EKS
- Kubernetes
- Apache Iceberg
- Dapr
- Lustre
- kro
- Projen
- ComfyUI
- Finch
- Open Cybersecurity Schema Framework
- OCSF
- PostgreSQL
- Amazon EMR
- Apache Cassandra
- MySQL
- HBase
- AWS Amplify
- Apache XTable
- Mountpoint for Amazon S3
- Valkey
- Apache Airflow
- MWAA
- Bottlerocket
- Apache Kafka
- Apache Flink
-
AWS open source newsletter #203
Aug 27, 2024 | 28 minute read
Welcome to the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition, #203. Projects to check out include: how you can proxy OpenAI requests through Amazon Bedrock, security tools that help you stay one step ahead of bad actors, a way of implementing CDK Pipelines in a less opinionated way, a tool that helps you validate your AWS IAM policies, a toolkit to help get you started with good practices when creating CloudFormation templates, some demo code that demonstrate how you can implement zero downtime updates to your applications, as well as some really cool demos and use cases of generative AI in action (too many to mention, so check them all out!
- oss-newsletter
- aws open source
- Langfuse
- Steampipe
- Ray
- Apache Spark
- AWS Amplify
- Flutter
- Valkey
- O3DE
- AWS CDK
- LangChain
- Kubernetes
- Amazon EKS
- Argo Workflows
- OpenTofu
- Bottlerocket
- Karpenter
- OpenTelemetry
- Apache Flink
- Apache Pinot
- Apache Kafka
- openCypher
- Apache Iceberg
- Apache Airflow
- MWAA
- MySQL
- PostgreSQL
- Deequ
- OCSF
- GraphStorm
- OpenShift
- Amazon EMR
- ActiveMQ
- Red Hat Enterprise Linux
- Cedar
-
AWS open source newsletter #201
Jul 10, 2024 | 28 minute read
Edition #201 Welcome to the AWS open source newsletter, issue #201, your trusted source for the very best open source on AWS content. This weeks new projects for you to practice your four freedoms include generative AI infused projects to help you generate your docs, streamline the setting up of your AWS resources, a new experimental framework for building document based workflows, and a cool demo that showcases how you can use generative AI to help translate American Sign Language.
- oss-newsletter
- aws open source
- PHP
- Apache Airflow
- MWAA
- Node.js
- LLRT
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- eksctl
- Valkey
- LangChain
- Project Lakechain
- AWS Amplify
- Itsio
- Apache Iceberg
- Apache Kafka
- Apache Cassandra
- PyTorch
- Apache httpd
- Babelfish for Aurora PostgreSQL
- Apache Flink
- PostgreSQL
- MySQL
- OpenSearch
- OpenZFS
- Amazon Linux
- FreeRTOS
- RabbitMQ
- AWS ParallelCluster
- Open Container Initiative
- Smithy
- Cedar
- sbt
-
AWS open source newsletter #198
May 28, 2024 | 25 minute read
Edition #198 Welcome to issue #198 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. In this issue we feature new projects that provide integration of .NET Aspire with AWS resources, an automated data discovery tool to find data in your AWS environments, a tool to help incorporate good practices when building SaaS solutions, a cost allocation dashboard for your Kubernetes workloads, a project that might help you mitigate costs around Internet Gateway, and a few generative AI demos around food, news, and social media which you should definitely check out.
- oss-newsletter
- aws open source
- Aspire
- Kubernetes
- Amazon EKS
- Leapp
- OpenTelemetry
- AWS CDK
- llrt
- Valkey
- PostgreSQL
- InfluxDB
- High Performance Software Foundation
- Karpenter
- Multus
- Kata
- Grafana
- Prometheus
- Apache Flink
- Zingg
- Apache Hudi
- Apache Iceberg
- MySQL
- Apache Tomcat
- WordPress
- AWS Amplify
- Apache Airflow
- MWAA
- OpenSearch
- Apache Kafka
- Bottlerocket
- Amazon EMR
-
AWS open source newsletter #195
Apr 15, 2024 | 21 minute read
Edition #195 Welcome to issue #195 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This week I am heading out to Everything Open, and looking forward to meeting the community in Gladstone. I will be talking about Cedar, and showing why it is important and how it works (demo is working lovely now). I am now on the third week of my open source roadshow, which is why I have had to change the publishing of this newsletter to every other week - at least until I get back home.
-
AWS open source newsletter #186
Jan 29, 2024 | 16 minute read
Edition #186 Welcome to issue #186 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have dashboards to help you cut through the noise when reviewing security information, a synthetic data generator that leverages generative AI, a tool to help you mask data from production so you can use it in development and testing, a solution to help you run VSCode on EC2, a tool to help you wipe your S3 Glacier data vaults, and an assortment of generative AI demos for you to try out.
-
AWS open source newsletter #184
Jan 15, 2024 | 17 minute read
Edition #184 Welcome to issue #184 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have a rust based cli tools to help you accelerate your S3 searches, we take a look at a new framework to help simplify bootstrapping your projects, a tool to help you report on your AWS resource tags, a voice translator for Chime, a really nice sample project to help you get hands on with Cedar, a number of generative AI demos and sample projects that are a must, and many more projects.
-
AWS open source newsletter #178
Nov 6, 2023 | 19 minute read
November 6th, 2023 - Instalment #178 Welcome to #178 of the AWS open source newsletter, the place for all your AWS and open source needs. This week we feature more new open source projects for you to practice your four freedoms. We have a useful tool that helps you synchronise your AWS Identity Centre users with the users you provision in your Amazon RDS databases, we share the AWS data solutions framework that helps you build data solutions following opinionated best practices, a resource explorer for your AWS accounts, a guardrails solution for your AWS account, and a couple of demo repositories that take a look at Localstack and RSS.
-
AWS open source newsletter #177
Oct 30, 2023 | 19 minute read
October 30th, 2023 - Instalment #177 Welcome to #177 of the AWS open source newsletter, the Halloween special. You will find no tricks in this edition, only treats, with more new projects for you to check out and content that are a feast for your eyes. This weeks new projects include a tool to help you easily deploy vector databases on Kubernetes, an observability toolkit, a tool to help you benchmark network latency, as well as lots of new demos on generative AI.
- oss-newsletter
- aws open source
- Bottlerocket
- KubeArmor
- NGINX
- Wordpress
- Milvus
- Falcon-40B
- JupyterHub
- Dask
- Flux GitOps
- Crossplane
- Kubernetes
- Amazon EKS
- Babelfish for Aurora PostgreSQL
- PostgreSQL
- Linux
- Apache Hive
- Apache Spark
- Apache Kafka
- Apache Hudi
- Delta Lake
- Apache Iceberg
- OpenSearch
- Dremio
- OpenShift
- OpenCLIP
- Apache Airflow
- MWAA
- Amazon Corretto
- OpenJDK
- AWS CDK
-
AWS open source newsletter #176
Oct 23, 2023 | 19 minute read
October 23rd, 2023 - Instalment #176 Welcome to #176 of the AWS open source newsletter, heading into Autumn and getting ready for the clocks to go back later in the week. How will you use that extra hour? Well, perhaps some of you might use it to check out this weeks new projects, which include a nice cli chat tool that uses Amazon Bedrock, a tool to help simplify deploying VSCode in the Cloud environments, and sample demos and code on chaos engineering, deploying Amazon Bedrock via AWS Lambda, and how you can use IAM Roles Anywhere to authenticate against external identity providers.
- oss-newsletter
- aws open source
- LangChain
- Trivy
- AWS CDK
- Apache Spark
- Pinecone
- Redis
- Postgres
- pgVector
- OpenSearch
- ClickHouse
- Chroma
- Apache Iceberg
- CfnGuard
- Kubernetes
- Amazon EKS
- Karpenter
- Kubecost
- Amazon Corretto
- NextJS
- AWS Amplify
- GraphQL
- Ray
- AWS Distro for OpenTelemetry
- Grafana
- Core WCF
- AWS SAM
- Amazon EMR on EKS
- RabbitMQ
- Swift
-
AWS open source newsletter #173
Sep 11, 2023 | 22 minute read
September 11th, 2023 - Instalment #173 Welcome to #173 of the AWS open source newsletter, bringing you all the news and latest projects for AWS developers. This weeks new projects include a Golang based SDK for kernel eBPF operations, a project that helps you to optimise your network performance, a couple of projects for Apache Flink users, as well as a handful of different tools and demos featuring open source technologies helping to drive innovation in generative AI.
-
AWS open source newsletter #170
Aug 21, 2023 | 21 minute read
August 21st, 2023 - Instalment #170 Welcome to edition #170 of the AWS open source newsletter, an oasis of open source goodness that features the latest new projects, essential reading, and must view videos to quench the thirst of every open source developer. This weeks edition we have new projects that help you get on top of your IAM actions, a handy tool for knowing what your current AWS account service limits are from the command line, a tool to help you do database migrations, and some interesting and very detailed reference solutions for gaming, live streaming, and managing/exporting of your Amazon Cognito profiles.
- oss-newsletter
- aws open source
- AWS-LC
- Threat Composer
- AWS CDK
- AWS SAM
- AWS SDK for Java
- GitLab
- GraphQL
- AWS AppSync
- AWS Distro for OpenTelemetry (ADOT)
- PostgreSQL
- Apache Airflow
- SBOM
- Syft
- Apache Hudi
- Apache Iceberg
- Apache Spark
- collectd
- Grafana
- O3DE
- ROS
- Next.js
- PostgreSQL
- OpenZFS
- MWAA
- Cedar
- Powertools for Lambda
-
AWS open source newsletter #168
Aug 7, 2023 | 24 minute read
August 7th, 2023 - Instalment #168 Welcome to #168 of the AWS open source newsletter, the only newsletter that features the freshest open source and AWS content* New projects for you to feast on in this issue include the obligatory projects that look at how Generative AI can help developers be more productive, in this case by making documentation more relevant and easier to find and to help with code reviews, a nice tool to help you query your AWS Identity Access Management (IAM) policies, and a security focused tool to help you search for potentially incorrect configured S3 buckets.
-
AWS open source newsletter #167
Jul 31, 2023 | 22 minute read
July 31st, 2023 - Instalment #167 Welcome to #167 of the AWS open source newsletter, and another edition packed with new open source projects for you to explore. Whether you are new to this newsletter, or returning (we thank you!) there is something for you. This week we have projects that will help use Terraform to deploy your monolith applications, a tool to accelerate your GraphQL building when working with Amazon DynamoDB, a project that will help you introduce chaos without changes to your code, and a couple of really nice demos of using generative AI that allows you to use natural language to query your data.
- oss-newsletter
- aws open source
- Terraform
- Rust
- LangChain
- Streamlit
- PostgreSQL
- Supabase
- OpenSearch
- AWS SAM
- AWS CDK
- Powertools for AWS Lambda
- Open Application Model
- OAM
- Traefik
- Keycloak
- FastAPI
- PyTorch
- MySQL
- IAM Roles Anywhere
- Apache Iceberg
- MQTT
- Amazon EMR
- Kubernetes
- Amazon EKS
- Apache Hudi
- Go
- Cedar
- RabbitMQ
- Pacu
-
AWS open source newsletter #166
Jul 24, 2023 | 22 minute read
July 24th, 2023 - Instalment #166 Welcome to #166 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks new projects include a library to help you managed and validate your environment variables when working with AWS Lambda, a new Rust based tool for interacting with your S3 buckets, an essential tool to help CDK developers remove a lot of the setup work, and a tool that helps you run Yocto embedded Linux build jobs in AWS.
-
AWS open source newsletter #165
Jul 17, 2023 | 17 minute read
July 17th, 2023 - Instalment #165 Welcome to #165 of the AWS open source newsletter, the only* newsletter that brings you the best and latest open source content. We have some great new projects this week, including a tool for IoT developers to help you validate your SQL statements, a command line interface tool for Amazon Verified Permissions, an Amazon DynamoDB estimation tool, and more. Also featured this week is content on Apache Iceberg, OpenSearch, PostgreSQL, Kubernetes, Power Tools for AWS Lambda, Spring Boot, Babelfish for Aurora PostgreSQL, Karpenter, Apollo GraphQL, JupyterHub, dbt, Apache Airflow, Cedar, and Apache Flink.
-
AWS open source newsletter #164
Jul 10, 2023 | 17 minute read
July 10th, 2023 - Instalment #164 Welcome to #164 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. New projects this week will help you implement single table designs easily on Amazon DynamoDB, an experimental project to help you get to grips with Cedar, a comprehensive clickstream analytics project for your applications, web sites, and mobile applications, and some cool projects to help you with edge and hybrid use cases.
- oss-newsletter
- aws open source
- Apache Flink
- Apache Airflow
- Kubernetes
- Amazon EKS
- AWS Lambda Powertools
- Spring Boot
- Linux
- Apache Parquet
- OpenZFS
- OpenSearch
- Mountpoint for Amazon S3
- PostgreSQL
- AWS Amplify
- Next.js
- AWS Distro for OpenTelemetry
- Grafana
- Babelfish for Aurora PostgreSQL
- AWS ParallelCluster
- Consul
- Apache Iceberg
- Cedar
- Steampipe
- VS Code Server
- nomad
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #161
Jun 19, 2023 | 19 minute read
June 19th, 2023 - Instalment #161 Welcome to #161 of the AWS open source newsletter, and another week for fresh, new open source projects and code for you to practice your four freedoms. This weeks projects include tools that will help you create temporary elevated credentials, a new Java library that provides methods for encrypting and decrypting cryptographic materials, an AWS DynamoDB wrapper for Node/TypeScript developers, and a solution to help you find and visualise data assets.
- oss-newsletter
- aws open source
- Falcon
- AWS CDK
- Keycloak
- Cedar
- FreeRTOS
- Apache Airflow
- MWAA
- Apache Spark
- Amazon EMR
- Apache Hudi
- Apache Iceberg
- and Delta Lake
- Apache Flink
- OpenChatkit
- Kubernetes
- Pinniped
- Kubecost
- Karpenter
- ONNX
- Apache Kafka
- Babelfish for Aurora PostgreSQL
- AWS Amplify
- Next.js
- OpenSearch
- Flux
- ArgoCD
- KVM
-
AWS open source newsletter #159
Jun 5, 2023 | 16 minute read
June 5th, 2023 - Instalment #159 Welcome to #159 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you generate test data, an accelerator for stable diffusion, tools to help you with managing application credentials and variables, a new connector for Apache Kafka, and more!
-
AWS open source newsletter #158
May 30, 2023 | 21 minute read
May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you.
-
AWS open source newsletter #155
Apr 29, 2023 | 20 minute read
May 1st, 2023 - Instalment #155 Welcome Hello and welcome to the AWS open source newsletter, #155, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. This week’s new projects include “aws-cloudformation-controller-for-flux” provides a way to use flux to orchestrate your CloudFormation deployments, “threat-composer” is a nice React based tool to help you create Threat Models for your systems and applications, “cdk-integ-tests-sample” a tool to allow you to do integration tests with your CDK stacks (these three were all featured in the latest episode of Build on Open Source, you can watch it here), “iam-access-key-report” generates reports from your AWS accounts about your AWS access keys, “personalize-kafka-connector” provides an integration into Apache Kafka for this AWS service, and more!
-
AWS open source newsletter #150
Mar 27, 2023 | 12 minute read
March 27th, 2023 - Instalment #150 Welcome Hello and welcome to a milestone edition of the AWS open source newsletter, #150. Over two hundred thousand words later, thousands of contributors, hundreds of new open source projects, I hope this newsletter brings as much joy for readers as it does for me to put this together. Thank you all for your amazing support so far. What do we have in store for you this week?
-
AWS open source newsletter #149
Mar 19, 2023 | 14 minute read
March 20th, 2023 - Instalment #149 Welcome Hello and welcome to edition #149 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. I hope some of you were able to catch this episode reviewed on our last Build on Open Source livestream. If not, you can catch the replay here. This week we have projects such “mountpoint-s3”, “s3-access-for-squash”, and “amazon-s3-tar-tool” which provide some useful tools for managing your files on S3, “aws-serverless-ai-stories” a creative masterclass in storytelling, “earthquake-notifier” a serverless solution to keep you alerted and ready, and more!
-
AWS open source newsletter #148
Mar 12, 2023 | 17 minute read
March 13th, 2023 - Instalment #148 Welcome Hello and a warm welcome to edition #148 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. This week we have projects such as “iam-ape” a tool to help you grapple with your IAM policies, “amazon-emr-cli” a nice command line tool to package and deploy your Spark jobs on Amazon EMR, “duckdb-athena-extension” that helps you import data from Amazon Athena into DuckDB, “terraform-aws-email-files-dropped-in-s3” a helpful tool to easily email you attachments automatically, “cloud-queue-for-quantum-devices” a tool to help Quantum researchers across the world, “aws-private-ca-matter-infrastructure” a sample reference architecture for setting up a secure, private certificate authority, “aws-sam-cli-java-examples” will help you deploy your Java apps via AWS SAM, “mpartman” a PostgreSQL partition manager, “aws-do-pcluster” simplifying how to run AWS ParallelCluster, “staticwebsite-cli” a very nice too to help you easily deploy static web sites, and more!
-
AWS open source newsletter #147
Mar 6, 2023 | 14 minute read
March 6th, 2023 - Instalment #147 Welcome Welcome to edition #147 of the AWS open source newsletter, featured in the latest episode of Build on Open Source. This week we have new projects such as “metahub” and “savings-estimator” that we looked at in closer detail on the Build on Open Source livestream, “aws-iot-core-credential-provider-session-helper” a Python library to help simplify working with AWS IoT, “traffic-inspection-architectures-aws-cloud-wan” code that provides examples of different network architectures and how to do traffic inspection, “neptune-export” a tool to help you export your data in Amazon Neptune, “aws-organizations-tool” a command line tool to help you configure AWS Organisations, “sagemaker-external-repo-access” a nice reference architecture for Amazon Sagemaker, “aws-cdk-cfn-hook” a Python CDK app that will get you up and running quickly working with Cloudformation template hooks, and more!
- oss-newsletter
- aws open source
- Kubernetes
- OpenSearch
- Ubuntu
- Vault
- FreeRTOS
- AWS SAM
- MySQL
- MariaDB
- PostgreSQL
- AWS Lambda Powertools
- Debezium
- Apache Kafka
- Kafka Connect
- Apache Spark
- Apache Hudi
- DeltaStreamer
- Apicurio Registry
- Apache Iceberg
- FFMpeg
- Prometheus
- Babelfish for Amazon Aurora PostgreSQL
- Redis
- Mastadon
- Amazon EMR
-
AWS open source newsletter #145
Feb 20, 2023 | 24 minute read
Feb 20th, 2023 - Instalment #145 Welcome to edition #145 of the AWS open source newsletter. I hope some of you were able to catch the new Build on Open Source show we live streamed last Friday. You can catch up and replay the session by clicking on this link, where we went over a number of projects from this and a few previous newsletters, and we had special guest Valter who walked us through his project terraform-dev-containers.
-
AWS open source newsletter #144
Feb 5, 2023 | 19 minute read
Feb 5th, 2023 - Instalment #144 Welcome to edition #144 of the AWS open source newsletter, and another week of great new open source projects for you to try out. Some of the treats in store for you this week include “dynamodb-shell”, a project that provides a cli to your favourite AWS database, “precloud” a tool to help you catch issues with your configuration before you deploy, “node-latency-for-k8s” a tool to analyse your node logs, “stepfunctions-lambda-ec2-ssm” a very nice way of using step functions to overcome the 15 minute timeout of your lambda functions, “terraform-ec2-image-builder-container-hardening-pipeline” a very cool example of how to build an EC2 image hardening pipeline using Terraform, and “cloudtrail-event-fuzzy-viewer” a tool to copy your AWS CloudTrail events and then fuzzy search them on the command line.
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #141
Jan 15, 2023 | 13 minute read
January 16th, 2023 - Instalment #141 Welcome Welcome to the AWS open source newsletter of 2023, edition #141. This week we have more new projects for you to practice your four freedoms, including “distributed-compute-on-aws-with-cross-regional-dask”, a solution to simplify distributed compute using Dask, “amazon-emr-serverless-image-cli” a tool to verify your Amazon EMR custom container images, “serverless-run-watch” a tool to help accelerate your local development if you are using the Serverless Framework, “aws-sso-auto-expand-accounts” a quick browser extension for those using AWS SSO, “basti” a cool Bastion Host alternative, “klotho” generate cloud native code from your code, “amazon-route53-hosted-zone-sync” a nice solution for hybrid DNS use cases, and many more.
-
AWS open source news and updates #138
Dec 12, 2022 | 24 minute read
December 12th, 2022 - Instalment #138 Welcome Welcome to the AWS open source newsletter, edition #138. After a week off due to re:Invent, this edition is packed with content on many of the open source related announcements. As always, we have a great line up of new projects for you to practice your four freedoms on. In no particular order, we have projects like “eks-node-viewer”, a nice visualisation tool for your Amazon EKS clusters, “pg_tle” a great new project to make your PostgreSQL environments safer, “dyna53” a fun project that finally turns Amazon Route 53 into a database, “dynamodb-mass-migrations” a tool to help you migrate to Amazon DynamoDB, “visual-asset-management-system” a very nice digital asset management tool, “fast-differential-privacy” implement differential privacy in your PyTorch models, “migration-hadoop-to-emr-tco-simulator” a handy total cost of ownership calculator for Amazon EMR, “realtime-toxicity-detection” a tool to help you stay on top of your online communities, “functionclarity” a very cool tool to check the integrity of your serverless functions before executing, and many more.
- oss-newsletter
- aws open source
- Rez
- Terraform
- PostgreSQL
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Amazon EMR
- Apache Iceberg
- Apache Spark
- OpenZFS
- Ray
- MySQL
- Kubernetes
- Apache Kafka
- Open Invention Network
- AWS IoT Greengrass
- Ray
- Modin
- Amazon Corretto
- Firecracker
- DeeQu
- Open Cybersecurity Schema Framework
- ocsf
- AWS SDK for pandas
- Amazon Braket
- Yocto
- Log4shell
- MQTT
- Redis
- AWS CDK
- AWS Amplify
-
AWS open source news and updates #137
Nov 25, 2022 | 30 minute read
November 25th, 2022 - Instalment #137 Welcome Welcome to the AWS open source newsletter, edition #137. As it is re:Invent next week, I will be publishing the newsletter early as I am heading out on Monday. I will be in Las Vegas talking with open source Builders, hanging out on the Open Source Kiosk in the AWS Village, and doing some talks. If you are coming, I would love to meet some of you, so get in touch.
- oss-newsletter
- aws open source
- re:Invent
- GraphQL
- Grafana
- Prometheus
- AWS Toolkits for JetBrains
- AWS Toolkits for VS Code
- AWS Amplify
- NodeJS
- MariaDB
- PostgreSQL
- Flutter
- React
- Apache Iceberg
- Apache Airflow
- Apache Flink
- Apache ShardingSphere
- AutoGluon
- AWS ParallelCluster
- Kubeflow
- NGINX
- Finch
- Amazon EMR
- Trino
- Apache Hudi
- O3DE
- Apache Kafka
- OpenSearch
- MLFlow
-
AWS open source news and updates #135
Nov 11, 2022 | 17 minute read
November 11th, 2022 - Instalment #135 Welcome Welcome to the AWS open source newsletter, edition #135. What do we have in store for you in this weeks instalment? I am happy to report that we have yet more great new projects this week. These include “sovereign-keys” and “nitrogen” are new projects to help you secure and get started working with enclaves, “aws-serverless-scheduler” helps you schedule your events, “aws-resource-explorer-cli” provides a command line tool for this new capability, “workload-discovery-on-aws” helps you stay on top of your AWS workloads, ““image-content-moderation” provide a sample project for image moderation you can integrate into your workflows, “cloudenv” is a proof of concept that explores managing secrets and prameters, “cdk-schema-watcher” is a tool to help you stay notified of schema changes in your event driven applications, and several other projects to check out.
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #131
Oct 17, 2022 | 17 minute read
October 17th, 2022 - Instalment #131 Welcome to the AWS open source newsletter, edition #131. This week’s new projects include “metahub”, a command line way to interact with AWS Security Hub, “somod” a framework for creating micro applications in serverless, “terraform-aws-guardduty-multiaccount” a Terraform module to help you automate your AWS Guard Duty configuration, “aws-glue-cdk-cicd” a sample project to automate the creation data pipelines using AWS Glue, “go-kafka-event-source” an Apache Kafka client in Go, “project-tools” a tool to help you get insights from your GitHub repo, “eks-event-watcher” a command line tool to tail your Amazon EKS logs, “listmonk-based-edm-solution” an example of how to deploy this open source mailing list tool, and many more.
-
AWS open source news and updates #129
Sep 30, 2022 | 22 minute read
September 30th, 2022 - Instalment #129 Welcome Welcome to the AWS open source newsletter, edition #129. We have loads of great new projects this week, with plenty of variety to keep you all interested. We have “aws-ecr-cleaner”, a great tool to help you manage your container images, “dotnet-lambda-sql-server-proxy” that shows you how you can use RDS Proxy with SQL Server and why, “minecraft-server-dashboard” perfect for those running their own minecraft servers, “YATAS” and “aws-security-survival-kit” for those working on security and governance, “aws-lambda-handler-cookbook” useful recipes to get you going, “autonomous-driving-data-framework” for folks working in the automotive space, and many more - make sure you check all the projects out.
- oss-newsletter
- aws open source
- Apache TinkerPop
- Gremlin
- AWS CDK
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Apache Cassandra
- GraphQL
- Hive
- Apache Spark
- Apache Kafka Streams
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache Airflow
- Keycloak
- Kubeapps
- Babelfish for PostgreSQL
- Linux
- Ubuntu
- PHP
- MySQL
- Bottlerocket
-
AWS open source news and updates #125
Sep 2, 2022 | 20 minute read
September 2nd, 2022 - Instalment #125 Welcome After a couple of weeks off, it is great to welcome to back to the AWS open source newsletter, edition #125. As it has been a couple of weeks, this edition contains even more open source goodness to keep you occupied. As always, we kick things off we a round up of new open source projects. Over the past couple of weeks, there were so many that it was hard to select them (I will include the others in next weeks newsletter).
-
AWS open source news and updates #119
Jul 1, 2022 | 15 minute read
July 1st, 2022 - Instalment #119 Welcome to regular and new readers alike, to the AWS open source newsletter episode #119. This week we feature more new open source projects, such as “cdk-bill-bot”, a tool that can help you reduce AWS bill surprises, “steampipe-mod-aws-perimeter” helps you look for resources that are publicly accessible, “aws-cloudformation-diagrams” is a nice visualisation tool for CloudFormation users, “aws-swagger-ui” a project to help you set up Swagger UI for API Gateway, “kinesis-hot-shard-advisor” a handy tool that helps you identify whether you have hot key or hot shard issues on your Kinesis data streams, and many more.
-
AWS open source news and updates #118
Jun 24, 2022 | 14 minute read
June 24th, 2022 - Instalment #118 Welcome to regular and new readers alike, to the AWS open source newsletter episode #118. This week we feature more new open source projects, such as “seed-farmer”, and orchestration tool modelled after GitOps deployments, “aws-proton-plugins-for-backstage” Backstage plugins for interacting with AWS Proton, “dcv-gnome-shell-extension” is a GNOME Shell extension to provide functionalities required by NICE DCV, “simpleiot-arduino” an Arduino library to integrate with the SimpleIOT framework, “event-driven-weather-forecasts” an event driven weather forecasting demo, and many more.
-
AWS open source news and updates #117
Jun 17, 2022 | 16 minute read
June 17th, 2022 - Instalment #117 Welcome to regular and new readers alike, to the AWS open source newsletter episode #117. A little behind schedule this week, as I have been speaking at a couple of events this week. It has been good to get back on the stage and to talk and engage with real people. It seems that things are quickly returning back to normal. So this week we have some great new projects for you.
-
AWS open source news and updates #108
Apr 11, 2022 | 16 minute read
April 11th, 2022 - Instalment #108 Newsletter #108. A little later the usual as it was a busy week last week, and I was lucky enough to speak at some great events. It certainly seems that things are returning to normality now on the tech events scene, and it was great to meet so many customers and builders who were enthusiastic champions of open source. The AWS Summit season is upon us, with the Brussels summit just gone and Paris Summit happening this week.
-
AWS open source news and updates #100
Feb 14, 2022 | 12 minute read
Feb 14th, 2022 - Instalment #100 Newsletter #100. Happy Valentines everyone, and welcome to this landmark 100st edition of this newsletter. This week we celebrate the love that many builders have for open source with more great new open source projects and content. Cuddle up to new projects that will help you build scalable systems, simplify your work with AWS DynamoDB, integrate your .NET applications with OpenSearch, keep on top of your VPC networks, and more.
-
AWS open source news and updates #97
Jan 22, 2022 | 12 minute read
Jan 22nd, 2022 - Instalment #97 Newsletter #97. Welcome to another edition of the AWS open source newsletter, packed with more great new open source projects, content, and events. This week, we have new projects that help you improve security by de-obfuscating strings, a library to help you automate the configuration of your build pipelines, a new Terraform module, a nice new VSCode plugin that will help you when working with IAM, and several more.