MySQL
-
AWS open source newsletter #204
Oct 22, 2024 | 25 minute read
Edition #204 Welcome to issue #204 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Apologies for the long wait since the last edition, I will have to do better. Thanks for the lovely messages and feedback I have received over the past few weeks, this edition is for you! As always, we have more great new projects to check out, which include projects that surface up your AWS costs in Home Assistant, a tool that you can use to ask questions about your code base that uses generative AI, a git large file storage (LFS) extension that lets you use Amazon S3, and a handy network cost calculator.
- oss-newsletter
- aws open source
- Home Assistant
- Godot
- Valkey
- Keycloak
- Apache Airflow
- MWAA
- PostgreSQL
- deequ
- Kubernetes
- ArgoCD
- OTEL
- Grafana
- Spring Boot
- Amazon Corretto
- ROSA
- OpenShift
- Kubecost
- Amazon Linux 2023
- Karpenter
- MySQL
- MariaDB
- Apache Flink
- Apache Kafka
- OpenZFS
- InfluxDB
- AWS Parallel Cluster
- Lustre
- Prometheus
- Finch
- Ubuntu
- Cedar
-
AWS open source newsletter #203
Aug 27, 2024 | 28 minute read
Welcome to the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition, #203. Projects to check out include: how you can proxy OpenAI requests through Amazon Bedrock, security tools that help you stay one step ahead of bad actors, a way of implementing CDK Pipelines in a less opinionated way, a tool that helps you validate your AWS IAM policies, a toolkit to help get you started with good practices when creating CloudFormation templates, some demo code that demonstrate how you can implement zero downtime updates to your applications, as well as some really cool demos and use cases of generative AI in action (too many to mention, so check them all out!
- oss-newsletter
- aws open source
- Langfuse
- Steampipe
- Ray
- Apache Spark
- AWS Amplify
- Flutter
- Valkey
- O3DE
- AWS CDK
- LangChain
- Kubernetes
- Amazon EKS
- Argo Workflows
- OpenTofu
- Bottlerocket
- Karpenter
- OpenTelemetry
- Apache Flink
- Apache Pinot
- Apache Kafka
- openCypher
- Apache Iceberg
- Apache Airflow
- MWAA
- MySQL
- PostgreSQL
- Deequ
- OCSF
- GraphStorm
- OpenShift
- Amazon EMR
- ActiveMQ
- Red Hat Enterprise Linux
- Cedar
-
AWS open source newsletter #202
Jul 22, 2024 | 20 minute read
Edition #202 Welcome to the AWS open source newsletter, issue #202. In this edition, I share more new projects (thank you for those of you that have sent them through) which include a project to help you monitor your data pipelines, the open sourced AWS Secrets Manager agent, a really cool new framework for managing multi generative AI agents, a couple of interesting projects to help manage your AWS accounts, a repo that provides CloudFormation snippets, and a few demo applications including one I put together that shows how you can use the Amazon Bedrock Converse API to summarise Hacker News comments.
- oss-newsletter
- aws open source
- PostgreSQL
- OpenSearch
- Cedar
- Kubernetes
- Amazon EKS
- OpenShift
- ROSA
- PHP
- Flyway
- LiteLLM
- GraphRAG
- Valkey
- Finch
- Dask
- Cilium
- Apache Kafka
- Grafana
- Prometheus
- AWS CDK
- Trusted Language Extensions for PostgreSQL
- MySQL
- MariaDB
- InfluxDB
- Apache Solr
- Apache Flink
- MLflow
- Notation
- Amazon Linux 2023
- RabbitMQ
-
AWS open source newsletter #201
Jul 10, 2024 | 28 minute read
Edition #201 Welcome to the AWS open source newsletter, issue #201, your trusted source for the very best open source on AWS content. This weeks new projects for you to practice your four freedoms include generative AI infused projects to help you generate your docs, streamline the setting up of your AWS resources, a new experimental framework for building document based workflows, and a cool demo that showcases how you can use generative AI to help translate American Sign Language.
- oss-newsletter
- aws open source
- PHP
- Apache Airflow
- MWAA
- Node.js
- LLRT
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- eksctl
- Valkey
- LangChain
- Project Lakechain
- AWS Amplify
- Itsio
- Apache Iceberg
- Apache Kafka
- Apache Cassandra
- PyTorch
- Apache httpd
- Babelfish for Aurora PostgreSQL
- Apache Flink
- PostgreSQL
- MySQL
- OpenSearch
- OpenZFS
- Amazon Linux
- FreeRTOS
- RabbitMQ
- AWS ParallelCluster
- Open Container Initiative
- Smithy
- Cedar
- sbt
-
AWS open source newsletter #200
Jun 24, 2024 | 20 minute read
Edition #200 Welcome to a milestone edition of this newsletter, number #200!! Wow, it feels like quite an achievement. Before diving into this newsletter, a big thank you for sticking with me. Time has flown by so quickly, and am looking forward to the next 100. As I have done in a few of the previous milestone issues, I wanted to share a few interesting stats from sharing open source projects with you over the past few years.
-
AWS open source newsletter #199
Jun 10, 2024 | 18 minute read
Edition #199 Welcome to issue #199 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I cannot believe that we are one issue away from a pretty significant milestone. I would love to hear from some of the regular readers of this newsletter to find any highlights they have had, or perhaps things they have found that have been pretty significant.
-
AWS open source newsletter #198
May 28, 2024 | 25 minute read
Edition #198 Welcome to issue #198 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. In this issue we feature new projects that provide integration of .NET Aspire with AWS resources, an automated data discovery tool to find data in your AWS environments, a tool to help incorporate good practices when building SaaS solutions, a cost allocation dashboard for your Kubernetes workloads, a project that might help you mitigate costs around Internet Gateway, and a few generative AI demos around food, news, and social media which you should definitely check out.
- oss-newsletter
- aws open source
- Aspire
- Kubernetes
- Amazon EKS
- Leapp
- OpenTelemetry
- AWS CDK
- llrt
- Valkey
- PostgreSQL
- InfluxDB
- High Performance Software Foundation
- Karpenter
- Multus
- Kata
- Grafana
- Prometheus
- Apache Flink
- Zingg
- Apache Hudi
- Apache Iceberg
- MySQL
- Apache Tomcat
- WordPress
- AWS Amplify
- Apache Airflow
- MWAA
- OpenSearch
- Apache Kafka
- Bottlerocket
- Amazon EMR
-
AWS open source newsletter #197
May 13, 2024 | 21 minute read
Edition #197 Welcome to issue #197 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Like in previous editions of this newsletter, we feature new projects for you you practice your four freedoms. We have some great projects, including a sprinkling of repos that look to help you benchmark and assess your generative AI models and agents, a new fruity framework for building document understanding applications, a nice container command line tool that sysadmins will love, a tool to help you migrate your CodeCommit repositories, a really nice application of using generative AI to help automate CVE findings, and a neat generative AI newsletter generation demo.
-
AWS open source newsletter #196
Apr 29, 2024 | 22 minute read
Edition #196 Welcome to issue #196 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition of the newsletter, including a link to the Valkey repo, a nice GUI based project to help you build orchestration workflows that uses Apache Airflow under the covers, a tool to help you find signals through the noise of your security logs, a project to help you run serverless tasks in a cron like fashion, a command line runner for Amazon CodeCatalyst, a tool to help you simplify the deployment of Cruise Control on Amazon MSK, a nice Mac client for experimenting with Amazon Bedrock, and some really cool demo apps, the pick of which (for me) is a nice way of surfacing up your Amazon Bedrock models in a way that existing applications that expect an API key can use.
- oss-newsletter
- aws open source
- Valkey
- Apache Airflow
- MWAA
- OpenSearch
- LangChain
- PostgreSQL
- WordPress
- RAGmap
- RAGxplorer
- Cedar
- AWS CDK
- Lambda Web Adapter
- Postfix
- Spring Boot
- Amazon Corretto
- Amazon EKS
- Kubernetes
- Karpenter
- KEDA
- Prometheus
- OPA
- Amazon EMR
- PySpark
- MySQL
- Open JD
- AWS Amplify
- GraphQL
- AWS PDK
- Apache Livy
- Nodestream
-
AWS open source newsletter #195
Apr 15, 2024 | 21 minute read
Edition #195 Welcome to issue #195 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This week I am heading out to Everything Open, and looking forward to meeting the community in Gladstone. I will be talking about Cedar, and showing why it is important and how it works (demo is working lovely now). I am now on the third week of my open source roadshow, which is why I have had to change the publishing of this newsletter to every other week - at least until I get back home.
-
AWS open source newsletter #194
Apr 3, 2024 | 21 minute read
Edition #194 Welcome to issue #194 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Due to travelling and speaking commitments, regular readers will have noticed that I slipped up and missed a week. Normal service has been resumed, and as always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms.
-
AWS open source newsletter #193
Mar 18, 2024 | 16 minute read
Edition #193 Welcome to issue #193 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Sadly I will be missing the fun at KubeCon in Paris, but if you are attending, make sure to check out the AWS booth - I had a sneak peak at what you can expect, and there is going to be some great demos being shown, a lot of our open source folk will be there.
-
AWS open source newsletter #192
Mar 11, 2024 | 16 minute read
Edition #192 Welcome to issue #192 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. A wide variety this week, and we have projects that help you create architecture diagrams from your YAML, visualise and create dashboards for compliance and reporting purposes, a new multi-cloud threat detection tool, a Go implementation of Cedar, an example of load testing your large language models, and more!
-
AWS open source newsletter #191
Mar 4, 2024 | 15 minute read
Edition #191 Welcome to issue #191 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that cover AWS Nitro Enclaves, open source mapping libraries, how to grab secrets into your application configuration files, database performance benchmarking and analysis, improving the logging your applications generate, and a number of very handy tools to help you manage security data from the command line.
-
AWS open source newsletter #190
Feb 26, 2024 | 15 minute read
Edition #190 Welcome to issue #190 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that can help you keep on top of your cost optimisation, a tool to help you automate Well Architected reviews, a tool to help you map out your RDS instances, as well as sample projects and demos.
-
AWS open source newsletter #189
Feb 18, 2024 | 14 minute read
Edition #189 Welcome to issue #189 of the AWS open source newsletter, the newsletter where we search high and low to provide you with the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that help you find your RDS instances, automate tasks from your online Chime calls, a very nice visual file browser for your Amazon S3 buckets, a tool to help you track and manage copying files from your S3 storage buckets, an active-active multi region cluster solution for Redis, and more!
-
AWS open source newsletter #188
Feb 12, 2024 | 15 minute read
Edition #188 Welcome to issue #188 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have freshly cut repos that help you migrate your DNS configurations, improve your prompts when working with large language models, a new lightweight Javascript runtime, some reference code that shows you how you can deploy modern Java applications a number of different ways, and sample repos that show you how you can do remote debugging in Amazon EMR, as well as the usual cool demos that showcase some of the ways you can use generative AI.
-
AWS open source newsletter #187
Feb 4, 2024 | 15 minute read
Edition #187 Welcome to issue #187 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have new projects that help you optimise working with EBS volumes on EC2, a tool to help you document your architectures, a large language model benchmarking tool, a tool to help you optimise your S3 storage files, a data validation framework, and a really nice Java workshop.
-
AWS open source newsletter #186
Jan 29, 2024 | 16 minute read
Edition #186 Welcome to issue #186 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have dashboards to help you cut through the noise when reviewing security information, a synthetic data generator that leverages generative AI, a tool to help you mask data from production so you can use it in development and testing, a solution to help you run VSCode on EC2, a tool to help you wipe your S3 Glacier data vaults, and an assortment of generative AI demos for you to try out.
-
AWS open source newsletter #185
Jan 22, 2024 | 13 minute read
Edition #185 Welcome to issue #185 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that allow you to export your Partyrock applications, a tool to help you reduce hallucinations in your large language models, a new client for Redis, a tool to help you access the AWS Partner Network, as well as sample projects that look at how you can use large langue models to build a new reader and building pipelines using Cloudformation.
-
AWS open source newsletter #184
Jan 15, 2024 | 17 minute read
Edition #184 Welcome to issue #184 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have a rust based cli tools to help you accelerate your S3 searches, we take a look at a new framework to help simplify bootstrapping your projects, a tool to help you report on your AWS resource tags, a voice translator for Chime, a really nice sample project to help you get hands on with Cedar, a number of generative AI demos and sample projects that are a must, and many more projects.
-
AWS open source newsletter #183
Jan 8, 2024 | 26 minute read
January 8th, 2024 - Instalment #183 Happy new year and welcome to the first edition of the AWS open source newsletter of 2024, number #183. The big news for 2024 is the move from dev.to to community.aws as the “home” for the AWS open source newsletter, although it will still be posted on dev.to as well. Let me know what you think, community.aws has some top notch content that many readers might not be aware of.
- oss-newsletter
- aws open source
- Cedar
- Projen
- Prometheus
- Grafana
- Kubernetes
- Amazon EKS
- Mage
- OpenSearch
- AWS CDK
- eBPF
- Istio
- Kubecost
- PostgreSQL
- MySQL
- MariaDB
- ActiveMQ
- Apache Airflow
- MWAA
- Apache Spark
- Ray
- AWS Amplify
- Spring Boot
- Amazon EMR
- AWS Neuron
- Apache Cassandra
- OpenTelemetry
- Amazon Linux
- AWS ParallelCluster
- RabbitMQ
-
AWS open source newsletter #182
Dec 11, 2023 | 24 minute read
December 11th, 2023 - Instalment #182 Welcome to #182 of the AWS open source newsletter, the place for all your AWS and open source needs. This is a special re:Invent packed edition of this newsletter, attempting to catch up and cover all the main talking points, sessions, and announcements. Whilst there is a lot of content to go through, I know that many of you will still be wanting to know about new projects you can try out, and the good news is that we have plenty.
- oss-newsletter
- aws open source
- Redis
- Go
- MLFlow
- MySQL
- PostgreSQL
- MariaDB
- dbt
- OpenRewrite
- Amazon Corretto
- Amazon EMR
- lakeFS
- Apache Kafka
- Memecached
- Grafana
- GraphQL
- Code-OSS
- Rust
- Kotlin
- FreeRTOS
- Prometheus
- Kubernetes
- Amazon EKS
- OpenZFS
- OpenSearch
- AWS Distro for OpenTelemetry
- AWS CDK
- Powertools for Lambda
- Jupyter
- cdk8s
-
AWS open source newsletter #181
Nov 27, 2023 | 20 minute read
November 27th, 2023 - Instalment #181 Welcome to #181 of the AWS open source newsletter, the place for all your AWS and open source needs. As some of you will know, this is re:Invent week, where many of my colleagues and tens of thousands of developers will be congregating to learn about Cloud, and hopefully discover plenty of open source goodness too. If you are going, make sure to visit the open source booth in the Expo floor.
- oss-newsletter
- aws open source
- Griptape
- PyTorch
- AWS Amplify
- NextJS
- WordPress
- OpenJDK
- Amazon Corretto
- PostgreSQL
- OpenSearch
- SnapStart
- Kong
- AWS Copilot
- MySQL
- dbt
- Apache Hudi
- Apache Flink
- Kubernetes
- Amazon EKS
- Kali
- Karpenter
- Istio
- LangChain
- Pinecone
- Amazon EMR
- Apache Spark
- Prometheus
- Lustre
- OpenZFS
- Apache Kafka
- Lambda PowerTuning
-
AWS open source newsletter #180
Nov 20, 2023 | 20 minute read
November 20th, 2023 - Instalment #180 Welcome to #180 of the AWS open source newsletter, the place for all your AWS and open source needs. As we ramp up to re:Invent, it is good to see that pre:Invent is giving us plenty of open source goodies. In this weeks newsletter, we have some of those in the way of new projects such as res and aws-iatk, but we also have lots of really great content too.
- oss-newsletter
- aws open source
- Ragna
- ezsmdeploy
- SnapStart
- GraalVM
- Amazon Corretto
- Amazon EMR
- Apache Airflow
- LangChain
- AWS Copilot
- Karpenter
- MWAA
- Grafana
- Prometheus
- Amazon EKS
- Kubernetes
- Apache Flink
- Apache Kafka
- Avro
- Apache Cassandra
- Apache Spark
- Red Hat Linux
- Amazon Linux 2023
- NodeJS
- AWS Amplify
- Redis
- MySQL
- PostgreSQL
- eksctl
- MapLibre
- Overture Maps
-
AWS open source newsletter #179
Nov 13, 2023 | 18 minute read
November 13th, 2023 - Instalment #179 Welcome to #179 of the AWS open source newsletter, the place for all your AWS and open source needs. This weeks new projects include an open source tool that provides similar capabilities to AWS Control Tower, a tool for enrolling your Mac based EC2 instances into mobile device management (MDM) solution, a very neat tool to help you compare costs of running your CodePipeline jobs, as well as sample code that shows you how you can use Karpenter to optimise IP address use, examples of using Test Containers with AWS CDK, generative AI technologies such as LangChain, and more.
-
AWS open source newsletter #178
Nov 6, 2023 | 19 minute read
November 6th, 2023 - Instalment #178 Welcome to #178 of the AWS open source newsletter, the place for all your AWS and open source needs. This week we feature more new open source projects for you to practice your four freedoms. We have a useful tool that helps you synchronise your AWS Identity Centre users with the users you provision in your Amazon RDS databases, we share the AWS data solutions framework that helps you build data solutions following opinionated best practices, a resource explorer for your AWS accounts, a guardrails solution for your AWS account, and a couple of demo repositories that take a look at Localstack and RSS.
-
AWS open source newsletter #173
Sep 11, 2023 | 22 minute read
September 11th, 2023 - Instalment #173 Welcome to #173 of the AWS open source newsletter, bringing you all the news and latest projects for AWS developers. This weeks new projects include a Golang based SDK for kernel eBPF operations, a project that helps you to optimise your network performance, a couple of projects for Apache Flink users, as well as a handful of different tools and demos featuring open source technologies helping to drive innovation in generative AI.
-
AWS open source newsletter #172
Sep 4, 2023 | 21 minute read
September 4th, 2023 - Instalment #172 Welcome to #172 of the AWS open source newsletter, your reliable source for all open source on AWS goodness. What do we have for you this week? Well, more new projects to check out, and plenty of fresh content on the open source projects you all love. We have tools to help you export your DynamoDB tables as csv files, a tool that goes beyond tracking cost and actually shuts down resources to help you manage your AWS budget, a cool dashboard to help you stay on top of your EC2 configurations, a couple of useful utilities to simplify working with files on Amazon S3, and then a sample Cedar project that helps you implement a Lambda authoriser.
-
AWS open source newsletter #171
Aug 29, 2023 | 18 minute read
August 29th, 2023 - Instalment #171 Welcome to #171 of the AWS open source newsletter, the newsletter created for developers passionate about open source. Thanks to the wonderful August bank holiday here in the UK, we are publishing a day later than usual. If you have not read this newsletter before, we feature new projects, content from across the open source and AWS community, and share events and videos that you should check out.
-
AWS open source newsletter #169
Aug 14, 2023 | 26 minute read
August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications.
- oss-newsletter
- aws open source
- OpenSearch
- AWS CDK
- Juypter AI
- dbt
- Apache Airflow
- Managed Workflows for Apache Airflow
- MWAA
- Cedar
- cfnguard
- Grafana
- Prometheus
- Apache Kafka
- Amazon Timestream
- Open Cybersecurity Schema Framework
- OCSF
- AWS Lambda Web Adapter
- Smithy
- Apache Spark
- Linux
- Amazon Linux
- AWS ParallelCluster
- PostgreSQL
- Spring Boot
- Amazon EKS
- Kubernetes
- Mountpoint for Amazon S3
- MySQL
- Lustre
- OpenZFS
- Redis
- Amazon EMR
- Karpenter
- Seekable OCI
- SOCI
- Firecracker
-
AWS open source newsletter #168
Aug 7, 2023 | 24 minute read
August 7th, 2023 - Instalment #168 Welcome to #168 of the AWS open source newsletter, the only newsletter that features the freshest open source and AWS content* New projects for you to feast on in this issue include the obligatory projects that look at how Generative AI can help developers be more productive, in this case by making documentation more relevant and easier to find and to help with code reviews, a nice tool to help you query your AWS Identity Access Management (IAM) policies, and a security focused tool to help you search for potentially incorrect configured S3 buckets.
-
AWS open source newsletter #167
Jul 31, 2023 | 22 minute read
July 31st, 2023 - Instalment #167 Welcome to #167 of the AWS open source newsletter, and another edition packed with new open source projects for you to explore. Whether you are new to this newsletter, or returning (we thank you!) there is something for you. This week we have projects that will help use Terraform to deploy your monolith applications, a tool to accelerate your GraphQL building when working with Amazon DynamoDB, a project that will help you introduce chaos without changes to your code, and a couple of really nice demos of using generative AI that allows you to use natural language to query your data.
- oss-newsletter
- aws open source
- Terraform
- Rust
- LangChain
- Streamlit
- PostgreSQL
- Supabase
- OpenSearch
- AWS SAM
- AWS CDK
- Powertools for AWS Lambda
- Open Application Model
- OAM
- Traefik
- Keycloak
- FastAPI
- PyTorch
- MySQL
- IAM Roles Anywhere
- Apache Iceberg
- MQTT
- Amazon EMR
- Kubernetes
- Amazon EKS
- Apache Hudi
- Go
- Cedar
- RabbitMQ
- Pacu
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #160
Jun 12, 2023 | 17 minute read
June 12th, 2023 - Instalment #160 Welcome to #160 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you build data workflows, Terraform modules to help you incorporate temporary elevated access controls, integrating Tailscale to change your traffic flows, a neat AWS Lambda debugging tool, Go bindings for Cedar, and more.
-
AWS open source newsletter #158
May 30, 2023 | 21 minute read
May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you.
-
AWS open source newsletter #157
May 22, 2023 | 19 minute read
May 22nd, 2023 - Instalment #157 Welcome Hello and welcome to the AWS open source newsletter, #157. Apologies for the lack of newsletter last week, but hopefully this week will make up for that as we have a bumper selection of great open source content for you. This weeks new projects include repos that help you get OpenEMR up and running (“host-openemr-on-aws-fargate”), two new security related open source projects that you definitely need to check out, (“cedar” and “snapchange”), integration of clickstream analytics using Swift (“clickstream-swift”), deployment of Backstage to serve up access to your AWS resources, (“app-development-for-backstage-io-on-aws”), a tool to help you clean up ecs tasks definitions (“aws-ecs-task-definition-cleanup”) and many more.
-
AWS open source newsletter #156
May 8, 2023 | 21 minute read
May 8th, 2023 - Instalment #156 Welcome Hello and welcome to the AWS open source newsletter, #156, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. So what do we have for you this week? Coming up later in this newsletter we have projects such as “sustainability-scanner” helps you check your Cloudformation templates against sustainability good practices, “synthtable” helps you create synthetic data for different use cases, “neptune-gremlin-client” a Java based Gremlin client, “s3zipper” a tool to quickly download entire S3 buckets, “chataws” a nice demo of how you can use ChatGPT to aid your AWS deployments, and plenty of other great projects.
-
AWS open source newsletter #153
Apr 17, 2023 | 19 minute read
April 17th, 2023 - Instalment #153 Welcome Hello and welcome to the AWS open source newsletter, #153 as featured in the latest episode of Build on Open Source (S2E5) . We have lots of great projects for you this week, with a strong chatGPT influence. “pg_gpt”, “cw-logs-insights-gpt”, and “aiws” all integrate chatGPT to help you do different things on AWS, “semantic-search-aws-docs” is a very interesting demo on how to build a more coherent search for your documentation, “aws-chime-chat-demo” a very nice demo using the Chime SDK, “ckia” is an open source AWS Trusted Advisor tool, “AWS_ED” helps you keep your local IP in sync with external DNS records, “cfnctl” provides a Terraform like cli experience to CloudFormation, and more!
-
AWS open source newsletter #150
Mar 27, 2023 | 12 minute read
March 27th, 2023 - Instalment #150 Welcome Hello and welcome to a milestone edition of the AWS open source newsletter, #150. Over two hundred thousand words later, thousands of contributors, hundreds of new open source projects, I hope this newsletter brings as much joy for readers as it does for me to put this together. Thank you all for your amazing support so far. What do we have in store for you this week?
-
AWS open source newsletter #148
Mar 12, 2023 | 17 minute read
March 13th, 2023 - Instalment #148 Welcome Hello and a warm welcome to edition #148 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. This week we have projects such as “iam-ape” a tool to help you grapple with your IAM policies, “amazon-emr-cli” a nice command line tool to package and deploy your Spark jobs on Amazon EMR, “duckdb-athena-extension” that helps you import data from Amazon Athena into DuckDB, “terraform-aws-email-files-dropped-in-s3” a helpful tool to easily email you attachments automatically, “cloud-queue-for-quantum-devices” a tool to help Quantum researchers across the world, “aws-private-ca-matter-infrastructure” a sample reference architecture for setting up a secure, private certificate authority, “aws-sam-cli-java-examples” will help you deploy your Java apps via AWS SAM, “mpartman” a PostgreSQL partition manager, “aws-do-pcluster” simplifying how to run AWS ParallelCluster, “staticwebsite-cli” a very nice too to help you easily deploy static web sites, and more!
-
AWS open source newsletter #147
Mar 6, 2023 | 14 minute read
March 6th, 2023 - Instalment #147 Welcome Welcome to edition #147 of the AWS open source newsletter, featured in the latest episode of Build on Open Source. This week we have new projects such as “metahub” and “savings-estimator” that we looked at in closer detail on the Build on Open Source livestream, “aws-iot-core-credential-provider-session-helper” a Python library to help simplify working with AWS IoT, “traffic-inspection-architectures-aws-cloud-wan” code that provides examples of different network architectures and how to do traffic inspection, “neptune-export” a tool to help you export your data in Amazon Neptune, “aws-organizations-tool” a command line tool to help you configure AWS Organisations, “sagemaker-external-repo-access” a nice reference architecture for Amazon Sagemaker, “aws-cdk-cfn-hook” a Python CDK app that will get you up and running quickly working with Cloudformation template hooks, and more!
- oss-newsletter
- aws open source
- Kubernetes
- OpenSearch
- Ubuntu
- Vault
- FreeRTOS
- AWS SAM
- MySQL
- MariaDB
- PostgreSQL
- AWS Lambda Powertools
- Debezium
- Apache Kafka
- Kafka Connect
- Apache Spark
- Apache Hudi
- DeltaStreamer
- Apicurio Registry
- Apache Iceberg
- FFMpeg
- Prometheus
- Babelfish for Amazon Aurora PostgreSQL
- Redis
- Mastadon
- Amazon EMR
-
AWS open source newsletter #146
Feb 27, 2023 | 17 minute read
Feb 27th, 2023 - Instalment #146 Welcome to edition #146 of the AWS open source newsletter. This week we have another great selection of brand new, shiny open source projects for you to practice your four freedoms on. Some of the projects this week include “aws-lambda-web-adapter” that will help you build portable Lambda functions, “aws-marketplace-cli” if you want to escape the GUI when working with AWS Marketplace, this one is for you, ““otel-config-validator” helps you sanity check your configuration files, “aws-serverless-openai-chatbot-demo” build a personal assistance powered by ChatGPT, “drone-video-analysis” if you have wanted to use AI services to process your drone video footage, check this project out, “mask-words-in-image” a nice command line tool to quick mask data based on your needs, and many more cool projects.
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #140
Jan 9, 2023 | 19 minute read
January 9th, 2023 - Instalment #140 Welcome Happy New Year and welcome to the first AWS open source newsletter of 2023, edition #140. If you have not already checked it out, I put together a short retrospective summary of 2022 in the post, AWS open source newsletter - 2022 in review. There are some interesting facts and figures in there. I am also taking time to collect feedback from readers to help shape where this newsletter goes in 2023.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- Next.js
- AWS SDK for Java
- AWS ParallelCluster
- Docker
- MariaDB
- Amazon EKS
- Kubernetes
- MQTT
- ArgoCD
- AWS Distro for OpenTelemetry
- Prometheus
- DAMON
- Crossplane
- Log4Shell
- .NET
- Apache Spark
- Apache Kafka
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache NiFi
- Delta Lake
- OpenShift
- Redis
- Red Hat Enterprise Linux
- SUSE Linux Enterprise Server
- Ubuntu Pro
- AWS Copilot
- RabbitMQ
- Apache Airflow
- Rust
- Terraform
- Amazon EMR
- Apache ShardingSphere-Proxy
-
AWS open source news and updates #139
Dec 18, 2022 | 19 minute read
December 18th, 2022 - Instalment #139 Welcome Welcome to the last AWS open source newsletter of 2022, edition #139. I am planning on take a few weeks off to recharge, and wish readers of this newsletter a fabulous Christmas and New Year. Over 100K of you have read this newsletter, so I want to thank you all for your continued support. This newsletter is only possible because of the passion and enthusiasm of open source Builders, and I look forward to seeing what 2023 will bring.
-
AWS open source news and updates #138
Dec 12, 2022 | 24 minute read
December 12th, 2022 - Instalment #138 Welcome Welcome to the AWS open source newsletter, edition #138. After a week off due to re:Invent, this edition is packed with content on many of the open source related announcements. As always, we have a great line up of new projects for you to practice your four freedoms on. In no particular order, we have projects like “eks-node-viewer”, a nice visualisation tool for your Amazon EKS clusters, “pg_tle” a great new project to make your PostgreSQL environments safer, “dyna53” a fun project that finally turns Amazon Route 53 into a database, “dynamodb-mass-migrations” a tool to help you migrate to Amazon DynamoDB, “visual-asset-management-system” a very nice digital asset management tool, “fast-differential-privacy” implement differential privacy in your PyTorch models, “migration-hadoop-to-emr-tco-simulator” a handy total cost of ownership calculator for Amazon EMR, “realtime-toxicity-detection” a tool to help you stay on top of your online communities, “functionclarity” a very cool tool to check the integrity of your serverless functions before executing, and many more.
- oss-newsletter
- aws open source
- Rez
- Terraform
- PostgreSQL
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Amazon EMR
- Apache Iceberg
- Apache Spark
- OpenZFS
- Ray
- MySQL
- Kubernetes
- Apache Kafka
- Open Invention Network
- AWS IoT Greengrass
- Ray
- Modin
- Amazon Corretto
- Firecracker
- DeeQu
- Open Cybersecurity Schema Framework
- ocsf
- AWS SDK for pandas
- Amazon Braket
- Yocto
- Log4shell
- MQTT
- Redis
- AWS CDK
- AWS Amplify
-
AWS open source news and updates #136
Nov 21, 2022 | 20 minute read
November 21st, 2022 - Instalment #136 Welcome Welcome to the AWS open source newsletter, edition #136, as featured on the latest episode of Build on Open Source. This week we feature new projects including “dynamoit” a JavaFX gui for Amazon DynamoDB, “building-apache-kafka-connectors”, “msk-config-providers”, and “msk-serverless-data-pipeline” projects to help make your life easier when working with Apache Kafka, “stowrs-to-s3” a tool for working with STOWRS data on AWS, “aws-device-lobby” a tool to make onboarding devices into AWS IoT Core easier, “aws-graviton-run-confidential-ml-workloads-using-nitro-enclaves” a nice example of how you can do Confidential Computing for machine learning use cases, “aws-hpc-builder” a tool to help you manage your open source HPC tools, and many more.
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #133
Oct 28, 2022 | 18 minute read
October 28th, 2022 - Instalment #133 Welcome Welcome to the AWS open source newsletter, edition #133. This week has been all about KubeCon, and there were some important announcements from AWS. If you missed these, I have tried to capture the important ones here, but I want to start off with probably my favourite which was the announcement during Nate Taber keynote on some of the investments we are providing to CNCF and OpenSSF.
-
AWS open source news and updates #132
Oct 21, 2022 | 20 minute read
October 21st, 2022 - Instalment #132 Welcome Welcome to the AWS open source newsletter, edition #132. This newsletter was covered in last Friday’s Build on Open Source, so if you missed it, don’t worry as you can view episode five of Build on Open Source. In this episode special guest Abhishek Gupta walked us through how to use cdk8s using Golang, building a Wordpress site in minutes. New projects this week include “duvet” a tool to help honour RFC in code, “aws-lambda-explorer” a gui tool to explore your AWS Lambda functions, “k3s-aws-terraform-cluster” deploy k3s on AWS via Terraform, “snow-transfer-tool” a tool to help you transfer data via Snowball devices, “amazon-emr-vscode-toolkit” a new VSCode plugin for Amazon EMR users, “aws-cdk-for-discourse” a quick way to deploy the open source discourse tool, “image-optimization” a reference example of how to do image optimising, and “gtfs-serverless-ticketing-sample” a sample application using public transport data.
-
AWS open source news and updates #130
Oct 10, 2022 | 17 minute read
October 10th, 2022 - Instalment #130 Welcome Welcome to the AWS open source newsletter, edition #130. This newsletter was featured in the Build on Open Source episode four, which you can check out here if you missed it. New projects for you to practice your open source four freedoms this week include “grucloud” a new infrastructure as code tool with some nice features, “stepfunctions-sdk-autocomplete” a VSCode plugin for all you AWS Step Functions fans, “AWS_Billing_Overage_Shutdown” a very new repo that has some code to help you automate shutting down resources on alerts, “aws-secrets-manager-github-action” if you are using GitHub Actions, this one is for you, “meta-aws”, tools and recipes for those using and building with Yocto, “data-on-eks” a number of sample solutions to configure self managed open source data analytics tools, “cql-replicator” a tool to help you migrate from self managed Apache Cassandra to Amazon Keyspaces, “ec2-imagebuilder-ami-lifecycle” provides some new capabilities for those building AMIs, and many more.
-
AWS open source news and updates #129
Sep 30, 2022 | 22 minute read
September 30th, 2022 - Instalment #129 Welcome Welcome to the AWS open source newsletter, edition #129. We have loads of great new projects this week, with plenty of variety to keep you all interested. We have “aws-ecr-cleaner”, a great tool to help you manage your container images, “dotnet-lambda-sql-server-proxy” that shows you how you can use RDS Proxy with SQL Server and why, “minecraft-server-dashboard” perfect for those running their own minecraft servers, “YATAS” and “aws-security-survival-kit” for those working on security and governance, “aws-lambda-handler-cookbook” useful recipes to get you going, “autonomous-driving-data-framework” for folks working in the automotive space, and many more - make sure you check all the projects out.
- oss-newsletter
- aws open source
- Apache TinkerPop
- Gremlin
- AWS CDK
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Apache Cassandra
- GraphQL
- Hive
- Apache Spark
- Apache Kafka Streams
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache Airflow
- Keycloak
- Kubeapps
- Babelfish for PostgreSQL
- Linux
- Ubuntu
- PHP
- MySQL
- Bottlerocket
-
AWS open source news and updates #123
Aug 5, 2022 | 16 minute read
August, 5th, 2022 - Instalment #123 Welcome Welcome to the AWS open source newsletter episode #123. I sometimes speak with builders who are experienced developers but perhaps new to open source. A common question I get asked is what the impact of them working on open source might be on their careers. Whilst it is never a guarantee, open source can be a great career accelerator. I was reminded of that last week when reading the excellent post from Ran Isenberg, who shared his experience in his post How One Open-Source Code Donation Got Me Promoted.
-
AWS open source news and updates #120
Jul 15, 2022 | 16 minute read
July 15th, 2022 - Instalment #120 Welcome to regular and new readers alike, to the AWS open source newsletter episode #120. The observant will have noticed that it has been two weeks since the last newsletter. We all need some time off, and I spent most of the time cycling around the hills of a new cycle route called King Alfreds Way - highly recommended. There has been some great new projects created over the past couple of weeks, and of course I have you covered and have shared them below.
-
AWS open source news and updates #116
Jun 10, 2022 | 16 minute read
June 10th, 2022 - Instalment #116 Welcome to regular and new readers alike, to the AWS open source newsletter episode #116. Another selection of useful and interesting new open source projects for you to try out this week. First up, we have “aws-exec” a tool to help you do adhoc shell execution in AWS Lambda functions, “edgy” helps you simplify writing tests for Node.js based AWS CloudFront Lambda@Edge functions, “cdk-app-cli” a really nice cli that every AWS CDK user should know about, “Accumulus” a great looking reporting tool for AWS Lambda users, “sqldef-gitops-cdk” is a schema management for several open source databases, “log-hub” helps you to build your own log analytics tool using OpenSearch, “verifiable-controls-evidence-store” a very cool solution that builds a mechanism to centrally store findings and results of cloud security controls governing AWS workloads, and many more!
-
AWS open source news and updates #109
Apr 22, 2022 | 21 minute read
April 22nd, 2022 - Instalment #109 Newsletter #109. Welcome to edition #109 of the AWS open source newsletter. Big news, I have shaken things up and will be changing the publish date to Friday mornings, starting today with this edition. Over the months I have received some feedback about changing the published date to Fridays, so I am hoping this will give everyone plenty of time to check out the projects, read the posts and provide everyone with something to do over the weekend (if they want!
-
AWS open source news and updates #108
Apr 11, 2022 | 16 minute read
April 11th, 2022 - Instalment #108 Newsletter #108. A little later the usual as it was a busy week last week, and I was lucky enough to speak at some great events. It certainly seems that things are returning to normality now on the tech events scene, and it was great to meet so many customers and builders who were enthusiastic champions of open source. The AWS Summit season is upon us, with the Brussels summit just gone and Paris Summit happening this week.
-
AWS open source news and updates #106
Mar 28, 2022 | 14 minute read
March 28th, 2022 - Instalment #106 Newsletter #106. Welcome to the AWS open source newsletter, and this week we have more great new open source projects to tell you about. We have “access-undenied-aws”, a tool that helps you better understand your CloudTrail logs and suggest remediation. “aws-slack-clickoops-watcher” provides you with a way to alert you when changes are made to your AWS environment. “kronicle” provides a way of illustrating your tech stack automagically, and we have many more tools, demos and sample projects to help get you started on a number of topics.
-
AWS open source news and updates #103
Mar 7, 2022 | 15 minute read
March 7th, 2022 - Instalment #103 Newsletter #103. Welcome to edition #103 of the AWS open source news and updates. This weeks featured new open source projects include botocove (a decorator that helps you run your functions across your AWS accounts easily), functionless (a TypeScript plugin that transforms TypeScript code into Service-to-Service integrations), replibyte (a tool to replicate your PostgreSQL data), aws-security-bulletin-alert (notifies you of new AWS Security Bulletins) and sends out E-Mail notifications via Amazon SES), and many more.