AWS CDK
-
AWS open source newsletter #205
Nov 30, 2024 | 26 minute read
Welcome to issue #205 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This will be the last edition of 2024, but looking forward to coming back in 2025 with more great open source project and content. As always, we have more great new projects to check out, which include a project that simplifies how you manage complex Kubernetes resource configurations, a library to accelerate open source analytics using Amazon S3, a look at a GraphRAG project, a project that helps NodeJS developers make it easier to make use of some advanced Amazon Aurora capabilities, an ESLinting tool for AWS CDK, and more.
- oss-newsletter
- aws open source
- AWS CDK
- Amazon EKS
- Kubernetes
- Apache Iceberg
- Dapr
- Lustre
- kro
- Projen
- ComfyUI
- Finch
- Open Cybersecurity Schema Framework
- OCSF
- PostgreSQL
- Amazon EMR
- Apache Cassandra
- MySQL
- HBase
- AWS Amplify
- Apache XTable
- Mountpoint for Amazon S3
- Valkey
- Apache Airflow
- MWAA
- Bottlerocket
- Apache Kafka
- Apache Flink
-
AWS open source newsletter #203
Aug 27, 2024 | 28 minute read
Welcome to the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition, #203. Projects to check out include: how you can proxy OpenAI requests through Amazon Bedrock, security tools that help you stay one step ahead of bad actors, a way of implementing CDK Pipelines in a less opinionated way, a tool that helps you validate your AWS IAM policies, a toolkit to help get you started with good practices when creating CloudFormation templates, some demo code that demonstrate how you can implement zero downtime updates to your applications, as well as some really cool demos and use cases of generative AI in action (too many to mention, so check them all out!
- oss-newsletter
- aws open source
- Langfuse
- Steampipe
- Ray
- Apache Spark
- AWS Amplify
- Flutter
- Valkey
- O3DE
- AWS CDK
- LangChain
- Kubernetes
- Amazon EKS
- Argo Workflows
- OpenTofu
- Bottlerocket
- Karpenter
- OpenTelemetry
- Apache Flink
- Apache Pinot
- Apache Kafka
- openCypher
- Apache Iceberg
- Apache Airflow
- MWAA
- MySQL
- PostgreSQL
- Deequ
- OCSF
- GraphStorm
- OpenShift
- Amazon EMR
- ActiveMQ
- Red Hat Enterprise Linux
- Cedar
-
AWS open source newsletter #202
Jul 22, 2024 | 20 minute read
Edition #202 Welcome to the AWS open source newsletter, issue #202. In this edition, I share more new projects (thank you for those of you that have sent them through) which include a project to help you monitor your data pipelines, the open sourced AWS Secrets Manager agent, a really cool new framework for managing multi generative AI agents, a couple of interesting projects to help manage your AWS accounts, a repo that provides CloudFormation snippets, and a few demo applications including one I put together that shows how you can use the Amazon Bedrock Converse API to summarise Hacker News comments.
- oss-newsletter
- aws open source
- PostgreSQL
- OpenSearch
- Cedar
- Kubernetes
- Amazon EKS
- OpenShift
- ROSA
- PHP
- Flyway
- LiteLLM
- GraphRAG
- Valkey
- Finch
- Dask
- Cilium
- Apache Kafka
- Grafana
- Prometheus
- AWS CDK
- Trusted Language Extensions for PostgreSQL
- MySQL
- MariaDB
- InfluxDB
- Apache Solr
- Apache Flink
- MLflow
- Notation
- Amazon Linux 2023
- RabbitMQ
-
AWS open source newsletter #200
Jun 24, 2024 | 20 minute read
Edition #200 Welcome to a milestone edition of this newsletter, number #200!! Wow, it feels like quite an achievement. Before diving into this newsletter, a big thank you for sticking with me. Time has flown by so quickly, and am looking forward to the next 100. As I have done in a few of the previous milestone issues, I wanted to share a few interesting stats from sharing open source projects with you over the past few years.
-
AWS open source newsletter #198
May 28, 2024 | 25 minute read
Edition #198 Welcome to issue #198 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. In this issue we feature new projects that provide integration of .NET Aspire with AWS resources, an automated data discovery tool to find data in your AWS environments, a tool to help incorporate good practices when building SaaS solutions, a cost allocation dashboard for your Kubernetes workloads, a project that might help you mitigate costs around Internet Gateway, and a few generative AI demos around food, news, and social media which you should definitely check out.
- oss-newsletter
- aws open source
- Aspire
- Kubernetes
- Amazon EKS
- Leapp
- OpenTelemetry
- AWS CDK
- llrt
- Valkey
- PostgreSQL
- InfluxDB
- High Performance Software Foundation
- Karpenter
- Multus
- Kata
- Grafana
- Prometheus
- Apache Flink
- Zingg
- Apache Hudi
- Apache Iceberg
- MySQL
- Apache Tomcat
- WordPress
- AWS Amplify
- Apache Airflow
- MWAA
- OpenSearch
- Apache Kafka
- Bottlerocket
- Amazon EMR
-
AWS open source newsletter #197
May 13, 2024 | 21 minute read
Edition #197 Welcome to issue #197 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Like in previous editions of this newsletter, we feature new projects for you you practice your four freedoms. We have some great projects, including a sprinkling of repos that look to help you benchmark and assess your generative AI models and agents, a new fruity framework for building document understanding applications, a nice container command line tool that sysadmins will love, a tool to help you migrate your CodeCommit repositories, a really nice application of using generative AI to help automate CVE findings, and a neat generative AI newsletter generation demo.
-
AWS open source newsletter #196
Apr 29, 2024 | 22 minute read
Edition #196 Welcome to issue #196 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition of the newsletter, including a link to the Valkey repo, a nice GUI based project to help you build orchestration workflows that uses Apache Airflow under the covers, a tool to help you find signals through the noise of your security logs, a project to help you run serverless tasks in a cron like fashion, a command line runner for Amazon CodeCatalyst, a tool to help you simplify the deployment of Cruise Control on Amazon MSK, a nice Mac client for experimenting with Amazon Bedrock, and some really cool demo apps, the pick of which (for me) is a nice way of surfacing up your Amazon Bedrock models in a way that existing applications that expect an API key can use.
- oss-newsletter
- aws open source
- Valkey
- Apache Airflow
- MWAA
- OpenSearch
- LangChain
- PostgreSQL
- WordPress
- RAGmap
- RAGxplorer
- Cedar
- AWS CDK
- Lambda Web Adapter
- Postfix
- Spring Boot
- Amazon Corretto
- Amazon EKS
- Kubernetes
- Karpenter
- KEDA
- Prometheus
- OPA
- Amazon EMR
- PySpark
- MySQL
- Open JD
- AWS Amplify
- GraphQL
- AWS PDK
- Apache Livy
- Nodestream
-
AWS open source newsletter #195
Apr 15, 2024 | 21 minute read
Edition #195 Welcome to issue #195 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This week I am heading out to Everything Open, and looking forward to meeting the community in Gladstone. I will be talking about Cedar, and showing why it is important and how it works (demo is working lovely now). I am now on the third week of my open source roadshow, which is why I have had to change the publishing of this newsletter to every other week - at least until I get back home.
-
AWS open source newsletter #194
Apr 3, 2024 | 21 minute read
Edition #194 Welcome to issue #194 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Due to travelling and speaking commitments, regular readers will have noticed that I slipped up and missed a week. Normal service has been resumed, and as always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms.
-
AWS open source newsletter #193
Mar 18, 2024 | 16 minute read
Edition #193 Welcome to issue #193 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Sadly I will be missing the fun at KubeCon in Paris, but if you are attending, make sure to check out the AWS booth - I had a sneak peak at what you can expect, and there is going to be some great demos being shown, a lot of our open source folk will be there.
-
AWS open source newsletter #192
Mar 11, 2024 | 16 minute read
Edition #192 Welcome to issue #192 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. A wide variety this week, and we have projects that help you create architecture diagrams from your YAML, visualise and create dashboards for compliance and reporting purposes, a new multi-cloud threat detection tool, a Go implementation of Cedar, an example of load testing your large language models, and more!
-
AWS open source newsletter #191
Mar 4, 2024 | 15 minute read
Edition #191 Welcome to issue #191 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that cover AWS Nitro Enclaves, open source mapping libraries, how to grab secrets into your application configuration files, database performance benchmarking and analysis, improving the logging your applications generate, and a number of very handy tools to help you manage security data from the command line.
-
AWS open source newsletter #189
Feb 18, 2024 | 14 minute read
Edition #189 Welcome to issue #189 of the AWS open source newsletter, the newsletter where we search high and low to provide you with the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that help you find your RDS instances, automate tasks from your online Chime calls, a very nice visual file browser for your Amazon S3 buckets, a tool to help you track and manage copying files from your S3 storage buckets, an active-active multi region cluster solution for Redis, and more!
-
AWS open source newsletter #188
Feb 12, 2024 | 15 minute read
Edition #188 Welcome to issue #188 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have freshly cut repos that help you migrate your DNS configurations, improve your prompts when working with large language models, a new lightweight Javascript runtime, some reference code that shows you how you can deploy modern Java applications a number of different ways, and sample repos that show you how you can do remote debugging in Amazon EMR, as well as the usual cool demos that showcase some of the ways you can use generative AI.
-
AWS open source newsletter #187
Feb 4, 2024 | 15 minute read
Edition #187 Welcome to issue #187 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have new projects that help you optimise working with EBS volumes on EC2, a tool to help you document your architectures, a large language model benchmarking tool, a tool to help you optimise your S3 storage files, a data validation framework, and a really nice Java workshop.
-
AWS open source newsletter #186
Jan 29, 2024 | 16 minute read
Edition #186 Welcome to issue #186 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have dashboards to help you cut through the noise when reviewing security information, a synthetic data generator that leverages generative AI, a tool to help you mask data from production so you can use it in development and testing, a solution to help you run VSCode on EC2, a tool to help you wipe your S3 Glacier data vaults, and an assortment of generative AI demos for you to try out.
-
AWS open source newsletter #185
Jan 22, 2024 | 13 minute read
Edition #185 Welcome to issue #185 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that allow you to export your Partyrock applications, a tool to help you reduce hallucinations in your large language models, a new client for Redis, a tool to help you access the AWS Partner Network, as well as sample projects that look at how you can use large langue models to build a new reader and building pipelines using Cloudformation.
-
AWS open source newsletter #184
Jan 15, 2024 | 17 minute read
Edition #184 Welcome to issue #184 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have a rust based cli tools to help you accelerate your S3 searches, we take a look at a new framework to help simplify bootstrapping your projects, a tool to help you report on your AWS resource tags, a voice translator for Chime, a really nice sample project to help you get hands on with Cedar, a number of generative AI demos and sample projects that are a must, and many more projects.
-
AWS open source newsletter #183
Jan 8, 2024 | 26 minute read
January 8th, 2024 - Instalment #183 Happy new year and welcome to the first edition of the AWS open source newsletter of 2024, number #183. The big news for 2024 is the move from dev.to to community.aws as the “home” for the AWS open source newsletter, although it will still be posted on dev.to as well. Let me know what you think, community.aws has some top notch content that many readers might not be aware of.
- oss-newsletter
- aws open source
- Cedar
- Projen
- Prometheus
- Grafana
- Kubernetes
- Amazon EKS
- Mage
- OpenSearch
- AWS CDK
- eBPF
- Istio
- Kubecost
- PostgreSQL
- MySQL
- MariaDB
- ActiveMQ
- Apache Airflow
- MWAA
- Apache Spark
- Ray
- AWS Amplify
- Spring Boot
- Amazon EMR
- AWS Neuron
- Apache Cassandra
- OpenTelemetry
- Amazon Linux
- AWS ParallelCluster
- RabbitMQ
-
AWS open source newsletter #182
Dec 11, 2023 | 24 minute read
December 11th, 2023 - Instalment #182 Welcome to #182 of the AWS open source newsletter, the place for all your AWS and open source needs. This is a special re:Invent packed edition of this newsletter, attempting to catch up and cover all the main talking points, sessions, and announcements. Whilst there is a lot of content to go through, I know that many of you will still be wanting to know about new projects you can try out, and the good news is that we have plenty.
- oss-newsletter
- aws open source
- Redis
- Go
- MLFlow
- MySQL
- PostgreSQL
- MariaDB
- dbt
- OpenRewrite
- Amazon Corretto
- Amazon EMR
- lakeFS
- Apache Kafka
- Memecached
- Grafana
- GraphQL
- Code-OSS
- Rust
- Kotlin
- FreeRTOS
- Prometheus
- Kubernetes
- Amazon EKS
- OpenZFS
- OpenSearch
- AWS Distro for OpenTelemetry
- AWS CDK
- Powertools for Lambda
- Jupyter
- cdk8s
-
AWS open source newsletter #179
Nov 13, 2023 | 18 minute read
November 13th, 2023 - Instalment #179 Welcome to #179 of the AWS open source newsletter, the place for all your AWS and open source needs. This weeks new projects include an open source tool that provides similar capabilities to AWS Control Tower, a tool for enrolling your Mac based EC2 instances into mobile device management (MDM) solution, a very neat tool to help you compare costs of running your CodePipeline jobs, as well as sample code that shows you how you can use Karpenter to optimise IP address use, examples of using Test Containers with AWS CDK, generative AI technologies such as LangChain, and more.
-
AWS open source newsletter #177
Oct 30, 2023 | 19 minute read
October 30th, 2023 - Instalment #177 Welcome to #177 of the AWS open source newsletter, the Halloween special. You will find no tricks in this edition, only treats, with more new projects for you to check out and content that are a feast for your eyes. This weeks new projects include a tool to help you easily deploy vector databases on Kubernetes, an observability toolkit, a tool to help you benchmark network latency, as well as lots of new demos on generative AI.
- oss-newsletter
- aws open source
- Bottlerocket
- KubeArmor
- NGINX
- Wordpress
- Milvus
- Falcon-40B
- JupyterHub
- Dask
- Flux GitOps
- Crossplane
- Kubernetes
- Amazon EKS
- Babelfish for Aurora PostgreSQL
- PostgreSQL
- Linux
- Apache Hive
- Apache Spark
- Apache Kafka
- Apache Hudi
- Delta Lake
- Apache Iceberg
- OpenSearch
- Dremio
- OpenShift
- OpenCLIP
- Apache Airflow
- MWAA
- Amazon Corretto
- OpenJDK
- AWS CDK
-
AWS open source newsletter #176
Oct 23, 2023 | 19 minute read
October 23rd, 2023 - Instalment #176 Welcome to #176 of the AWS open source newsletter, heading into Autumn and getting ready for the clocks to go back later in the week. How will you use that extra hour? Well, perhaps some of you might use it to check out this weeks new projects, which include a nice cli chat tool that uses Amazon Bedrock, a tool to help simplify deploying VSCode in the Cloud environments, and sample demos and code on chaos engineering, deploying Amazon Bedrock via AWS Lambda, and how you can use IAM Roles Anywhere to authenticate against external identity providers.
- oss-newsletter
- aws open source
- LangChain
- Trivy
- AWS CDK
- Apache Spark
- Pinecone
- Redis
- Postgres
- pgVector
- OpenSearch
- ClickHouse
- Chroma
- Apache Iceberg
- CfnGuard
- Kubernetes
- Amazon EKS
- Karpenter
- Kubecost
- Amazon Corretto
- NextJS
- AWS Amplify
- GraphQL
- Ray
- AWS Distro for OpenTelemetry
- Grafana
- Core WCF
- AWS SAM
- Amazon EMR on EKS
- RabbitMQ
- Swift
-
AWS open source newsletter #175
Oct 16, 2023 | 25 minute read
October 16th, 2023 - Instalment #175 Welcome to #175 of the AWS open source newsletter, back after recharging in the wonderful countyside of Yorkshire. I am publishing this weeks newsletter from Raleigh, North Carolina. All Things Open is happening this week, and you will catch me at the AWS booth where I will be showing off some cool open source stuff (Cedar, Apache Airflow, and a few others), and I also have a talk on Tuesday.
- oss-newsletter
- aws open source
- Redis
- MariaDB
- and PostgreSQL
- Cloud Native Operational Excellence
- CNOE
- Crossplane
- Apache Airflow
- MWAA
- Apache Flink
- Amazon EMR
- Powertools for AWS Lambda
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- AWS Distributed OpenTelemetry(ADOT)
- Karpenter
- CoreDNS
- etcd
- Istio
- SUSE
- AWS-LC
- Spring Boot
- SOCI
- Apache Kafka
- Amazon Corretto
- AWS CDK
- Amazon Linux
- Bottlerocket
- cdk8s
- AWS Amplify
- Stable Diffusion
- NextJS
-
AWS open source newsletter #174
Sep 18, 2023 | 18 minute read
September 18th, 2023 - Instalment #174 Welcome to #174 of the AWS open source newsletter, which will be the last one for a couple of weeks as I take some time off to recharge. I will be back in early October with more open source goodness, but in the meantime, you still have this edition packed with open source goodness. This weeks new projects include a Rust tool to help you keep your CloudFormation stacks up to date, a tool to help upload files to Amazon S3, a generative AI tool that aims to help you review and detect IAM configuration issues, an updated JDBC driver for connecting to Amazon Aurora, and more.
-
AWS open source newsletter #171
Aug 29, 2023 | 18 minute read
August 29th, 2023 - Instalment #171 Welcome to #171 of the AWS open source newsletter, the newsletter created for developers passionate about open source. Thanks to the wonderful August bank holiday here in the UK, we are publishing a day later than usual. If you have not read this newsletter before, we feature new projects, content from across the open source and AWS community, and share events and videos that you should check out.
-
AWS open source newsletter #170
Aug 21, 2023 | 21 minute read
August 21st, 2023 - Instalment #170 Welcome to edition #170 of the AWS open source newsletter, an oasis of open source goodness that features the latest new projects, essential reading, and must view videos to quench the thirst of every open source developer. This weeks edition we have new projects that help you get on top of your IAM actions, a handy tool for knowing what your current AWS account service limits are from the command line, a tool to help you do database migrations, and some interesting and very detailed reference solutions for gaming, live streaming, and managing/exporting of your Amazon Cognito profiles.
- oss-newsletter
- aws open source
- AWS-LC
- Threat Composer
- AWS CDK
- AWS SAM
- AWS SDK for Java
- GitLab
- GraphQL
- AWS AppSync
- AWS Distro for OpenTelemetry (ADOT)
- PostgreSQL
- Apache Airflow
- SBOM
- Syft
- Apache Hudi
- Apache Iceberg
- Apache Spark
- collectd
- Grafana
- O3DE
- ROS
- Next.js
- PostgreSQL
- OpenZFS
- MWAA
- Cedar
- Powertools for Lambda
-
AWS open source newsletter #169
Aug 14, 2023 | 26 minute read
August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications.
- oss-newsletter
- aws open source
- OpenSearch
- AWS CDK
- Juypter AI
- dbt
- Apache Airflow
- Managed Workflows for Apache Airflow
- MWAA
- Cedar
- cfnguard
- Grafana
- Prometheus
- Apache Kafka
- Amazon Timestream
- Open Cybersecurity Schema Framework
- OCSF
- AWS Lambda Web Adapter
- Smithy
- Apache Spark
- Linux
- Amazon Linux
- AWS ParallelCluster
- PostgreSQL
- Spring Boot
- Amazon EKS
- Kubernetes
- Mountpoint for Amazon S3
- MySQL
- Lustre
- OpenZFS
- Redis
- Amazon EMR
- Karpenter
- Seekable OCI
- SOCI
- Firecracker
-
AWS open source newsletter #168
Aug 7, 2023 | 24 minute read
August 7th, 2023 - Instalment #168 Welcome to #168 of the AWS open source newsletter, the only newsletter that features the freshest open source and AWS content* New projects for you to feast on in this issue include the obligatory projects that look at how Generative AI can help developers be more productive, in this case by making documentation more relevant and easier to find and to help with code reviews, a nice tool to help you query your AWS Identity Access Management (IAM) policies, and a security focused tool to help you search for potentially incorrect configured S3 buckets.
-
AWS open source newsletter #167
Jul 31, 2023 | 22 minute read
July 31st, 2023 - Instalment #167 Welcome to #167 of the AWS open source newsletter, and another edition packed with new open source projects for you to explore. Whether you are new to this newsletter, or returning (we thank you!) there is something for you. This week we have projects that will help use Terraform to deploy your monolith applications, a tool to accelerate your GraphQL building when working with Amazon DynamoDB, a project that will help you introduce chaos without changes to your code, and a couple of really nice demos of using generative AI that allows you to use natural language to query your data.
- oss-newsletter
- aws open source
- Terraform
- Rust
- LangChain
- Streamlit
- PostgreSQL
- Supabase
- OpenSearch
- AWS SAM
- AWS CDK
- Powertools for AWS Lambda
- Open Application Model
- OAM
- Traefik
- Keycloak
- FastAPI
- PyTorch
- MySQL
- IAM Roles Anywhere
- Apache Iceberg
- MQTT
- Amazon EMR
- Kubernetes
- Amazon EKS
- Apache Hudi
- Go
- Cedar
- RabbitMQ
- Pacu
-
AWS open source newsletter #166
Jul 24, 2023 | 22 minute read
July 24th, 2023 - Instalment #166 Welcome to #166 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks new projects include a library to help you managed and validate your environment variables when working with AWS Lambda, a new Rust based tool for interacting with your S3 buckets, an essential tool to help CDK developers remove a lot of the setup work, and a tool that helps you run Yocto embedded Linux build jobs in AWS.
-
AWS open source newsletter #163
Jul 3, 2023 | 13 minute read
July 3rd, 2023 - Instalment #163 Welcome to #163 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks featured projects include a Cedar authorisation service and demo examples, a tool to help you find dangling DNS records, a new CLI for those using Amazon ECR, an accelerator for observability on AWS, a serverless web analytics solution (so good, that I implemented it myself), and several more projects.
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #161
Jun 19, 2023 | 19 minute read
June 19th, 2023 - Instalment #161 Welcome to #161 of the AWS open source newsletter, and another week for fresh, new open source projects and code for you to practice your four freedoms. This weeks projects include tools that will help you create temporary elevated credentials, a new Java library that provides methods for encrypting and decrypting cryptographic materials, an AWS DynamoDB wrapper for Node/TypeScript developers, and a solution to help you find and visualise data assets.
- oss-newsletter
- aws open source
- Falcon
- AWS CDK
- Keycloak
- Cedar
- FreeRTOS
- Apache Airflow
- MWAA
- Apache Spark
- Amazon EMR
- Apache Hudi
- Apache Iceberg
- and Delta Lake
- Apache Flink
- OpenChatkit
- Kubernetes
- Pinniped
- Kubecost
- Karpenter
- ONNX
- Apache Kafka
- Babelfish for Aurora PostgreSQL
- AWS Amplify
- Next.js
- OpenSearch
- Flux
- ArgoCD
- KVM
-
AWS open source newsletter #159
Jun 5, 2023 | 16 minute read
June 5th, 2023 - Instalment #159 Welcome to #159 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you generate test data, an accelerator for stable diffusion, tools to help you with managing application credentials and variables, a new connector for Apache Kafka, and more!
-
AWS open source newsletter #158
May 30, 2023 | 21 minute read
May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you.
-
AWS open source newsletter #156
May 8, 2023 | 21 minute read
May 8th, 2023 - Instalment #156 Welcome Hello and welcome to the AWS open source newsletter, #156, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. So what do we have for you this week? Coming up later in this newsletter we have projects such as “sustainability-scanner” helps you check your Cloudformation templates against sustainability good practices, “synthtable” helps you create synthetic data for different use cases, “neptune-gremlin-client” a Java based Gremlin client, “s3zipper” a tool to quickly download entire S3 buckets, “chataws” a nice demo of how you can use ChatGPT to aid your AWS deployments, and plenty of other great projects.
-
AWS open source newsletter #155
Apr 29, 2023 | 20 minute read
May 1st, 2023 - Instalment #155 Welcome Hello and welcome to the AWS open source newsletter, #155, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. This week’s new projects include “aws-cloudformation-controller-for-flux” provides a way to use flux to orchestrate your CloudFormation deployments, “threat-composer” is a nice React based tool to help you create Threat Models for your systems and applications, “cdk-integ-tests-sample” a tool to allow you to do integration tests with your CDK stacks (these three were all featured in the latest episode of Build on Open Source, you can watch it here), “iam-access-key-report” generates reports from your AWS accounts about your AWS access keys, “personalize-kafka-connector” provides an integration into Apache Kafka for this AWS service, and more!
-
AWS open source newsletter #152
Apr 10, 2023 | 16 minute read
April 10th, 2023 - Instalment #152 Welcome Hello and welcome to the AWS open source newsletter, #152 an Easter special. This week sees more great new projects including, “redshift-test-drive” a set of essential tools for Amazon Redshift users, “simple-database-archival-solution” a nice tool to help you archive your data, “attribution-gen” a Go tool to help you build open source attribution documents, “aws-glue-data-catalog-federation” a library to help you federate your Glue catalog, “subnet-utilization-monitor-for-amazon-vpc” a handy tool to keep on top of your IP address allocation, “AlexaGPT” a demo of integrating Alexa with you know what, and more!
-
AWS open source newsletter #151
Apr 3, 2023 | 22 minute read
April 3rd, 2023 - Instalment #151 Welcome Hello and welcome to the AWS open source newsletter, #151. This week sees more great new projects, including those covered in the latest episode of Build on Open Source, such as “ec2-former2” a way to host this great project to reverse engineer your CloudFormation templates, “protonizer” a cli tool for those using AWS Proton, “fortuna”, a library for Uncertainty Quantification, “aws-resilience-hub-tools” a set of tools and scripts for working with the AWS Resilience Hub, “jenkins-unity-build-on-aws” a nice reference solution for those needing to build Unity projects, “amazon-cognito-passwordless-auth” a nice demo of how to do authentication sans password, and more.
-
AWS open source newsletter #149
Mar 19, 2023 | 14 minute read
March 20th, 2023 - Instalment #149 Welcome Hello and welcome to edition #149 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. I hope some of you were able to catch this episode reviewed on our last Build on Open Source livestream. If not, you can catch the replay here. This week we have projects such “mountpoint-s3”, “s3-access-for-squash”, and “amazon-s3-tar-tool” which provide some useful tools for managing your files on S3, “aws-serverless-ai-stories” a creative masterclass in storytelling, “earthquake-notifier” a serverless solution to keep you alerted and ready, and more!
-
AWS open source newsletter #146
Feb 27, 2023 | 17 minute read
Feb 27th, 2023 - Instalment #146 Welcome to edition #146 of the AWS open source newsletter. This week we have another great selection of brand new, shiny open source projects for you to practice your four freedoms on. Some of the projects this week include “aws-lambda-web-adapter” that will help you build portable Lambda functions, “aws-marketplace-cli” if you want to escape the GUI when working with AWS Marketplace, this one is for you, ““otel-config-validator” helps you sanity check your configuration files, “aws-serverless-openai-chatbot-demo” build a personal assistance powered by ChatGPT, “drone-video-analysis” if you have wanted to use AI services to process your drone video footage, check this project out, “mask-words-in-image” a nice command line tool to quick mask data based on your needs, and many more cool projects.
-
AWS open source newsletter #145
Feb 20, 2023 | 24 minute read
Feb 20th, 2023 - Instalment #145 Welcome to edition #145 of the AWS open source newsletter. I hope some of you were able to catch the new Build on Open Source show we live streamed last Friday. You can catch up and replay the session by clicking on this link, where we went over a number of projects from this and a few previous newsletters, and we had special guest Valter who walked us through his project terraform-dev-containers.
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #142
Jan 23, 2023 | 14 minute read
January 23rd, 2023 - Instalment #142 Welcome Welcome to edition #142 of the AWS open source newsletter. We have another great round up of new projects for you to get stuck into. Here are just a taste of some of the projects, kicking off with “sls-mentor” a new tool to help you assess your serverless applications, “subnet-watcher”, a tool to help you monitor your IP addresses, “aws-cdk-web-administered-apps” a very nice reference solution for applications that have a user and admin component, “serverless-newsletter-app” if you are looking for a newsletter solution and want to host your own, look here first, “aws-iot-with-privatelink” shows you how you use private networks for your IoT traffic, “emr-spark-benchmark” benchmarking tool for assessing your Amazon EMR environments, and “update-aws-ip-ranges” keep automatically updated on Amazon’s IP address ranges.
-
AWS open source newsletter #141
Jan 15, 2023 | 13 minute read
January 16th, 2023 - Instalment #141 Welcome Welcome to the AWS open source newsletter of 2023, edition #141. This week we have more new projects for you to practice your four freedoms, including “distributed-compute-on-aws-with-cross-regional-dask”, a solution to simplify distributed compute using Dask, “amazon-emr-serverless-image-cli” a tool to verify your Amazon EMR custom container images, “serverless-run-watch” a tool to help accelerate your local development if you are using the Serverless Framework, “aws-sso-auto-expand-accounts” a quick browser extension for those using AWS SSO, “basti” a cool Bastion Host alternative, “klotho” generate cloud native code from your code, “amazon-route53-hosted-zone-sync” a nice solution for hybrid DNS use cases, and many more.
-
AWS open source news and updates #139
Dec 18, 2022 | 19 minute read
December 18th, 2022 - Instalment #139 Welcome Welcome to the last AWS open source newsletter of 2022, edition #139. I am planning on take a few weeks off to recharge, and wish readers of this newsletter a fabulous Christmas and New Year. Over 100K of you have read this newsletter, so I want to thank you all for your continued support. This newsletter is only possible because of the passion and enthusiasm of open source Builders, and I look forward to seeing what 2023 will bring.
-
AWS open source news and updates #138
Dec 12, 2022 | 24 minute read
December 12th, 2022 - Instalment #138 Welcome Welcome to the AWS open source newsletter, edition #138. After a week off due to re:Invent, this edition is packed with content on many of the open source related announcements. As always, we have a great line up of new projects for you to practice your four freedoms on. In no particular order, we have projects like “eks-node-viewer”, a nice visualisation tool for your Amazon EKS clusters, “pg_tle” a great new project to make your PostgreSQL environments safer, “dyna53” a fun project that finally turns Amazon Route 53 into a database, “dynamodb-mass-migrations” a tool to help you migrate to Amazon DynamoDB, “visual-asset-management-system” a very nice digital asset management tool, “fast-differential-privacy” implement differential privacy in your PyTorch models, “migration-hadoop-to-emr-tco-simulator” a handy total cost of ownership calculator for Amazon EMR, “realtime-toxicity-detection” a tool to help you stay on top of your online communities, “functionclarity” a very cool tool to check the integrity of your serverless functions before executing, and many more.
- oss-newsletter
- aws open source
- Rez
- Terraform
- PostgreSQL
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Amazon EMR
- Apache Iceberg
- Apache Spark
- OpenZFS
- Ray
- MySQL
- Kubernetes
- Apache Kafka
- Open Invention Network
- AWS IoT Greengrass
- Ray
- Modin
- Amazon Corretto
- Firecracker
- DeeQu
- Open Cybersecurity Schema Framework
- ocsf
- AWS SDK for pandas
- Amazon Braket
- Yocto
- Log4shell
- MQTT
- Redis
- AWS CDK
- AWS Amplify
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #133
Oct 28, 2022 | 18 minute read
October 28th, 2022 - Instalment #133 Welcome Welcome to the AWS open source newsletter, edition #133. This week has been all about KubeCon, and there were some important announcements from AWS. If you missed these, I have tried to capture the important ones here, but I want to start off with probably my favourite which was the announcement during Nate Taber keynote on some of the investments we are providing to CNCF and OpenSSF.
-
AWS open source news and updates #132
Oct 21, 2022 | 20 minute read
October 21st, 2022 - Instalment #132 Welcome Welcome to the AWS open source newsletter, edition #132. This newsletter was covered in last Friday’s Build on Open Source, so if you missed it, don’t worry as you can view episode five of Build on Open Source. In this episode special guest Abhishek Gupta walked us through how to use cdk8s using Golang, building a Wordpress site in minutes. New projects this week include “duvet” a tool to help honour RFC in code, “aws-lambda-explorer” a gui tool to explore your AWS Lambda functions, “k3s-aws-terraform-cluster” deploy k3s on AWS via Terraform, “snow-transfer-tool” a tool to help you transfer data via Snowball devices, “amazon-emr-vscode-toolkit” a new VSCode plugin for Amazon EMR users, “aws-cdk-for-discourse” a quick way to deploy the open source discourse tool, “image-optimization” a reference example of how to do image optimising, and “gtfs-serverless-ticketing-sample” a sample application using public transport data.
-
AWS open source news and updates #131
Oct 17, 2022 | 17 minute read
October 17th, 2022 - Instalment #131 Welcome to the AWS open source newsletter, edition #131. This week’s new projects include “metahub”, a command line way to interact with AWS Security Hub, “somod” a framework for creating micro applications in serverless, “terraform-aws-guardduty-multiaccount” a Terraform module to help you automate your AWS Guard Duty configuration, “aws-glue-cdk-cicd” a sample project to automate the creation data pipelines using AWS Glue, “go-kafka-event-source” an Apache Kafka client in Go, “project-tools” a tool to help you get insights from your GitHub repo, “eks-event-watcher” a command line tool to tail your Amazon EKS logs, “listmonk-based-edm-solution” an example of how to deploy this open source mailing list tool, and many more.
-
AWS open source news and updates #130
Oct 10, 2022 | 17 minute read
October 10th, 2022 - Instalment #130 Welcome Welcome to the AWS open source newsletter, edition #130. This newsletter was featured in the Build on Open Source episode four, which you can check out here if you missed it. New projects for you to practice your open source four freedoms this week include “grucloud” a new infrastructure as code tool with some nice features, “stepfunctions-sdk-autocomplete” a VSCode plugin for all you AWS Step Functions fans, “AWS_Billing_Overage_Shutdown” a very new repo that has some code to help you automate shutting down resources on alerts, “aws-secrets-manager-github-action” if you are using GitHub Actions, this one is for you, “meta-aws”, tools and recipes for those using and building with Yocto, “data-on-eks” a number of sample solutions to configure self managed open source data analytics tools, “cql-replicator” a tool to help you migrate from self managed Apache Cassandra to Amazon Keyspaces, “ec2-imagebuilder-ami-lifecycle” provides some new capabilities for those building AMIs, and many more.
-
AWS open source news and updates #129
Sep 30, 2022 | 22 minute read
September 30th, 2022 - Instalment #129 Welcome Welcome to the AWS open source newsletter, edition #129. We have loads of great new projects this week, with plenty of variety to keep you all interested. We have “aws-ecr-cleaner”, a great tool to help you manage your container images, “dotnet-lambda-sql-server-proxy” that shows you how you can use RDS Proxy with SQL Server and why, “minecraft-server-dashboard” perfect for those running their own minecraft servers, “YATAS” and “aws-security-survival-kit” for those working on security and governance, “aws-lambda-handler-cookbook” useful recipes to get you going, “autonomous-driving-data-framework” for folks working in the automotive space, and many more - make sure you check all the projects out.
- oss-newsletter
- aws open source
- Apache TinkerPop
- Gremlin
- AWS CDK
- Apache Hudi
- Apache Iceberg
- Delta Lake
- Apache Cassandra
- GraphQL
- Hive
- Apache Spark
- Apache Kafka Streams
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache Airflow
- Keycloak
- Kubeapps
- Babelfish for PostgreSQL
- Linux
- Ubuntu
- PHP
- MySQL
- Bottlerocket
-
AWS open source news and updates #128
Sep 23, 2022 | 15 minute read
September 23rd, 2022 - Instalment #128 Welcome Welcome to the AWS open source newsletter, edition #128. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed our special guest, Gethin Webster as he walked us through the open source Cloudscape project. If you want to catch up on that event, check out the video here. This weeks opens new open source projects include “Guardian”, a command line tool that produces nice reports on your AWS environments, “cdk-scheduler”, a new construct that helps you schedule your CDK deployments, “terraform-iam-policy-validator” a script that helps you validate your Terraform scripts, “aws-cdk-golden-ami-pipeline” an example of how to build an automated pipeline to build Amazon Machine Images (AMI’s), and many more.
-
AWS open source news and updates #127
Sep 16, 2022 | 17 minute read
September 16th, 2022 - Instalment #127 Welcome Welcome to the AWS open source newsletter, edition #127. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed as our special guest, AWS Hero Ian Mckay walked us through some of his open source projects. It was very cool indeed, and if you have not yet watched, Ian shares an early glimpse of a new project - so make sure you check that out.
-
AWS open source news and updates #125
Sep 2, 2022 | 20 minute read
September 2nd, 2022 - Instalment #125 Welcome After a couple of weeks off, it is great to welcome to back to the AWS open source newsletter, edition #125. As it has been a couple of weeks, this edition contains even more open source goodness to keep you occupied. As always, we kick things off we a round up of new open source projects. Over the past couple of weeks, there were so many that it was hard to select them (I will include the others in next weeks newsletter).
-
AWS open source news and updates #124
Aug 12, 2022 | 15 minute read
August, 12th, 2022 - Instalment #124 Welcome Welcome to edition #124 of the AWS open source newsletter. This is a very special edition as this will be the first edition that we cover in the new Build on AWS Open Source fortnight show on twitch.tv/aws. I hope some of you were able to attend, but if not don’t worry we will be sharing links to the recording. To keep up to date on future episodes, make sure you follow @buildonopen.
-
AWS open source news and updates #122
Jul 29, 2022 | 14 minute read
July 29th, 2022 - Instalment #122 Welcome Welcome back to my regular readers and hello to new readers, I hope you will enjoy and come back again to the AWS open source newsletter episode #122. This week we have another great collection of community and AWS related open source tools, demos and samples for you to practice your open source four freedoms. “rds_auto_encrypt” helps you encrypt your Amazon RDS databases, “middy-profiler” is an interesting looking tool to help you understand performance characteristics of your AWS Lambda functions, “simpleiot” is a very nice looking IoT framework to help simplify how you can onboard devices into AWS IoT, “aws-secrets-manager-hybrid-secret-replication-from-hashicorp-vault” (bit of a mouthful to say that one) helps you synchronise your secrets across different secret providers, “automated-forensic-orchestrator-for-amazon-ec2” is a very nice reference solution for automating some of your operational security activities, and we have several other projects for you to dive deep into.
-
AWS open source news and updates #119
Jul 1, 2022 | 15 minute read
July 1st, 2022 - Instalment #119 Welcome to regular and new readers alike, to the AWS open source newsletter episode #119. This week we feature more new open source projects, such as “cdk-bill-bot”, a tool that can help you reduce AWS bill surprises, “steampipe-mod-aws-perimeter” helps you look for resources that are publicly accessible, “aws-cloudformation-diagrams” is a nice visualisation tool for CloudFormation users, “aws-swagger-ui” a project to help you set up Swagger UI for API Gateway, “kinesis-hot-shard-advisor” a handy tool that helps you identify whether you have hot key or hot shard issues on your Kinesis data streams, and many more.
-
AWS open source news and updates #117
Jun 17, 2022 | 16 minute read
June 17th, 2022 - Instalment #117 Welcome to regular and new readers alike, to the AWS open source newsletter episode #117. A little behind schedule this week, as I have been speaking at a couple of events this week. It has been good to get back on the stage and to talk and engage with real people. It seems that things are quickly returning back to normal. So this week we have some great new projects for you.
-
AWS open source news and updates #116
Jun 10, 2022 | 16 minute read
June 10th, 2022 - Instalment #116 Welcome to regular and new readers alike, to the AWS open source newsletter episode #116. Another selection of useful and interesting new open source projects for you to try out this week. First up, we have “aws-exec” a tool to help you do adhoc shell execution in AWS Lambda functions, “edgy” helps you simplify writing tests for Node.js based AWS CloudFront Lambda@Edge functions, “cdk-app-cli” a really nice cli that every AWS CDK user should know about, “Accumulus” a great looking reporting tool for AWS Lambda users, “sqldef-gitops-cdk” is a schema management for several open source databases, “log-hub” helps you to build your own log analytics tool using OpenSearch, “verifiable-controls-evidence-store” a very cool solution that builds a mechanism to centrally store findings and results of cloud security controls governing AWS workloads, and many more!
-
AWS open source news and updates #115
Jun 3, 2022 | 17 minute read
June 3rd, 2022 - Instalment #115 Welcome to regular and new readers alike, to the AWS open source newsletter episode #115. This week we have another great selection of brand new open source projects for you to explore, including “firec” a Rust client library for interacting with Firecracker, “sfn-cli” a tool that helps you quickly build StepFunctions definitions, “ssm-cloner” a tool to help you replicate across AWS regions your AWS System Manager documents, “amazon-lambda-compute-tuning” an AWS Lambda function benchmarking tool, “aws-iam-root-user-activity-monitor” a sample project to help you keep track of your root user, “hpc-cost-simulator” a tool to help estimate costs running your HPC workloads on AWS, and many more.
-
AWS open source news and updates #109
Apr 22, 2022 | 21 minute read
April 22nd, 2022 - Instalment #109 Newsletter #109. Welcome to edition #109 of the AWS open source newsletter. Big news, I have shaken things up and will be changing the publish date to Friday mornings, starting today with this edition. Over the months I have received some feedback about changing the published date to Fridays, so I am hoping this will give everyone plenty of time to check out the projects, read the posts and provide everyone with something to do over the weekend (if they want!
-
AWS open source news and updates #107
Apr 4, 2022 | 17 minute read
April 4th, 2022 - Instalment #107 Newsletter #107. Welcome to edition #107 of the AWS open source newsletter, and we have a bumper edition this week packed with more great new open source projects and content for you to consume. Topics featured this week include optimising open source big data tools, developer tooling, case studies and we even some some great open source content for .NET core developers. This weeks projects include a really nice handy browser plugin called “aws-search-extension”, that lets you search and find developer information from the AWS docs, a tool that will help you detect whether you have configured or using dockershim in your Kubernetes clusters, a library to help you integrate Amazon Cognito in your Laravel PHP applications, and plenty more developer tools and sample projects.
-
AWS open source news and updates #104
Mar 14, 2022 | 17 minute read
March 14th, 2022 - Instalment #104 Newsletter #104. Welcome to #104 of the AWS open source news and updates newsletter, bringing you the latest updates from around the AWS and Communities. This week we have yet more great new open source projects, including a Deno runtime for your Lambda functions, data lineage and data testing tools, a performance testing tool for Apache Kafka, an ELT tool for Amazon Redshift, an Amazon S3 archive tool, and many more.
-
AWS open source news and updates #101
Feb 21, 2022 | 12 minute read
Feb 21st, 2022 - Instalment #101 Newsletter #101. There is nothing basic and fundamental about edition 101 of the AWS open source newsletter, with another great round up of new open source projects including eks-creation-engine from the folks at Lightspin helping you all to stay safer with this handy tool you should check out, idp-scim-sync to help users of AWS SSO who want to synchronise with their Google Workspace Directory, typecart an analysis tool for proof evolution and many other great projects and sample code.
-
AWS open source news and updates #99
Feb 7, 2022 | 12 minute read
Feb 7th, 2022 - Instalment #99 Newsletter #99. While Nena gave you 99 red balloons, I give you the latest version of the AWS open source news letter. This week we feature more great new open source projects including a project to help you with drift detection in your CloudFormation stacks, new Terraform modules, an open-source prometheus exporter, some AWS CDK resources and sample projects and more. This weeks AWS and Community posts cover PostgreSQL, Apache Airflow, AWS CDK, Redis, GraphQL, Apollo GraphQL, Kubernetes, AWS EKS and more.
-
AWS open source news and updates #98
Jan 29, 2022 | 14 minute read
Jan 31st, 2022 - Instalment #98 Newsletter #98. Welcome to another edition of AWS open source news and updates, featuring more new open source projects. This week, these include eventbridge-assistant (a VScode plugin to help you whilst you are developing with Amazon EventBridge), stratus-red-team (a tool you can use to emulate offensive attack techniques), critter (AWS Config rule integration testing), syne-tune-s3-transfer (an example of how to apply the distributed parameter search library to optimise download performance), karpenter-terraform (a Terraform module to help you automate deployment of karpenter), and a couple of super interesting open source solutions covering last mile delivery and software defined radio.
-
AWS open source news and updates #97
Jan 22, 2022 | 12 minute read
Jan 22nd, 2022 - Instalment #97 Newsletter #97. Welcome to another edition of the AWS open source newsletter, packed with more great new open source projects, content, and events. This week, we have new projects that help you improve security by de-obfuscating strings, a library to help you automate the configuration of your build pipelines, a new Terraform module, a nice new VSCode plugin that will help you when working with IAM, and several more.
-
AWS open source news and updates #95
Jan 10, 2022 | 19 minute read
Jan 10th, 2022 - Instalment #95 Newsletter #95. Feliz Ano and a very happy new year to you all in this first newsletter in 2022. In this weeks update I reflect on some of the interesting stuff I learnt running this newsletter in 2021, before diving into the usual round up of new open source projects, AWS and community blog posts, videos and events. This weeks projects include tfdevops, a tool for Terraform uses to integrate with DevOps Guru, a tool to validate your custom container images on Amazon EMR, a Python wrapper for DynamoDB local and more.
-
Using AWS CDK to deploy your Amazon Managed Workflows for Apache Airflow environment
Apr 28, 2021 | 11 minute read
update I am grateful to Michael Grabenstein for spotting some mistakes in the original post/code. I hope these have now been rectified in this post. Using AWS CDK to deploy your Amazon Managed Workflows for Apache Airflow environment What better way to celebrate CDK Day than to return to a previous blog where I wrote about automating the installation and configuration of Amazon Managed Workflows for Apache Airflow (MWAA), and take a look at doing the same thing but this time using AWS CDK.
-
Automating the installation and configuration of Amazon Managed Workflows for Apache Airflow
Jan 26, 2021 | 15 minute read
updated, August 25th Thanks to Philip T for spotting a typo in the cloudformation code below - it is ok in the GitHub repo, but I have fixed it now below. Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow <- this post Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow environments Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 1, automating the installation and configuration of Managed Workflows for Apache Airflow (MWAA).
-
Amazon Aurora - setting up and configuration, four ways
Oct 15, 2020 | 8 minute read
In this post I want to share four different approaches to installing and configuring your Amazon Aurora database clusters. Everything in this post is covered in detail in the embedded video, but I wanted to share some additional information that I did not include in the video that was easier done in this blog. {% youtube wZfh9PurE9E %} Why four ways? The approach in the video was to look at the journey you might take when learning a new technology and then how you move to productise that technology.