AWS ParallelCluster
-
AWS open source newsletter #209
Apr 29, 2025 | 23 minute read
Edition #209 - April 2025 Welcome to issue #209 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I am publishing this from the AWS Summit London, and it has been great to speak to so many of the AWS community about open source - it is very much alive and thriving, so thank you all! As always, in this edition we have more great new projects to check out, which include a bumper selection of the current hot topic that is Model Context Protocol (MCP).
- oss-newsletter
- aws open source
- Ruby
- Apache Airflow
- MWAA
- Amazon EKS
- Kubernetes
- Bottlerocket
- Karpenter
- PostgreSQL
- Apache Iceberg
- Apache OFBiz
- Apache Flink
- Prometheus
- Grafana
- AWS Amplify
- Spring Boot
- LangChain
- Valkey
- LangGraph
- MLFlow
- AuthZen
- Amazon Corretto
- AWS CDK
- Apache Kafka
- memecachd
- AWS ParallelCluster
- Amazon Linux
- Swift
-
AWS open source newsletter #201
Jul 10, 2024 | 28 minute read
Edition #201 Welcome to the AWS open source newsletter, issue #201, your trusted source for the very best open source on AWS content. This weeks new projects for you to practice your four freedoms include generative AI infused projects to help you generate your docs, streamline the setting up of your AWS resources, a new experimental framework for building document based workflows, and a cool demo that showcases how you can use generative AI to help translate American Sign Language.
- oss-newsletter
- aws open source
- PHP
- Apache Airflow
- MWAA
- Node.js
- LLRT
- Kubernetes
- Amazon EKS
- Prometheus
- Grafana
- eksctl
- Valkey
- LangChain
- Project Lakechain
- AWS Amplify
- Itsio
- Apache Iceberg
- Apache Kafka
- Apache Cassandra
- PyTorch
- Apache httpd
- Babelfish for Aurora PostgreSQL
- Apache Flink
- PostgreSQL
- MySQL
- OpenSearch
- OpenZFS
- Amazon Linux
- FreeRTOS
- RabbitMQ
- AWS ParallelCluster
- Open Container Initiative
- Smithy
- Cedar
- sbt
-
AWS open source newsletter #200
Jun 24, 2024 | 20 minute read
Edition #200 Welcome to a milestone edition of this newsletter, number #200!! Wow, it feels like quite an achievement. Before diving into this newsletter, a big thank you for sticking with me. Time has flown by so quickly, and am looking forward to the next 100. As I have done in a few of the previous milestone issues, I wanted to share a few interesting stats from sharing open source projects with you over the past few years.
-
AWS open source newsletter #199
Jun 10, 2024 | 18 minute read
Edition #199 Welcome to issue #199 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I cannot believe that we are one issue away from a pretty significant milestone. I would love to hear from some of the regular readers of this newsletter to find any highlights they have had, or perhaps things they have found that have been pretty significant.
-
AWS open source newsletter #194
Apr 3, 2024 | 21 minute read
Edition #194 Welcome to issue #194 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Due to travelling and speaking commitments, regular readers will have noticed that I slipped up and missed a week. Normal service has been resumed, and as always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms.
-
AWS open source newsletter #193
Mar 18, 2024 | 16 minute read
Edition #193 Welcome to issue #193 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Sadly I will be missing the fun at KubeCon in Paris, but if you are attending, make sure to check out the AWS booth - I had a sneak peak at what you can expect, and there is going to be some great demos being shown, a lot of our open source folk will be there.
-
AWS open source newsletter #188
Feb 12, 2024 | 15 minute read
Edition #188 Welcome to issue #188 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have freshly cut repos that help you migrate your DNS configurations, improve your prompts when working with large language models, a new lightweight Javascript runtime, some reference code that shows you how you can deploy modern Java applications a number of different ways, and sample repos that show you how you can do remote debugging in Amazon EMR, as well as the usual cool demos that showcase some of the ways you can use generative AI.
-
AWS open source newsletter #184
Jan 15, 2024 | 17 minute read
Edition #184 Welcome to issue #184 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have a rust based cli tools to help you accelerate your S3 searches, we take a look at a new framework to help simplify bootstrapping your projects, a tool to help you report on your AWS resource tags, a voice translator for Chime, a really nice sample project to help you get hands on with Cedar, a number of generative AI demos and sample projects that are a must, and many more projects.
-
AWS open source newsletter #183
Jan 8, 2024 | 26 minute read
January 8th, 2024 - Instalment #183 Happy new year and welcome to the first edition of the AWS open source newsletter of 2024, number #183. The big news for 2024 is the move from dev.to to community.aws as the “home” for the AWS open source newsletter, although it will still be posted on dev.to as well. Let me know what you think, community.aws has some top notch content that many readers might not be aware of.
- oss-newsletter
- aws open source
- Cedar
- Projen
- Prometheus
- Grafana
- Kubernetes
- Amazon EKS
- Mage
- OpenSearch
- AWS CDK
- eBPF
- Istio
- Kubecost
- PostgreSQL
- MySQL
- MariaDB
- ActiveMQ
- Apache Airflow
- MWAA
- Apache Spark
- Ray
- AWS Amplify
- Spring Boot
- Amazon EMR
- AWS Neuron
- Apache Cassandra
- OpenTelemetry
- Amazon Linux
- AWS ParallelCluster
- RabbitMQ
-
AWS open source newsletter #172
Sep 4, 2023 | 21 minute read
September 4th, 2023 - Instalment #172 Welcome to #172 of the AWS open source newsletter, your reliable source for all open source on AWS goodness. What do we have for you this week? Well, more new projects to check out, and plenty of fresh content on the open source projects you all love. We have tools to help you export your DynamoDB tables as csv files, a tool that goes beyond tracking cost and actually shuts down resources to help you manage your AWS budget, a cool dashboard to help you stay on top of your EC2 configurations, a couple of useful utilities to simplify working with files on Amazon S3, and then a sample Cedar project that helps you implement a Lambda authoriser.
-
AWS open source newsletter #169
Aug 14, 2023 | 26 minute read
August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications.
- oss-newsletter
- aws open source
- OpenSearch
- AWS CDK
- Juypter AI
- dbt
- Apache Airflow
- Managed Workflows for Apache Airflow
- MWAA
- Cedar
- cfnguard
- Grafana
- Prometheus
- Apache Kafka
- Amazon Timestream
- Open Cybersecurity Schema Framework
- OCSF
- AWS Lambda Web Adapter
- Smithy
- Apache Spark
- Linux
- Amazon Linux
- AWS ParallelCluster
- PostgreSQL
- Spring Boot
- Amazon EKS
- Kubernetes
- Mountpoint for Amazon S3
- MySQL
- Lustre
- OpenZFS
- Redis
- Amazon EMR
- Karpenter
- Seekable OCI
- SOCI
- Firecracker
-
AWS open source newsletter #164
Jul 10, 2023 | 17 minute read
July 10th, 2023 - Instalment #164 Welcome to #164 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. New projects this week will help you implement single table designs easily on Amazon DynamoDB, an experimental project to help you get to grips with Cedar, a comprehensive clickstream analytics project for your applications, web sites, and mobile applications, and some cool projects to help you with edge and hybrid use cases.
- oss-newsletter
- aws open source
- Apache Flink
- Apache Airflow
- Kubernetes
- Amazon EKS
- AWS Lambda Powertools
- Spring Boot
- Linux
- Apache Parquet
- OpenZFS
- OpenSearch
- Mountpoint for Amazon S3
- PostgreSQL
- AWS Amplify
- Next.js
- AWS Distro for OpenTelemetry
- Grafana
- Babelfish for Aurora PostgreSQL
- AWS ParallelCluster
- Consul
- Apache Iceberg
- Cedar
- Steampipe
- VS Code Server
- nomad
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #158
May 30, 2023 | 21 minute read
May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you.
-
AWS open source newsletter #146
Feb 27, 2023 | 17 minute read
Feb 27th, 2023 - Instalment #146 Welcome to edition #146 of the AWS open source newsletter. This week we have another great selection of brand new, shiny open source projects for you to practice your four freedoms on. Some of the projects this week include “aws-lambda-web-adapter” that will help you build portable Lambda functions, “aws-marketplace-cli” if you want to escape the GUI when working with AWS Marketplace, this one is for you, ““otel-config-validator” helps you sanity check your configuration files, “aws-serverless-openai-chatbot-demo” build a personal assistance powered by ChatGPT, “drone-video-analysis” if you have wanted to use AI services to process your drone video footage, check this project out, “mask-words-in-image” a nice command line tool to quick mask data based on your needs, and many more cool projects.
-
AWS open source newsletter #145
Feb 20, 2023 | 24 minute read
Feb 20th, 2023 - Instalment #145 Welcome to edition #145 of the AWS open source newsletter. I hope some of you were able to catch the new Build on Open Source show we live streamed last Friday. You can catch up and replay the session by clicking on this link, where we went over a number of projects from this and a few previous newsletters, and we had special guest Valter who walked us through his project terraform-dev-containers.
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #140
Jan 9, 2023 | 19 minute read
January 9th, 2023 - Instalment #140 Welcome Happy New Year and welcome to the first AWS open source newsletter of 2023, edition #140. If you have not already checked it out, I put together a short retrospective summary of 2022 in the post, AWS open source newsletter - 2022 in review. There are some interesting facts and figures in there. I am also taking time to collect feedback from readers to help shape where this newsletter goes in 2023.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- Next.js
- AWS SDK for Java
- AWS ParallelCluster
- Docker
- MariaDB
- Amazon EKS
- Kubernetes
- MQTT
- ArgoCD
- AWS Distro for OpenTelemetry
- Prometheus
- DAMON
- Crossplane
- Log4Shell
- .NET
- Apache Spark
- Apache Kafka
- Apache Flink
- Apache Pinot
- Apache Superset
- Apache NiFi
- Delta Lake
- OpenShift
- Redis
- Red Hat Enterprise Linux
- SUSE Linux Enterprise Server
- Ubuntu Pro
- AWS Copilot
- RabbitMQ
- Apache Airflow
- Rust
- Terraform
- Amazon EMR
- Apache ShardingSphere-Proxy
-
AWS open source news and updates #137
Nov 25, 2022 | 30 minute read
November 25th, 2022 - Instalment #137 Welcome Welcome to the AWS open source newsletter, edition #137. As it is re:Invent next week, I will be publishing the newsletter early as I am heading out on Monday. I will be in Las Vegas talking with open source Builders, hanging out on the Open Source Kiosk in the AWS Village, and doing some talks. If you are coming, I would love to meet some of you, so get in touch.
- oss-newsletter
- aws open source
- re:Invent
- GraphQL
- Grafana
- Prometheus
- AWS Toolkits for JetBrains
- AWS Toolkits for VS Code
- AWS Amplify
- NodeJS
- MariaDB
- PostgreSQL
- Flutter
- React
- Apache Iceberg
- Apache Airflow
- Apache Flink
- Apache ShardingSphere
- AutoGluon
- AWS ParallelCluster
- Kubeflow
- NGINX
- Finch
- Amazon EMR
- Trino
- Apache Hudi
- O3DE
- Apache Kafka
- OpenSearch
- MLFlow
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #127
Sep 16, 2022 | 17 minute read
September 16th, 2022 - Instalment #127 Welcome Welcome to the AWS open source newsletter, edition #127. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed as our special guest, AWS Hero Ian Mckay walked us through some of his open source projects. It was very cool indeed, and if you have not yet watched, Ian shares an early glimpse of a new project - so make sure you check that out.
-
AWS open source news and updates #122
Jul 29, 2022 | 14 minute read
July 29th, 2022 - Instalment #122 Welcome Welcome back to my regular readers and hello to new readers, I hope you will enjoy and come back again to the AWS open source newsletter episode #122. This week we have another great collection of community and AWS related open source tools, demos and samples for you to practice your open source four freedoms. “rds_auto_encrypt” helps you encrypt your Amazon RDS databases, “middy-profiler” is an interesting looking tool to help you understand performance characteristics of your AWS Lambda functions, “simpleiot” is a very nice looking IoT framework to help simplify how you can onboard devices into AWS IoT, “aws-secrets-manager-hybrid-secret-replication-from-hashicorp-vault” (bit of a mouthful to say that one) helps you synchronise your secrets across different secret providers, “automated-forensic-orchestrator-for-amazon-ec2” is a very nice reference solution for automating some of your operational security activities, and we have several other projects for you to dive deep into.
-
AWS open source news and updates #116
Jun 10, 2022 | 16 minute read
June 10th, 2022 - Instalment #116 Welcome to regular and new readers alike, to the AWS open source newsletter episode #116. Another selection of useful and interesting new open source projects for you to try out this week. First up, we have “aws-exec” a tool to help you do adhoc shell execution in AWS Lambda functions, “edgy” helps you simplify writing tests for Node.js based AWS CloudFront Lambda@Edge functions, “cdk-app-cli” a really nice cli that every AWS CDK user should know about, “Accumulus” a great looking reporting tool for AWS Lambda users, “sqldef-gitops-cdk” is a schema management for several open source databases, “log-hub” helps you to build your own log analytics tool using OpenSearch, “verifiable-controls-evidence-store” a very cool solution that builds a mechanism to centrally store findings and results of cloud security controls governing AWS workloads, and many more!
-
AWS open source news and updates #100
Feb 14, 2022 | 12 minute read
Feb 14th, 2022 - Instalment #100 Newsletter #100. Happy Valentines everyone, and welcome to this landmark 100st edition of this newsletter. This week we celebrate the love that many builders have for open source with more great new open source projects and content. Cuddle up to new projects that will help you build scalable systems, simplify your work with AWS DynamoDB, integrate your .NET applications with OpenSearch, keep on top of your VPC networks, and more.
-
AWS open source news and updates #97
Jan 22, 2022 | 12 minute read
Jan 22nd, 2022 - Instalment #97 Newsletter #97. Welcome to another edition of the AWS open source newsletter, packed with more great new open source projects, content, and events. This week, we have new projects that help you improve security by de-obfuscating strings, a library to help you automate the configuration of your build pipelines, a new Terraform module, a nice new VSCode plugin that will help you when working with IAM, and several more.