OpenSearch
-
AWS open source newsletter #181
Nov 27, 2023 | 20 minute read
November 27th, 2023 - Instalment #181 Welcome to #181 of the AWS open source newsletter, the place for all your AWS and open source needs. As some of you will know, this is re:Invent week, where many of my colleagues and tens of thousands of developers will be congregating to learn about Cloud, and hopefully discover plenty of open source goodness too. If you are going, make sure to visit the open source booth in the Expo floor.
- oss-newsletter
- aws open source
- Griptape
- PyTorch
- AWS Amplify
- NextJS
- WordPress
- OpenJDK
- Amazon Corretto
- PostgreSQL
- OpenSearch
- SnapStart
- Kong
- AWS Copilot
- MySQL
- dbt
- Apache Hudi
- Apache Flink
- Kubernetes
- Amazon EKS
- Kali
- Karpenter
- Istio
- LangChain
- Pinecone
- Amazon EMR
- Apache Spark
- Prometheus
- Lustre
- OpenZFS
- Apache Kafka
- Lambda PowerTuning
-
AWS open source newsletter #179
Nov 13, 2023 | 18 minute read
November 13th, 2023 - Instalment #179 Welcome to #179 of the AWS open source newsletter, the place for all your AWS and open source needs. This weeks new projects include an open source tool that provides similar capabilities to AWS Control Tower, a tool for enrolling your Mac based EC2 instances into mobile device management (MDM) solution, a very neat tool to help you compare costs of running your CodePipeline jobs, as well as sample code that shows you how you can use Karpenter to optimise IP address use, examples of using Test Containers with AWS CDK, generative AI technologies such as LangChain, and more.
-
AWS open source newsletter #178
Nov 6, 2023 | 19 minute read
November 6th, 2023 - Instalment #178 Welcome to #178 of the AWS open source newsletter, the place for all your AWS and open source needs. This week we feature more new open source projects for you to practice your four freedoms. We have a useful tool that helps you synchronise your AWS Identity Centre users with the users you provision in your Amazon RDS databases, we share the AWS data solutions framework that helps you build data solutions following opinionated best practices, a resource explorer for your AWS accounts, a guardrails solution for your AWS account, and a couple of demo repositories that take a look at Localstack and RSS.
-
AWS open source newsletter #177
Oct 30, 2023 | 19 minute read
October 30th, 2023 - Instalment #177 Welcome to #177 of the AWS open source newsletter, the Halloween special. You will find no tricks in this edition, only treats, with more new projects for you to check out and content that are a feast for your eyes. This weeks new projects include a tool to help you easily deploy vector databases on Kubernetes, an observability toolkit, a tool to help you benchmark network latency, as well as lots of new demos on generative AI.
- oss-newsletter
- aws open source
- Bottlerocket
- KubeArmor
- NGINX
- Wordpress
- Milvus
- Falcon-40B
- JupyterHub
- Dask
- Flux GitOps
- Crossplane
- Kubernetes
- Amazon EKS
- Babelfish for Aurora PostgreSQL
- PostgreSQL
- Linux
- Apache Hive
- Apache Spark
- Apache Kafka
- Apache Hudi
- Delta Lake
- Apache Iceberg
- OpenSearch
- Dremio
- OpenShift
- OpenCLIP
- Apache Airflow
- MWAA
- Amazon Corretto
- OpenJDK
- AWS CDK
-
AWS open source newsletter #176
Oct 23, 2023 | 19 minute read
October 23rd, 2023 - Instalment #176 Welcome to #176 of the AWS open source newsletter, heading into Autumn and getting ready for the clocks to go back later in the week. How will you use that extra hour? Well, perhaps some of you might use it to check out this weeks new projects, which include a nice cli chat tool that uses Amazon Bedrock, a tool to help simplify deploying VSCode in the Cloud environments, and sample demos and code on chaos engineering, deploying Amazon Bedrock via AWS Lambda, and how you can use IAM Roles Anywhere to authenticate against external identity providers.
- oss-newsletter
- aws open source
- LangChain
- Trivy
- AWS CDK
- Apache Spark
- Pinecone
- Redis
- Postgres
- pgVector
- OpenSearch
- ClickHouse
- Chroma
- Apache Iceberg
- CfnGuard
- Kubernetes
- Amazon EKS
- Karpenter
- Kubecost
- Amazon Corretto
- NextJS
- AWS Amplify
- GraphQL
- Ray
- AWS Distro for OpenTelemetry
- Grafana
- Core WCF
- AWS SAM
- Amazon EMR on EKS
- RabbitMQ
- Swift
-
AWS open source newsletter #174
Sep 18, 2023 | 18 minute read
September 18th, 2023 - Instalment #174 Welcome to #174 of the AWS open source newsletter, which will be the last one for a couple of weeks as I take some time off to recharge. I will be back in early October with more open source goodness, but in the meantime, you still have this edition packed with open source goodness. This weeks new projects include a Rust tool to help you keep your CloudFormation stacks up to date, a tool to help upload files to Amazon S3, a generative AI tool that aims to help you review and detect IAM configuration issues, an updated JDBC driver for connecting to Amazon Aurora, and more.
-
AWS open source newsletter #173
Sep 11, 2023 | 22 minute read
September 11th, 2023 - Instalment #173 Welcome to #173 of the AWS open source newsletter, bringing you all the news and latest projects for AWS developers. This weeks new projects include a Golang based SDK for kernel eBPF operations, a project that helps you to optimise your network performance, a couple of projects for Apache Flink users, as well as a handful of different tools and demos featuring open source technologies helping to drive innovation in generative AI.
-
AWS open source newsletter #172
Sep 4, 2023 | 21 minute read
September 4th, 2023 - Instalment #172 Welcome to #172 of the AWS open source newsletter, your reliable source for all open source on AWS goodness. What do we have for you this week? Well, more new projects to check out, and plenty of fresh content on the open source projects you all love. We have tools to help you export your DynamoDB tables as csv files, a tool that goes beyond tracking cost and actually shuts down resources to help you manage your AWS budget, a cool dashboard to help you stay on top of your EC2 configurations, a couple of useful utilities to simplify working with files on Amazon S3, and then a sample Cedar project that helps you implement a Lambda authoriser.
-
AWS open source newsletter #171
Aug 29, 2023 | 18 minute read
August 29th, 2023 - Instalment #171 Welcome to #171 of the AWS open source newsletter, the newsletter created for developers passionate about open source. Thanks to the wonderful August bank holiday here in the UK, we are publishing a day later than usual. If you have not read this newsletter before, we feature new projects, content from across the open source and AWS community, and share events and videos that you should check out.
-
AWS open source newsletter #169
Aug 14, 2023 | 26 minute read
August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications.
- oss-newsletter
- aws open source
- OpenSearch
- AWS CDK
- Juypter AI
- dbt
- Apache Airflow
- Managed Workflows for Apache Airflow
- MWAA
- Cedar
- cfnguard
- Grafana
- Prometheus
- Apache Kafka
- Amazon Timestream
- Open Cybersecurity Schema Framework
- OCSF
- AWS Lambda Web Adapter
- Smithy
- Apache Spark
- Linux
- Amazon Linux
- AWS ParallelCluster
- PostgreSQL
- Spring Boot
- Amazon EKS
- Kubernetes
- Mountpoint for Amazon S3
- MySQL
- Lustre
- OpenZFS
- Redis
- Amazon EMR
- Karpenter
- Seekable OCI
- SOCI
- Firecracker
-
AWS open source newsletter #168
Aug 7, 2023 | 24 minute read
August 7th, 2023 - Instalment #168 Welcome to #168 of the AWS open source newsletter, the only newsletter that features the freshest open source and AWS content* New projects for you to feast on in this issue include the obligatory projects that look at how Generative AI can help developers be more productive, in this case by making documentation more relevant and easier to find and to help with code reviews, a nice tool to help you query your AWS Identity Access Management (IAM) policies, and a security focused tool to help you search for potentially incorrect configured S3 buckets.
-
AWS open source newsletter #167
Jul 31, 2023 | 22 minute read
July 31st, 2023 - Instalment #167 Welcome to #167 of the AWS open source newsletter, and another edition packed with new open source projects for you to explore. Whether you are new to this newsletter, or returning (we thank you!) there is something for you. This week we have projects that will help use Terraform to deploy your monolith applications, a tool to accelerate your GraphQL building when working with Amazon DynamoDB, a project that will help you introduce chaos without changes to your code, and a couple of really nice demos of using generative AI that allows you to use natural language to query your data.
- oss-newsletter
- aws open source
- Terraform
- Rust
- LangChain
- Streamlit
- PostgreSQL
- Supabase
- OpenSearch
- AWS SAM
- AWS CDK
- Powertools for AWS Lambda
- Open Application Model
- OAM
- Traefik
- Keycloak
- FastAPI
- PyTorch
- MySQL
- IAM Roles Anywhere
- Apache Iceberg
- MQTT
- Amazon EMR
- Kubernetes
- Amazon EKS
- Apache Hudi
- Go
- Cedar
- RabbitMQ
- Pacu
-
AWS open source newsletter #166
Jul 24, 2023 | 22 minute read
July 24th, 2023 - Instalment #166 Welcome to #166 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks new projects include a library to help you managed and validate your environment variables when working with AWS Lambda, a new Rust based tool for interacting with your S3 buckets, an essential tool to help CDK developers remove a lot of the setup work, and a tool that helps you run Yocto embedded Linux build jobs in AWS.
-
AWS open source newsletter #165
Jul 17, 2023 | 17 minute read
July 17th, 2023 - Instalment #165 Welcome to #165 of the AWS open source newsletter, the only* newsletter that brings you the best and latest open source content. We have some great new projects this week, including a tool for IoT developers to help you validate your SQL statements, a command line interface tool for Amazon Verified Permissions, an Amazon DynamoDB estimation tool, and more. Also featured this week is content on Apache Iceberg, OpenSearch, PostgreSQL, Kubernetes, Power Tools for AWS Lambda, Spring Boot, Babelfish for Aurora PostgreSQL, Karpenter, Apollo GraphQL, JupyterHub, dbt, Apache Airflow, Cedar, and Apache Flink.
-
AWS open source newsletter #164
Jul 10, 2023 | 17 minute read
July 10th, 2023 - Instalment #164 Welcome to #164 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. New projects this week will help you implement single table designs easily on Amazon DynamoDB, an experimental project to help you get to grips with Cedar, a comprehensive clickstream analytics project for your applications, web sites, and mobile applications, and some cool projects to help you with edge and hybrid use cases.
- oss-newsletter
- aws open source
- Apache Flink
- Apache Airflow
- Kubernetes
- Amazon EKS
- AWS Lambda Powertools
- Spring Boot
- Linux
- Apache Parquet
- OpenZFS
- OpenSearch
- Mountpoint for Amazon S3
- PostgreSQL
- AWS Amplify
- Next.js
- AWS Distro for OpenTelemetry
- Grafana
- Babelfish for Aurora PostgreSQL
- AWS ParallelCluster
- Consul
- Apache Iceberg
- Cedar
- Steampipe
- VS Code Server
- nomad
-
AWS open source newsletter #163
Jul 3, 2023 | 13 minute read
July 3rd, 2023 - Instalment #163 Welcome to #163 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks featured projects include a Cedar authorisation service and demo examples, a tool to help you find dangling DNS records, a new CLI for those using Amazon ECR, an accelerator for observability on AWS, a serverless web analytics solution (so good, that I implemented it myself), and several more projects.
-
AWS open source newsletter #162
Jun 26, 2023 | 18 minute read
June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions.
-
AWS open source newsletter #161
Jun 19, 2023 | 19 minute read
June 19th, 2023 - Instalment #161 Welcome to #161 of the AWS open source newsletter, and another week for fresh, new open source projects and code for you to practice your four freedoms. This weeks projects include tools that will help you create temporary elevated credentials, a new Java library that provides methods for encrypting and decrypting cryptographic materials, an AWS DynamoDB wrapper for Node/TypeScript developers, and a solution to help you find and visualise data assets.
- oss-newsletter
- aws open source
- Falcon
- AWS CDK
- Keycloak
- Cedar
- FreeRTOS
- Apache Airflow
- MWAA
- Apache Spark
- Amazon EMR
- Apache Hudi
- Apache Iceberg
- and Delta Lake
- Apache Flink
- OpenChatkit
- Kubernetes
- Pinniped
- Kubecost
- Karpenter
- ONNX
- Apache Kafka
- Babelfish for Aurora PostgreSQL
- AWS Amplify
- Next.js
- OpenSearch
- Flux
- ArgoCD
- KVM
-
AWS open source newsletter #158
May 30, 2023 | 21 minute read
May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you.
-
AWS open source newsletter #157
May 22, 2023 | 19 minute read
May 22nd, 2023 - Instalment #157 Welcome Hello and welcome to the AWS open source newsletter, #157. Apologies for the lack of newsletter last week, but hopefully this week will make up for that as we have a bumper selection of great open source content for you. This weeks new projects include repos that help you get OpenEMR up and running (“host-openemr-on-aws-fargate”), two new security related open source projects that you definitely need to check out, (“cedar” and “snapchange”), integration of clickstream analytics using Swift (“clickstream-swift”), deployment of Backstage to serve up access to your AWS resources, (“app-development-for-backstage-io-on-aws”), a tool to help you clean up ecs tasks definitions (“aws-ecs-task-definition-cleanup”) and many more.
-
AWS open source newsletter #156
May 8, 2023 | 21 minute read
May 8th, 2023 - Instalment #156 Welcome Hello and welcome to the AWS open source newsletter, #156, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. So what do we have for you this week? Coming up later in this newsletter we have projects such as “sustainability-scanner” helps you check your Cloudformation templates against sustainability good practices, “synthtable” helps you create synthetic data for different use cases, “neptune-gremlin-client” a Java based Gremlin client, “s3zipper” a tool to quickly download entire S3 buckets, “chataws” a nice demo of how you can use ChatGPT to aid your AWS deployments, and plenty of other great projects.
-
AWS open source newsletter #155
Apr 29, 2023 | 20 minute read
May 1st, 2023 - Instalment #155 Welcome Hello and welcome to the AWS open source newsletter, #155, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. This week’s new projects include “aws-cloudformation-controller-for-flux” provides a way to use flux to orchestrate your CloudFormation deployments, “threat-composer” is a nice React based tool to help you create Threat Models for your systems and applications, “cdk-integ-tests-sample” a tool to allow you to do integration tests with your CDK stacks (these three were all featured in the latest episode of Build on Open Source, you can watch it here), “iam-access-key-report” generates reports from your AWS accounts about your AWS access keys, “personalize-kafka-connector” provides an integration into Apache Kafka for this AWS service, and more!
-
AWS open source newsletter #154
Apr 24, 2023 | 22 minute read
April 24th, 2023 - Instalment #154 Welcome Hello and welcome to the AWS open source newsletter, #154, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. We have another great selection of projects for you as always, starting off with “cfn-teleport” an essential cli tool for Cloudformation users, “aither” an interesting collaborative development tool using virtualised desktops on containers, “tabular-column-semantic-search” a tool to help you find similar types of data in your data lakes, “resource-lister” and “komiser” tools that help you manage your AWS resources, “resource-utilization” helps you track your AWS resource utilisation, “iot-network-traffic-control-and-load-testing-simulator” an interesting load and chaos testing example, and more!
- oss-newsletter
- aws open source
- Apache Oozie
- Apache Airflow
- Deep Java Library
- DJL
- mwaa-local-runner
- MWAA
- Trusted Language Extensions for PostgreSQL
- Supabase
- PostgreSQL
- Jupyter
- Grafana
- Opus
- Papermill
- Apache Spark
- HiveQL
- Amazon EKS
- Kubernetes
- Amazon EMR
- RStudio
- USBGuard
- Amazon Corretto
- AWS Amplify
- Apache Hive Metastore
- LoRaWAN
- gMSA
- Python
- OpenSearch
- AWS Copilot
- Marten
- Flutter
-
AWS open source newsletter #152
Apr 10, 2023 | 16 minute read
April 10th, 2023 - Instalment #152 Welcome Hello and welcome to the AWS open source newsletter, #152 an Easter special. This week sees more great new projects including, “redshift-test-drive” a set of essential tools for Amazon Redshift users, “simple-database-archival-solution” a nice tool to help you archive your data, “attribution-gen” a Go tool to help you build open source attribution documents, “aws-glue-data-catalog-federation” a library to help you federate your Glue catalog, “subnet-utilization-monitor-for-amazon-vpc” a handy tool to keep on top of your IP address allocation, “AlexaGPT” a demo of integrating Alexa with you know what, and more!
-
AWS open source newsletter #151
Apr 3, 2023 | 22 minute read
April 3rd, 2023 - Instalment #151 Welcome Hello and welcome to the AWS open source newsletter, #151. This week sees more great new projects, including those covered in the latest episode of Build on Open Source, such as “ec2-former2” a way to host this great project to reverse engineer your CloudFormation templates, “protonizer” a cli tool for those using AWS Proton, “fortuna”, a library for Uncertainty Quantification, “aws-resilience-hub-tools” a set of tools and scripts for working with the AWS Resilience Hub, “jenkins-unity-build-on-aws” a nice reference solution for those needing to build Unity projects, “amazon-cognito-passwordless-auth” a nice demo of how to do authentication sans password, and more.
-
AWS open source newsletter #149
Mar 19, 2023 | 14 minute read
March 20th, 2023 - Instalment #149 Welcome Hello and welcome to edition #149 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. I hope some of you were able to catch this episode reviewed on our last Build on Open Source livestream. If not, you can catch the replay here. This week we have projects such “mountpoint-s3”, “s3-access-for-squash”, and “amazon-s3-tar-tool” which provide some useful tools for managing your files on S3, “aws-serverless-ai-stories” a creative masterclass in storytelling, “earthquake-notifier” a serverless solution to keep you alerted and ready, and more!
-
AWS open source newsletter #148
Mar 12, 2023 | 17 minute read
March 13th, 2023 - Instalment #148 Welcome Hello and a warm welcome to edition #148 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. This week we have projects such as “iam-ape” a tool to help you grapple with your IAM policies, “amazon-emr-cli” a nice command line tool to package and deploy your Spark jobs on Amazon EMR, “duckdb-athena-extension” that helps you import data from Amazon Athena into DuckDB, “terraform-aws-email-files-dropped-in-s3” a helpful tool to easily email you attachments automatically, “cloud-queue-for-quantum-devices” a tool to help Quantum researchers across the world, “aws-private-ca-matter-infrastructure” a sample reference architecture for setting up a secure, private certificate authority, “aws-sam-cli-java-examples” will help you deploy your Java apps via AWS SAM, “mpartman” a PostgreSQL partition manager, “aws-do-pcluster” simplifying how to run AWS ParallelCluster, “staticwebsite-cli” a very nice too to help you easily deploy static web sites, and more!
-
AWS open source newsletter #147
Mar 6, 2023 | 14 minute read
March 6th, 2023 - Instalment #147 Welcome Welcome to edition #147 of the AWS open source newsletter, featured in the latest episode of Build on Open Source. This week we have new projects such as “metahub” and “savings-estimator” that we looked at in closer detail on the Build on Open Source livestream, “aws-iot-core-credential-provider-session-helper” a Python library to help simplify working with AWS IoT, “traffic-inspection-architectures-aws-cloud-wan” code that provides examples of different network architectures and how to do traffic inspection, “neptune-export” a tool to help you export your data in Amazon Neptune, “aws-organizations-tool” a command line tool to help you configure AWS Organisations, “sagemaker-external-repo-access” a nice reference architecture for Amazon Sagemaker, “aws-cdk-cfn-hook” a Python CDK app that will get you up and running quickly working with Cloudformation template hooks, and more!
- oss-newsletter
- aws open source
- Kubernetes
- OpenSearch
- Ubuntu
- Vault
- FreeRTOS
- AWS SAM
- MySQL
- MariaDB
- PostgreSQL
- AWS Lambda Powertools
- Debezium
- Apache Kafka
- Kafka Connect
- Apache Spark
- Apache Hudi
- DeltaStreamer
- Apicurio Registry
- Apache Iceberg
- FFMpeg
- Prometheus
- Babelfish for Amazon Aurora PostgreSQL
- Redis
- Mastadon
- Amazon EMR
-
AWS open source newsletter #145
Feb 20, 2023 | 24 minute read
Feb 20th, 2023 - Instalment #145 Welcome to edition #145 of the AWS open source newsletter. I hope some of you were able to catch the new Build on Open Source show we live streamed last Friday. You can catch up and replay the session by clicking on this link, where we went over a number of projects from this and a few previous newsletters, and we had special guest Valter who walked us through his project terraform-dev-containers.
-
AWS open source newsletter #144
Feb 5, 2023 | 19 minute read
Feb 5th, 2023 - Instalment #144 Welcome to edition #144 of the AWS open source newsletter, and another week of great new open source projects for you to try out. Some of the treats in store for you this week include “dynamodb-shell”, a project that provides a cli to your favourite AWS database, “precloud” a tool to help you catch issues with your configuration before you deploy, “node-latency-for-k8s” a tool to analyse your node logs, “stepfunctions-lambda-ec2-ssm” a very nice way of using step functions to overcome the 15 minute timeout of your lambda functions, “terraform-ec2-image-builder-container-hardening-pipeline” a very cool example of how to build an EC2 image hardening pipeline using Terraform, and “cloudtrail-event-fuzzy-viewer” a tool to copy your AWS CloudTrail events and then fuzzy search them on the command line.
-
AWS open source newsletter #143
Jan 30, 2023 | 14 minute read
January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more.
- oss-newsletter
- aws open source
- MySQL
- PostgreSQL
- MariaDB
- OpenSearch
- RabbitMQ
- Apache Flink
- Apache Velocity Template Language
- AWS ParallelCluster
- Kubernetes
- EKS Anywhere
- Apache Kafka
- AWS Distro for OpenTelemetry
- Prometheus
- OpenShift
- ROSA
- AWS SAM
- Terraform
- OpenJDK
- DataHub
- AWS CDK
- Pulumi
- SST
- Serverless Framework
- Apache Iceberg
-
AWS open source newsletter #142
Jan 23, 2023 | 14 minute read
January 23rd, 2023 - Instalment #142 Welcome Welcome to edition #142 of the AWS open source newsletter. We have another great round up of new projects for you to get stuck into. Here are just a taste of some of the projects, kicking off with “sls-mentor” a new tool to help you assess your serverless applications, “subnet-watcher”, a tool to help you monitor your IP addresses, “aws-cdk-web-administered-apps” a very nice reference solution for applications that have a user and admin component, “serverless-newsletter-app” if you are looking for a newsletter solution and want to host your own, look here first, “aws-iot-with-privatelink” shows you how you use private networks for your IoT traffic, “emr-spark-benchmark” benchmarking tool for assessing your Amazon EMR environments, and “update-aws-ip-ranges” keep automatically updated on Amazon’s IP address ranges.
-
AWS open source newsletter #141
Jan 15, 2023 | 13 minute read
January 16th, 2023 - Instalment #141 Welcome Welcome to the AWS open source newsletter of 2023, edition #141. This week we have more new projects for you to practice your four freedoms, including “distributed-compute-on-aws-with-cross-regional-dask”, a solution to simplify distributed compute using Dask, “amazon-emr-serverless-image-cli” a tool to verify your Amazon EMR custom container images, “serverless-run-watch” a tool to help accelerate your local development if you are using the Serverless Framework, “aws-sso-auto-expand-accounts” a quick browser extension for those using AWS SSO, “basti” a cool Bastion Host alternative, “klotho” generate cloud native code from your code, “amazon-route53-hosted-zone-sync” a nice solution for hybrid DNS use cases, and many more.
-
AWS open source news and updates #137
Nov 25, 2022 | 30 minute read
November 25th, 2022 - Instalment #137 Welcome Welcome to the AWS open source newsletter, edition #137. As it is re:Invent next week, I will be publishing the newsletter early as I am heading out on Monday. I will be in Las Vegas talking with open source Builders, hanging out on the Open Source Kiosk in the AWS Village, and doing some talks. If you are coming, I would love to meet some of you, so get in touch.
- oss-newsletter
- aws open source
- re:Invent
- GraphQL
- Grafana
- Prometheus
- AWS Toolkits for JetBrains
- AWS Toolkits for VS Code
- AWS Amplify
- NodeJS
- MariaDB
- PostgreSQL
- Flutter
- React
- Apache Iceberg
- Apache Airflow
- Apache Flink
- Apache ShardingSphere
- AutoGluon
- AWS ParallelCluster
- Kubeflow
- NGINX
- Finch
- Amazon EMR
- Trino
- Apache Hudi
- O3DE
- Apache Kafka
- OpenSearch
- MLFlow
-
AWS open source news and updates #136
Nov 21, 2022 | 20 minute read
November 21st, 2022 - Instalment #136 Welcome Welcome to the AWS open source newsletter, edition #136, as featured on the latest episode of Build on Open Source. This week we feature new projects including “dynamoit” a JavaFX gui for Amazon DynamoDB, “building-apache-kafka-connectors”, “msk-config-providers”, and “msk-serverless-data-pipeline” projects to help make your life easier when working with Apache Kafka, “stowrs-to-s3” a tool for working with STOWRS data on AWS, “aws-device-lobby” a tool to make onboarding devices into AWS IoT Core easier, “aws-graviton-run-confidential-ml-workloads-using-nitro-enclaves” a nice example of how you can do Confidential Computing for machine learning use cases, “aws-hpc-builder” a tool to help you manage your open source HPC tools, and many more.
-
AWS open source news and updates #134
Nov 7, 2022 | 20 minute read
November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more!
-
AWS open source news and updates #130
Oct 10, 2022 | 17 minute read
October 10th, 2022 - Instalment #130 Welcome Welcome to the AWS open source newsletter, edition #130. This newsletter was featured in the Build on Open Source episode four, which you can check out here if you missed it. New projects for you to practice your open source four freedoms this week include “grucloud” a new infrastructure as code tool with some nice features, “stepfunctions-sdk-autocomplete” a VSCode plugin for all you AWS Step Functions fans, “AWS_Billing_Overage_Shutdown” a very new repo that has some code to help you automate shutting down resources on alerts, “aws-secrets-manager-github-action” if you are using GitHub Actions, this one is for you, “meta-aws”, tools and recipes for those using and building with Yocto, “data-on-eks” a number of sample solutions to configure self managed open source data analytics tools, “cql-replicator” a tool to help you migrate from self managed Apache Cassandra to Amazon Keyspaces, “ec2-imagebuilder-ami-lifecycle” provides some new capabilities for those building AMIs, and many more.
-
AWS open source news and updates #127
Sep 16, 2022 | 17 minute read
September 16th, 2022 - Instalment #127 Welcome Welcome to the AWS open source newsletter, edition #127. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed as our special guest, AWS Hero Ian Mckay walked us through some of his open source projects. It was very cool indeed, and if you have not yet watched, Ian shares an early glimpse of a new project - so make sure you check that out.
-
AWS open source news and updates #124
Aug 12, 2022 | 15 minute read
August, 12th, 2022 - Instalment #124 Welcome Welcome to edition #124 of the AWS open source newsletter. This is a very special edition as this will be the first edition that we cover in the new Build on AWS Open Source fortnight show on twitch.tv/aws. I hope some of you were able to attend, but if not don’t worry we will be sharing links to the recording. To keep up to date on future episodes, make sure you follow @buildonopen.
-
AWS open source news and updates #123
Aug 5, 2022 | 16 minute read
August, 5th, 2022 - Instalment #123 Welcome Welcome to the AWS open source newsletter episode #123. I sometimes speak with builders who are experienced developers but perhaps new to open source. A common question I get asked is what the impact of them working on open source might be on their careers. Whilst it is never a guarantee, open source can be a great career accelerator. I was reminded of that last week when reading the excellent post from Ran Isenberg, who shared his experience in his post How One Open-Source Code Donation Got Me Promoted.
-
AWS open source news and updates #122
Jul 29, 2022 | 14 minute read
July 29th, 2022 - Instalment #122 Welcome Welcome back to my regular readers and hello to new readers, I hope you will enjoy and come back again to the AWS open source newsletter episode #122. This week we have another great collection of community and AWS related open source tools, demos and samples for you to practice your open source four freedoms. “rds_auto_encrypt” helps you encrypt your Amazon RDS databases, “middy-profiler” is an interesting looking tool to help you understand performance characteristics of your AWS Lambda functions, “simpleiot” is a very nice looking IoT framework to help simplify how you can onboard devices into AWS IoT, “aws-secrets-manager-hybrid-secret-replication-from-hashicorp-vault” (bit of a mouthful to say that one) helps you synchronise your secrets across different secret providers, “automated-forensic-orchestrator-for-amazon-ec2” is a very nice reference solution for automating some of your operational security activities, and we have several other projects for you to dive deep into.
-
AWS open source news and updates #121
Jul 22, 2022 | 15 minute read
July 22nd, 2022 - Instalment #121 Welcome to regular and new readers alike, to the AWS open source newsletter episode #121. Am super excited about this weeks new projects, including a number of AWS CDK related projects so if you are a fan of AWS CDK then make sure you check them all out. We feature projects such as “openrolesanywhere”, a proof of concept client for the recently released AWS IAM Roles Anywhere, “amazon-redshift-odbc-driver” an open source ODBC driver for Amazon Redshift, “spot-interruption-simulation” a very handy tool to help you test and simulate spot interuptions for your EC2 workloads, “magento-ecs-cdk” a quick way to deploy a scalable Magento environment, “using-rekognition-to-detect-sounds” a very interesting project that will help you hear sounds from your pictures (yes, you did not read that wrong!
-
AWS open source news and updates #120
Jul 15, 2022 | 16 minute read
July 15th, 2022 - Instalment #120 Welcome to regular and new readers alike, to the AWS open source newsletter episode #120. The observant will have noticed that it has been two weeks since the last newsletter. We all need some time off, and I spent most of the time cycling around the hills of a new cycle route called King Alfreds Way - highly recommended. There has been some great new projects created over the past couple of weeks, and of course I have you covered and have shared them below.
-
AWS open source news and updates #119
Jul 1, 2022 | 15 minute read
July 1st, 2022 - Instalment #119 Welcome to regular and new readers alike, to the AWS open source newsletter episode #119. This week we feature more new open source projects, such as “cdk-bill-bot”, a tool that can help you reduce AWS bill surprises, “steampipe-mod-aws-perimeter” helps you look for resources that are publicly accessible, “aws-cloudformation-diagrams” is a nice visualisation tool for CloudFormation users, “aws-swagger-ui” a project to help you set up Swagger UI for API Gateway, “kinesis-hot-shard-advisor” a handy tool that helps you identify whether you have hot key or hot shard issues on your Kinesis data streams, and many more.
-
AWS open source news and updates #118
Jun 24, 2022 | 14 minute read
June 24th, 2022 - Instalment #118 Welcome to regular and new readers alike, to the AWS open source newsletter episode #118. This week we feature more new open source projects, such as “seed-farmer”, and orchestration tool modelled after GitOps deployments, “aws-proton-plugins-for-backstage” Backstage plugins for interacting with AWS Proton, “dcv-gnome-shell-extension” is a GNOME Shell extension to provide functionalities required by NICE DCV, “simpleiot-arduino” an Arduino library to integrate with the SimpleIOT framework, “event-driven-weather-forecasts” an event driven weather forecasting demo, and many more.
-
AWS open source news and updates #117
Jun 17, 2022 | 16 minute read
June 17th, 2022 - Instalment #117 Welcome to regular and new readers alike, to the AWS open source newsletter episode #117. A little behind schedule this week, as I have been speaking at a couple of events this week. It has been good to get back on the stage and to talk and engage with real people. It seems that things are quickly returning back to normal. So this week we have some great new projects for you.
-
AWS open source news and updates #114
May 27, 2022 | 15 minute read
May 27th, 2022 - Instalment #114 Welcome to the AWS open source newsletter #114. This weeks new open source projects feature a variety of community related projects such as “instance-scheduler” a tool to help you schedule AWS resources, “libaws” an opinionated tool that helps you simplify creation and deletion of some AWS resources, “elasticspot” a nice tool to help you reassign elastic IPs, and “auto-close-aws-accounts” that allows you to close AWS accounts if you are using AWS Organisations.
-
AWS open source news and updates #112
May 13, 2022 | 14 minute read
May 13th, 2022 - Instalment #112 Newsletter #112. Welcome to this weeks round up of AWS open source news. This weeks new projects features projects such as “aws-dataall” an open source framework for building a data marketplace, “backpack” a set of tools to help you work with the AWS Panorama devices, and we have other projects that help you automate DNS tasks, manage game servers, automate data ingestion, and more.
-
AWS open source news and updates #111
May 6, 2022 | 15 minute read
May 6th, 2022 - Instalment #111 Newsletter #111. Welcome to edition #111 of the AWS open source newsletter, a bit later this week but that was so I could pack in even more great open source content. This week we have another round up of new open source projects from the AWS community that include tools to help you manage your AWS CloudFront distributions, resource providers for CloudFormation for Confluent users, managing Amazon Route53 via the command line, a nice tool for Rust developers working with AWS Lambda, a nice tool to help you find your CIDR address ranges, and many more including some great samples.
-
AWS open source news and updates #109
Apr 22, 2022 | 21 minute read
April 22nd, 2022 - Instalment #109 Newsletter #109. Welcome to edition #109 of the AWS open source newsletter. Big news, I have shaken things up and will be changing the publish date to Friday mornings, starting today with this edition. Over the months I have received some feedback about changing the published date to Fridays, so I am hoping this will give everyone plenty of time to check out the projects, read the posts and provide everyone with something to do over the weekend (if they want!
-
AWS open source news and updates #107
Apr 4, 2022 | 17 minute read
April 4th, 2022 - Instalment #107 Newsletter #107. Welcome to edition #107 of the AWS open source newsletter, and we have a bumper edition this week packed with more great new open source projects and content for you to consume. Topics featured this week include optimising open source big data tools, developer tooling, case studies and we even some some great open source content for .NET core developers. This weeks projects include a really nice handy browser plugin called “aws-search-extension”, that lets you search and find developer information from the AWS docs, a tool that will help you detect whether you have configured or using dockershim in your Kubernetes clusters, a library to help you integrate Amazon Cognito in your Laravel PHP applications, and plenty more developer tools and sample projects.
-
AWS open source news and updates #105
Mar 20, 2022 | 15 minute read
March 21st, 2022 - Instalment #105 Newsletter #105. Welcome to edition #105 of the AWS open source news and updates, where we bring you the latest open source projects, posts, events, and much more. This weeks new projects include the latest work in progress from AWS Hero Ian Mckay, “iamfast” is an AWS IAM policy generation tool that is in early stages but promises to be very useful indeed. “iasql-engine” is a tool that models cloud infrastructure as data, “ssm-patch-portal” provides a nice gui front end to simplify patching with AWS System Manager, a new crowdsource guide that contains learning resources for AWS, a business intelligence platform built using open source technologies from the NHS, and many more.
-
AWS open source news and updates #104
Mar 14, 2022 | 17 minute read
March 14th, 2022 - Instalment #104 Newsletter #104. Welcome to #104 of the AWS open source news and updates newsletter, bringing you the latest updates from around the AWS and Communities. This week we have yet more great new open source projects, including a Deno runtime for your Lambda functions, data lineage and data testing tools, a performance testing tool for Apache Kafka, an ELT tool for Amazon Redshift, an Amazon S3 archive tool, and many more.
-
AWS open source news and updates #100
Feb 14, 2022 | 12 minute read
Feb 14th, 2022 - Instalment #100 Newsletter #100. Happy Valentines everyone, and welcome to this landmark 100st edition of this newsletter. This week we celebrate the love that many builders have for open source with more great new open source projects and content. Cuddle up to new projects that will help you build scalable systems, simplify your work with AWS DynamoDB, integrate your .NET applications with OpenSearch, keep on top of your VPC networks, and more.
-
AWS open source news and updates #96
Jan 17, 2022 | 14 minute read
Jan 17th, 2022 - Instalment #96 Newsletter #96. Welcome to another great round up of open source projects, news and great content. This week, we have new open source projects such as Event Catalog (that helps you to discover, explore and document your Event Driven Architectures), AWS Powertools for Lambda TypeScript edition, flowdog (an application/framework for inspection and manipulation of network traffic in AWS VPCs), ai-doorbell (a serverless AI enabled door bell) and many more.