https://blog.beachgeek.co.uk/ Recent content in Home on Beachgeek blog - a refuge for pineapple on pizza lovers Hugo -- gohugo.io en-us Mon, 26 Jun 2017 18:27:58 +0100 https://blog.beachgeek.co.uk/bookmarks-3/ Sun, 01 Mar 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/bookmarks-3/ Currently reading ( 1st March) These are the current online posts that I enjoyed reading and made me think. AI AWS responsible use of AI guide (pdf) - link [best-practice] - ( Added: 2026-03-01 15:16:45 ) Agentic AI is an amplifier, for both good and bad organisational behaviours. This post looks at some of the things you might observe for those who have not yet got their house in order - link [opinion] - ( Added: 2026-03-01 13:12:29 ) https://blog.beachgeek.co.uk/kiro-cli-timebound-iam/ Thu, 19 Feb 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/kiro-cli-timebound-iam/ Agentic AI tools like Kiro IDE and Kiro CLI are pretty awesome. You provide the right context, the right prompt, and away they will go. After a period of time, you can now review the output. Early on developers understood the power, but also the potential harm that could be cause (and we began to read stories like this one. Most developer tools now provide capabilities that allow you as a developer to have fine grain control of what they can and more importantly, should never do. https://blog.beachgeek.co.uk/kiro-cli-aws-vault/ Thu, 19 Feb 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/kiro-cli-aws-vault/ As we say at AWS, security is our top priority. This is why I have been spending time thinking about how to manage what our agentic AI tools can do. After publishing a previous post on this topic (Getting Kiro CLI to use short lived AWS credentials), this post takes a look at another approach you can take. Vincent reminded me about an awesome open source tool called aws-vault that helps developers move to using short lived, temporary credentials. https://blog.beachgeek.co.uk/bookmarks-2/ Thu, 19 Feb 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/bookmarks-2/ Currently reading ( 23rd Feb) These are the current online posts that I enjoyed reading and made me think. CODING A tool that provides observability across your Claude Code sessions - when running multi agent swarms this provides some nice info on what they are all up to - link [tool] - ( Added: 2026-02-23 17:47:05 ) Brooks proved in 1975 that adding more programmers to a late project makes it later because communication overhead grows faster than output. https://blog.beachgeek.co.uk/bookmarks-1/ Tue, 17 Feb 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/bookmarks-1/ What I am currently reading ( 17th Feb) These are the current online posts that I enjoyed reading and made me think. AI A new CNCF inspired look at the agentic AI space - link [tool] - ( Added: 2026-02-22 23:48:00 ) A detailed 100 page guide from Jeremy Daley on how to build production grade multi tenant systems - link [best-practice] - ( Added: 2026-02-22 21:03:48 ) https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-218/ Wed, 28 Jan 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-218/ Edition #218 - January 2026 Welcome to issue #218 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. Many of you will be on your way to FOSDEM, and sadly I will not be there this year - although I will be in spirit as my weekend will be spent watching the livestreams. In this months edition we have a nice selection of projects - from tools to help you review and audit your cloud resources, to projects that simplify deployment of complete AI stacks, and cool terminal based tools that will delight a lot of you I am sure. https://blog.beachgeek.co.uk/ecs-express-mode/ Thu, 15 Jan 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/ecs-express-mode/ I have been working on a new digital badge demo application that you can use to generate and then issue digital certificates. You have probably seen these in your LinkedIn newsfeed - those digital badges saying that you have completed this or that activity or training course. I have been using Kiro to create this demo application, leveraging the Strands Agent framework to make adding generative AI a trivial exercise (seriously, if you have not tried it yet do yourself a favour and check it out). https://blog.beachgeek.co.uk/kiro-cli-subagents-player-coach/ Fri, 09 Jan 2026 00:00:00 +0000 https://blog.beachgeek.co.uk/kiro-cli-subagents-player-coach/ Edition #216 - November 2025 Over the Christmas period I spent some of my down time catching up on blog posts and open source projects that I had bookmarked to “read later”. I have been interested in learning about opinionated workflows that use agentic tools like Kiro CLI to generate better output. One of those projects looked at how you can improve the output from agentic tools through something called player/coach (I think it might be similar to the actor/critic method that I used back in the reinforcement learning days of Deep Racer). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-217/ Thu, 18 Dec 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-217/ Edition #217 - December 2025 Welcome to the Christmas edition of the AWS open source newsletter, #217. I am publishing this before the end of the month as I begin to wind down and get ready for the holidays. We have plenty of gifts from the open source community to keep you busy over the festive period, and we have a bumper selection of projects. There are too many good ones to single out, so go check them out and let me know which ones you tried and liked. https://blog.beachgeek.co.uk/automating-with-kiro/ Wed, 10 Dec 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/automating-with-kiro/ What are you automating with generative AI ? I have spoken at many events this year sharing how I see developers using AI coding assistants like Kiro and Kiro CLI. The top use case was debugging code, and I wrote about that in Debugging and troubleshooting issues with AI coding assistants. In this post I am going to talk about another very common use case, automation. I will share a couple of things that I found trivial to automate with the help of Kiro, but also some unexpected things I learned along the way. https://blog.beachgeek.co.uk/zero-to-shipped/ Thu, 04 Dec 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/zero-to-shipped/ A year of Zero to Shipped I am at Build Stuff doing my live coding talk, Zero to Shipped in 30 minutes. I have done this “talk” many times this year, and as I look back to January when I did the same session at PyCon+Web in Berlin, what amazes me is how far AI Coding Assistants have come in such a short period of time. Back then I used Amazon Q Developer (pre agentic mode), and a lot has changed. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-216/ Fri, 28 Nov 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-216/ Edition #216 - November 2025 Welcome to issue #216 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. re:Invent is just around the corner, and this months edition has a lot of great pre:Invent stuff, and I can’t wait to see what other open source stuff gets announced. Some readers may be heading to re:Invent (or maybe already there), so enjoy the week. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-215/ Fri, 31 Oct 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-215/ Edition #215 - October 2025 Welcome to issue #215 of the AWS open source newsletter, the only newsletter that I know of that brings you the best open source on AWS content. There is nothing spooky or scary in this months edition we have a nice selection of projects that cover a broad range of use cases - tools to help you with CloudFormation stacks, provide a GUI layer over your Amazon S3 buckets, terminal user interfaces to work with Amazon ECS and your AWS profiles, a couple of nice tools to simplify building agentic applications using Strands Agents, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-214/ Mon, 29 Sep 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-214/ Edition #214- September 2025 Welcome to issue #214 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. Sometimes less is more, and I am using that as an excuse as I was on holiday for the first two weeks of September (in lovely Cornwall for those wondering, hiking the SW Coastal Path), and so have less time that usual to put this together. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-213/ Thu, 28 Aug 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-213/ Edition #213- August 2025 Welcome to issue #213 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. As always, this edition has more great new projects to check out. In this edition, we have a nice selection of projects that help you migrate your CDK projects, a number of graphical and text interfaces for a number of backend systems and data, a look at the Valkey client for Swift, and the usual sampling of. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-212/ Thu, 31 Jul 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-212/ Edition #212 - July 2025 Welcome to issue #212 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. This newsletter was started in January 2021, and since then over you have engaged in the projects and content I put together over 3 million times. Amazing, so thank you for those of you who are still following and still sending me messages of support. https://blog.beachgeek.co.uk/manage-context-rot/ Wed, 02 Jul 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/manage-context-rot/ Like many folk who have been spending their time with AI Coding Assistants like Amazon Q Developer and Amazon Q CLI, understanding how to manage context is one of the key things you need to develop intuition for to improve the outputs these tools give you. More recently I have started hearing about new terms such as "context rot", and others exploring the field of context engineering. Understanding how to manage your context will be key to your success. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-211/ Sat, 28 Jun 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-211/ Edition #211 - June 2025 Welcome to issue #211 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. I was super humbled by AWS Hero Lee Gilmore earlier this month, who gave this newsletter a shoutout - thank you! (and make sure you check out his own newsletter, the Serverless Advocate Newsletter). Please please please take 1 minute to complete this short survey - feedback is a gift, and your gifts help keep this newsletter going in the right direction. https://blog.beachgeek.co.uk/vibe-coding-q-load-testing/ Tue, 24 Jun 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/vibe-coding-q-load-testing/ I have a long history with testing, and specifically load testing. Many many years ago, I spent many a happy hour designing, building, running, and then assessing load tests for the applications I was working with. It was one of the first technical interviews I ever did and it was also how I found AWS, spinning up Centos load runners to simulate thousands of virtual test users. Ahh the good old days! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-210/ Fri, 30 May 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-210/ Edition #210 - May 2025 Welcome to issue #210 of the AWS open source newsletter, the newsletter where I try and provide you the best open source on AWS content. As always, this edition has more great new projects to check out, which include: a couple of projects for those of you looking for tools that can help you with cost optimisation, a new security threat modelling tool that uses the power of generative AI, an experimental Python SDK that offers async support, a nice UI testing tool (that will warm your spirits), and of course the now obligatory collection of MCP projects - that said, don’t miss those as I think you are going to love these, including some that have been contributed by a member of the AWS Community. https://blog.beachgeek.co.uk/mcp-finch/ Fri, 02 May 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/mcp-finch/ I was chatting with AWS Hero Matt Lewis on the topic of how to run MCP Servers via a container image, and realised that I had not actually tried this yet. So this post was inspired by that conversation, and I hope it helps anyone else who is looking to try it out. In a previous post I introduced how Amazon Q CLI now supports Model Context Protocol (MCP) (check out Configuring Model Context Protocol (MCP) with Amazon Q CLI for more details). https://blog.beachgeek.co.uk/getting-started-mcp-amazon-q-cli/ Thu, 01 May 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/getting-started-mcp-amazon-q-cli/ Amazon Q CLI is a next generation developer tool that brings IDE-style autocomplete and agentic capabilities to your terminal. I have spent a lot of time recently writing about this amazing tool, and so was super excited by the news today that with the v1.9.x release, Amazon Q CLI now supports Model Context Protocol (MCP) for tools use. What is Model Context Protocol (MCP)? if you have not heard about MCP (where have you been? https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-209/ Tue, 29 Apr 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-209/ Edition #209 - April 2025 Welcome to issue #209 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I am publishing this from the AWS Summit London, and it has been great to speak to so many of the AWS community about open source - it is very much alive and thriving, so thank you all! As always, in this edition we have more great new projects to check out, which include a bumper selection of the current hot topic that is Model Context Protocol (MCP). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-208/ Fri, 28 Mar 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-208/ Edition #208 - March 2025 Welcome to issue #208 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include an experimental profiler for your serverless Java applications, a bunch of cool projects around Model Context Protocol (MCP), an interesting project around extracting insights from your observation data, projects to help you with your AWS storage services, an interesting project for those of you exploring chaos engineering, some nice generative AI projects that help you explore your code base, and to finish, the usual round up of demo projects which you should go check out. https://blog.beachgeek.co.uk/q-php-2-python/ Sun, 16 Mar 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/q-php-2-python/ In this blog post I share how I was able to use Amazon Q Developer CLI to refactor code from one programming language to another Many years ago, I spend many happy years developing code in PHP. It was such an accessible and tactile language, with a great community momentum that continues to this day. One of the things I used to enjoy, was trying out many of the open source clones of well known websites that the PHP community would release. https://blog.beachgeek.co.uk/q-cli-new-app/ Sun, 09 Mar 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/q-cli-new-app/ I have been writing a lot recently about AI Coding Assistants, and I have been mostly using Amazon Q Developer within VSCode. This week though, saw a very nice update to the Amazon Q Developer CLI, a separate download that provides you with Amazon Q within your command line. It is available for MacOS and various flavours of Linux (you can download it from here. I wanted to see how good the recent update is, so I decided to try and build a quick web application from the command line. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-207/ Fri, 28 Feb 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-207/ Edition #207 - February 2025 Welcome to issue #207 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, we have more great new projects to check out, which include real time analysis of your client calls to AWS APIs, a dashboard for all your AWS Health Events, an EBS analysis tool, a SIEM tool that allows you to query your AWS events, a really cool AI Coding Assistant powered by Amazon Bedrock, a really great demo of how to implement an MCP server, running WhispherX on AWS Lambda, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-206/ Mon, 27 Jan 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-206/ Edition #206 Happy New Year and welcome to issue #206 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As this is the first edition post re:Invent, you will find a lot of content showcasing all the new open source stuff that AWS has released, so there is plenty of really cool stuff to get stuck into - whether you are cloud native and want to know more about Amazon EKS Auto Mode, or more a data guru that is super excited about Apache Iceberg support in Amazon S3 Tables. https://blog.beachgeek.co.uk/q-spinning-wheel/ Thu, 09 Jan 2025 00:00:00 +0000 https://blog.beachgeek.co.uk/q-spinning-wheel/ This post was inspired by my colleague Matheus, who has used the aws spinning wheel (see blog post here) to help make running re:Cap’s a little more interesting and fun. That is a really neat solution, but I didn’t want to use that project as it was a little more comprehensive than I needed. As it is the new year, and I am starting to get hands on with all the really cool new features in Amazon Q Developer announced at re:Invent 2024, I thought I would create a simpler version. https://blog.beachgeek.co.uk/q-tips-25/ Wed, 25 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-25/ Tip 25 - Tips to help you get the most out of Amazon Q Developer Over the past weeks I have shared daily tips on how you can get the best out of AI coding assistants like Amazon Q Developer. Over the festive period some of you may find yourself with some free time, or perhaps you are going to be setting yourself some new years resolutions. For those that are planning on building new projects, or perhaps wanting to learn something new, then I hope this set of tips and tricks will help you towards that goal. https://blog.beachgeek.co.uk/q-tips-24/ Tue, 24 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-24/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-22/ Mon, 23 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-22/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-23/ Mon, 23 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-23/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-21/ Sat, 21 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-21/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-20/ Fri, 20 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-20/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-19/ Thu, 19 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-19/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-18/ Wed, 18 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-18/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-17/ Tue, 17 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-17/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-16/ Mon, 16 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-16/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-15/ Sun, 15 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-15/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-14/ Sat, 14 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-14/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-13/ Fri, 13 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-13/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-12/ Thu, 12 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-12/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-11/ Wed, 11 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-11/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-10/ Tue, 10 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-10/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-9/ Mon, 09 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-9/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-8/ Sun, 08 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-8/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-7/ Sat, 07 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-7/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-6/ Fri, 06 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-6/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-5/ Thu, 05 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-5/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-4/ Wed, 04 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-4/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-3/ Tue, 03 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-3/ In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. Each day I will share a new tip, categorised against a few themes and topics. If you have your own tips or your own experiences with tips I share, please use the comment feature or feel free to contact me directly. Check out the previous tips here. https://blog.beachgeek.co.uk/q-tips-2/ Mon, 02 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-2/ In the previous post I shared the importance of forming daily habits to help you discover your own flow when working with AI coding assistants like Amazon Q Developer. I also shared the first tip - make sure you keep your Amazon Q Developer plugin auto updated. In this series I will be sharing daily hints and tips to help you get ahead and start to accelerate you on your own journey with Amazon Q Developer. https://blog.beachgeek.co.uk/q-tips-1/ Sun, 01 Dec 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/q-tips-1/ The importance of building muscle memory When I talk to developers about the use of AI coding assistants, one of the key takeaways is that daily habits are one of the most effective tools in helping to build muscle memory and explore new possibilities that these tools provide. To help folk with this, over the next few weeks I am going to share daily hints and tips that I have found useful and made my use of Amazon Q Developer more effective. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-205/ Sat, 30 Nov 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-205/ Welcome to issue #205 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This will be the last edition of 2024, but looking forward to coming back in 2025 with more great open source project and content. As always, we have more great new projects to check out, which include a project that simplifies how you manage complex Kubernetes resource configurations, a library to accelerate open source analytics using Amazon S3, a look at a GraphRAG project, a project that helps NodeJS developers make it easier to make use of some advanced Amazon Aurora capabilities, an ESLinting tool for AWS CDK, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-204/ Tue, 22 Oct 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-204/ Edition #204 Welcome to issue #204 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Apologies for the long wait since the last edition, I will have to do better. Thanks for the lovely messages and feedback I have received over the past few weeks, this edition is for you! As always, we have more great new projects to check out, which include projects that surface up your AWS costs in Home Assistant, a tool that you can use to ask questions about your code base that uses generative AI, a git large file storage (LFS) extension that lets you use Amazon S3, and a handy network cost calculator. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-203/ Tue, 27 Aug 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-203/ Welcome to the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition, #203. Projects to check out include: how you can proxy OpenAI requests through Amazon Bedrock, security tools that help you stay one step ahead of bad actors, a way of implementing CDK Pipelines in a less opinionated way, a tool that helps you validate your AWS IAM policies, a toolkit to help get you started with good practices when creating CloudFormation templates, some demo code that demonstrate how you can implement zero downtime updates to your applications, as well as some really cool demos and use cases of generative AI in action (too many to mention, so check them all out! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-202/ Mon, 22 Jul 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-202/ Edition #202 Welcome to the AWS open source newsletter, issue #202. In this edition, I share more new projects (thank you for those of you that have sent them through) which include a project to help you monitor your data pipelines, the open sourced AWS Secrets Manager agent, a really cool new framework for managing multi generative AI agents, a couple of interesting projects to help manage your AWS accounts, a repo that provides CloudFormation snippets, and a few demo applications including one I put together that shows how you can use the Amazon Bedrock Converse API to summarise Hacker News comments. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-201/ Wed, 10 Jul 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-201/ Edition #201 Welcome to the AWS open source newsletter, issue #201, your trusted source for the very best open source on AWS content. This weeks new projects for you to practice your four freedoms include generative AI infused projects to help you generate your docs, streamline the setting up of your AWS resources, a new experimental framework for building document based workflows, and a cool demo that showcases how you can use generative AI to help translate American Sign Language. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-200/ Mon, 24 Jun 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-200/ Edition #200 Welcome to a milestone edition of this newsletter, number #200!! Wow, it feels like quite an achievement. Before diving into this newsletter, a big thank you for sticking with me. Time has flown by so quickly, and am looking forward to the next 100. As I have done in a few of the previous milestone issues, I wanted to share a few interesting stats from sharing open source projects with you over the past few years. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-199/ Mon, 10 Jun 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-199/ Edition #199 Welcome to issue #199 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. I cannot believe that we are one issue away from a pretty significant milestone. I would love to hear from some of the regular readers of this newsletter to find any highlights they have had, or perhaps things they have found that have been pretty significant. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-198/ Tue, 28 May 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-198/ Edition #198 Welcome to issue #198 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. In this issue we feature new projects that provide integration of .NET Aspire with AWS resources, an automated data discovery tool to find data in your AWS environments, a tool to help incorporate good practices when building SaaS solutions, a cost allocation dashboard for your Kubernetes workloads, a project that might help you mitigate costs around Internet Gateway, and a few generative AI demos around food, news, and social media which you should definitely check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-197/ Mon, 13 May 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-197/ Edition #197 Welcome to issue #197 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Like in previous editions of this newsletter, we feature new projects for you you practice your four freedoms. We have some great projects, including a sprinkling of repos that look to help you benchmark and assess your generative AI models and agents, a new fruity framework for building document understanding applications, a nice container command line tool that sysadmins will love, a tool to help you migrate your CodeCommit repositories, a really nice application of using generative AI to help automate CVE findings, and a neat generative AI newsletter generation demo. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-196/ Mon, 29 Apr 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-196/ Edition #196 Welcome to issue #196 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, more great new projects are featured in this edition of the newsletter, including a link to the Valkey repo, a nice GUI based project to help you build orchestration workflows that uses Apache Airflow under the covers, a tool to help you find signals through the noise of your security logs, a project to help you run serverless tasks in a cron like fashion, a command line runner for Amazon CodeCatalyst, a tool to help you simplify the deployment of Cruise Control on Amazon MSK, a nice Mac client for experimenting with Amazon Bedrock, and some really cool demo apps, the pick of which (for me) is a nice way of surfacing up your Amazon Bedrock models in a way that existing applications that expect an API key can use. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-195/ Mon, 15 Apr 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-195/ Edition #195 Welcome to issue #195 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. This week I am heading out to Everything Open, and looking forward to meeting the community in Gladstone. I will be talking about Cedar, and showing why it is important and how it works (demo is working lovely now). I am now on the third week of my open source roadshow, which is why I have had to change the publishing of this newsletter to every other week - at least until I get back home. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-194/ Wed, 03 Apr 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-194/ Edition #194 Welcome to issue #194 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Due to travelling and speaking commitments, regular readers will have noticed that I slipped up and missed a week. Normal service has been resumed, and as always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-193/ Mon, 18 Mar 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-193/ Edition #193 Welcome to issue #193 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. Sadly I will be missing the fun at KubeCon in Paris, but if you are attending, make sure to check out the AWS booth - I had a sneak peak at what you can expect, and there is going to be some great demos being shown, a lot of our open source folk will be there. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-192/ Mon, 11 Mar 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-192/ Edition #192 Welcome to issue #192 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. A wide variety this week, and we have projects that help you create architecture diagrams from your YAML, visualise and create dashboards for compliance and reporting purposes, a new multi-cloud threat detection tool, a Go implementation of Cedar, an example of load testing your large language models, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-191/ Mon, 04 Mar 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-191/ Edition #191 Welcome to issue #191 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that cover AWS Nitro Enclaves, open source mapping libraries, how to grab secrets into your application configuration files, database performance benchmarking and analysis, improving the logging your applications generate, and a number of very handy tools to help you manage security data from the command line. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-190/ Mon, 26 Feb 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-190/ Edition #190 Welcome to issue #190 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that can help you keep on top of your cost optimisation, a tool to help you automate Well Architected reviews, a tool to help you map out your RDS instances, as well as sample projects and demos. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-189/ Sun, 18 Feb 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-189/ Edition #189 Welcome to issue #189 of the AWS open source newsletter, the newsletter where we search high and low to provide you with the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that help you find your RDS instances, automate tasks from your online Chime calls, a very nice visual file browser for your Amazon S3 buckets, a tool to help you track and manage copying files from your S3 storage buckets, an active-active multi region cluster solution for Redis, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-188/ Mon, 12 Feb 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-188/ Edition #188 Welcome to issue #188 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have freshly cut repos that help you migrate your DNS configurations, improve your prompts when working with large language models, a new lightweight Javascript runtime, some reference code that shows you how you can deploy modern Java applications a number of different ways, and sample repos that show you how you can do remote debugging in Amazon EMR, as well as the usual cool demos that showcase some of the ways you can use generative AI. https://blog.beachgeek.co.uk/using-finch-with-mwaa-local-runner/ Mon, 12 Feb 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/using-finch-with-mwaa-local-runner/ I show you how you can use the Finch to run Apache Airflow using the mwaa-local-runner tool, and how you can do this for your applications too As some of you may know, I have been creating content on Apache Airflow for a few years now. One of the open source projects that AWS has produced to make it easier for developers to get started with Apache Airflow, is mwaa-local-runner. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-187/ Sun, 04 Feb 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-187/ Edition #187 Welcome to issue #187 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have new projects that help you optimise working with EBS volumes on EC2, a tool to help you document your architectures, a large language model benchmarking tool, a tool to help you optimise your S3 storage files, a data validation framework, and a really nice Java workshop. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-186/ Mon, 29 Jan 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-186/ Edition #186 Welcome to issue #186 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have dashboards to help you cut through the noise when reviewing security information, a synthetic data generator that leverages generative AI, a tool to help you mask data from production so you can use it in development and testing, a solution to help you run VSCode on EC2, a tool to help you wipe your S3 Glacier data vaults, and an assortment of generative AI demos for you to try out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-185/ Mon, 22 Jan 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-185/ Edition #185 Welcome to issue #185 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have projects that allow you to export your Partyrock applications, a tool to help you reduce hallucinations in your large language models, a new client for Redis, a tool to help you access the AWS Partner Network, as well as sample projects that look at how you can use large langue models to build a new reader and building pipelines using Cloudformation. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-184/ Mon, 15 Jan 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-184/ Edition #184 Welcome to issue #184 of the AWS open source newsletter, the newsletter where we try and provide you the best open source on AWS content. As always, this week we start with a round up of some freshly baked new projects for you to practice your four freedoms. This week we have a rust based cli tools to help you accelerate your S3 searches, we take a look at a new framework to help simplify bootstrapping your projects, a tool to help you report on your AWS resource tags, a voice translator for Chime, a really nice sample project to help you get hands on with Cedar, a number of generative AI demos and sample projects that are a must, and many more projects. https://blog.beachgeek.co.uk/amazon-q-finding-oss-projects-part-one/ Thu, 11 Jan 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/amazon-q-finding-oss-projects-part-one/ The future is here folks! I share my experiences using Amazon Q in the IDE, and how I was able to write more quickly and with less friction. Some of you might be familiar with the AWS open source newsletter, a weekly publication that features a curated set of content for open source developers on AWS. I rely on a number of folk to share with me interesting open source projects that I feature, but I wanted to see if I could create an automated script that I could run on a weekly schedule that would find new open source projects for me to review. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-183/ Mon, 08 Jan 2024 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-183/ January 8th, 2024 - Instalment #183 Happy new year and welcome to the first edition of the AWS open source newsletter of 2024, number #183. The big news for 2024 is the move from dev.to to community.aws as the “home” for the AWS open source newsletter, although it will still be posted on dev.to as well. Let me know what you think, community.aws has some top notch content that many readers might not be aware of. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-182/ Mon, 11 Dec 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-182/ December 11th, 2023 - Instalment #182 Welcome to #182 of the AWS open source newsletter, the place for all your AWS and open source needs. This is a special re:Invent packed edition of this newsletter, attempting to catch up and cover all the main talking points, sessions, and announcements. Whilst there is a lot of content to go through, I know that many of you will still be wanting to know about new projects you can try out, and the good news is that we have plenty. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-181/ Mon, 27 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-181/ November 27th, 2023 - Instalment #181 Welcome to #181 of the AWS open source newsletter, the place for all your AWS and open source needs. As some of you will know, this is re:Invent week, where many of my colleagues and tens of thousands of developers will be congregating to learn about Cloud, and hopefully discover plenty of open source goodness too. If you are going, make sure to visit the open source booth in the Expo floor. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-180/ Mon, 20 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-180/ November 20th, 2023 - Instalment #180 Welcome to #180 of the AWS open source newsletter, the place for all your AWS and open source needs. As we ramp up to re:Invent, it is good to see that pre:Invent is giving us plenty of open source goodies. In this weeks newsletter, we have some of those in the way of new projects such as res and aws-iatk, but we also have lots of really great content too. https://blog.beachgeek.co.uk/adding-llama2-to-ragna/ Thu, 16 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/adding-llama2-to-ragna/ Adding a new assistant in Ragna Following up from my previous post on Ragna, I wanted to share following the announcement of Meta’s Llama2 13b model availability within Amazon Bedrock, how you can incorporate that. I have also put together a GitHub repo that shares the code, something that I got quite a few questions from the original post. Adding Meta’s Llama2 As with adding Amazon Bedrock’s Anthropic’s Claude support, it was pretty straight forward to modify the original code to add support for Llama2. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-179/ Mon, 13 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-179/ November 13th, 2023 - Instalment #179 Welcome to #179 of the AWS open source newsletter, the place for all your AWS and open source needs. This weeks new projects include an open source tool that provides similar capabilities to AWS Control Tower, a tool for enrolling your Mac based EC2 instances into mobile device management (MDM) solution, a very neat tool to help you compare costs of running your CodePipeline jobs, as well as sample code that shows you how you can use Karpenter to optimise IP address use, examples of using Test Containers with AWS CDK, generative AI technologies such as LangChain, and more. https://blog.beachgeek.co.uk/getting-started-with-ragna/ Sun, 12 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/getting-started-with-ragna/ Unboxing Ragna: Getting hands on and making it to work with Amazon Bedrock I am always on the look out for interesting new projects to check out, and this week I came across Ragna, an open source Retrieval Augmented Generation RAG orchestration framework. It is a new project with a committed and active community, so I wanted to find out more about this project. What piqued my interest was reading this blog post, Unveiling Ragna: An Open Source RAG-based AI Orchestration Framework Designed to Scale From Research to Production which takes a look at the background, or as I like to think of it, the “scratch that needed to be itched”. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-178/ Mon, 06 Nov 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-178/ November 6th, 2023 - Instalment #178 Welcome to #178 of the AWS open source newsletter, the place for all your AWS and open source needs. This week we feature more new open source projects for you to practice your four freedoms. We have a useful tool that helps you synchronise your AWS Identity Centre users with the users you provision in your Amazon RDS databases, we share the AWS data solutions framework that helps you build data solutions following opinionated best practices, a resource explorer for your AWS accounts, a guardrails solution for your AWS account, and a couple of demo repositories that take a look at Localstack and RSS. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-177/ Mon, 30 Oct 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-177/ October 30th, 2023 - Instalment #177 Welcome to #177 of the AWS open source newsletter, the Halloween special. You will find no tricks in this edition, only treats, with more new projects for you to check out and content that are a feast for your eyes. This weeks new projects include a tool to help you easily deploy vector databases on Kubernetes, an observability toolkit, a tool to help you benchmark network latency, as well as lots of new demos on generative AI. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-176/ Mon, 23 Oct 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-176/ October 23rd, 2023 - Instalment #176 Welcome to #176 of the AWS open source newsletter, heading into Autumn and getting ready for the clocks to go back later in the week. How will you use that extra hour? Well, perhaps some of you might use it to check out this weeks new projects, which include a nice cli chat tool that uses Amazon Bedrock, a tool to help simplify deploying VSCode in the Cloud environments, and sample demos and code on chaos engineering, deploying Amazon Bedrock via AWS Lambda, and how you can use IAM Roles Anywhere to authenticate against external identity providers. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-175/ Mon, 16 Oct 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-175/ October 16th, 2023 - Instalment #175 Welcome to #175 of the AWS open source newsletter, back after recharging in the wonderful countyside of Yorkshire. I am publishing this weeks newsletter from Raleigh, North Carolina. All Things Open is happening this week, and you will catch me at the AWS booth where I will be showing off some cool open source stuff (Cedar, Apache Airflow, and a few others), and I also have a talk on Tuesday. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-174/ Mon, 18 Sep 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-174/ September 18th, 2023 - Instalment #174 Welcome to #174 of the AWS open source newsletter, which will be the last one for a couple of weeks as I take some time off to recharge. I will be back in early October with more open source goodness, but in the meantime, you still have this edition packed with open source goodness. This weeks new projects include a Rust tool to help you keep your CloudFormation stacks up to date, a tool to help upload files to Amazon S3, a generative AI tool that aims to help you review and detect IAM configuration issues, an updated JDBC driver for connecting to Amazon Aurora, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-173/ Mon, 11 Sep 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-173/ September 11th, 2023 - Instalment #173 Welcome to #173 of the AWS open source newsletter, bringing you all the news and latest projects for AWS developers. This weeks new projects include a Golang based SDK for kernel eBPF operations, a project that helps you to optimise your network performance, a couple of projects for Apache Flink users, as well as a handful of different tools and demos featuring open source technologies helping to drive innovation in generative AI. https://blog.beachgeek.co.uk/getting-started-with-griptape/ Tue, 05 Sep 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/getting-started-with-griptape/ Getting started with Griptape Getting gnarly with AI When I was much much younger, I was known to (very occasionally) drop an ollie, kick-turn, or very occasionally dare a drop in on my trusty skateboard. Thanks to the grip tape, my shoes would stick to the board, and gave me the confidence I could try these tricks. I was always grateful to that grip tape and who knew all these years later, I would become re-aquatinted with it (albeit in a different form! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-172/ Mon, 04 Sep 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-172/ September 4th, 2023 - Instalment #172 Welcome to #172 of the AWS open source newsletter, your reliable source for all open source on AWS goodness. What do we have for you this week? Well, more new projects to check out, and plenty of fresh content on the open source projects you all love. We have tools to help you export your DynamoDB tables as csv files, a tool that goes beyond tracking cost and actually shuts down resources to help you manage your AWS budget, a cool dashboard to help you stay on top of your EC2 configurations, a couple of useful utilities to simplify working with files on Amazon S3, and then a sample Cedar project that helps you implement a Lambda authoriser. https://blog.beachgeek.co.uk/code-whisperer-my-trusted-sidekick/ Mon, 04 Sep 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/code-whisperer-my-trusted-sidekick/ How are you using these new AI coding assistants like Amazon CodeWhisperer? I want to share a quick story about how I am finding some success with using these tools, which I hope will encourage you to experiment for yourselves. As I work on new projects, demos, blog posts, I often need to do supporting activities such as creating or cleaning up AWS environments, which I sometimes do by hand but mostly do via the AWS CLI or via Python scripts and boto3. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-171/ Tue, 29 Aug 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-171/ August 29th, 2023 - Instalment #171 Welcome to #171 of the AWS open source newsletter, the newsletter created for developers passionate about open source. Thanks to the wonderful August bank holiday here in the UK, we are publishing a day later than usual. If you have not read this newsletter before, we feature new projects, content from across the open source and AWS community, and share events and videos that you should check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-170/ Mon, 21 Aug 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-170/ August 21st, 2023 - Instalment #170 Welcome to edition #170 of the AWS open source newsletter, an oasis of open source goodness that features the latest new projects, essential reading, and must view videos to quench the thirst of every open source developer. This weeks edition we have new projects that help you get on top of your IAM actions, a handy tool for knowing what your current AWS account service limits are from the command line, a tool to help you do database migrations, and some interesting and very detailed reference solutions for gaming, live streaming, and managing/exporting of your Amazon Cognito profiles. https://blog.beachgeek.co.uk/airflowctl-first-look/ Mon, 14 Aug 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/airflowctl-first-look/ I have written in the past about setting up developer environments and tools when working with Apache Airflow. Today I came across a new tool from Kaxil Naik, directory of engineering at Astronomer and all round Apache Airflow good guy. Kaxil has put together airflowctl, a command-line tool for managing Apache Airflow™ projects, and making it super easy to get up and running. What does it do? Well, it helps you install and use different versions of Apache Airflow, work with Variables and Connections, provide live logs, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-169/ Mon, 14 Aug 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-169/ August 14th, 2023 - Instalment #169 Welcome to #169 of the AWS open source newsletter, featuring the latest and greatest open source news, projects, videos, and community content that you need to know about. Featured in this weeks edition we have more great projects, including a new ODBC driver for Amazon Timestream database, a nice tool to simplify your ssh tunnelling, an essential VSCode extension for working with Cedar policies, a couple of projects that help you shift left and validate / monitor your policies, a solution to help you monitor your Apache Kafka environments, as well as some great sample applications. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-168/ Mon, 07 Aug 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-168/ August 7th, 2023 - Instalment #168 Welcome to #168 of the AWS open source newsletter, the only newsletter that features the freshest open source and AWS content* New projects for you to feast on in this issue include the obligatory projects that look at how Generative AI can help developers be more productive, in this case by making documentation more relevant and easier to find and to help with code reviews, a nice tool to help you query your AWS Identity Access Management (IAM) policies, and a security focused tool to help you search for potentially incorrect configured S3 buckets. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-167/ Mon, 31 Jul 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-167/ July 31st, 2023 - Instalment #167 Welcome to #167 of the AWS open source newsletter, and another edition packed with new open source projects for you to explore. Whether you are new to this newsletter, or returning (we thank you!) there is something for you. This week we have projects that will help use Terraform to deploy your monolith applications, a tool to accelerate your GraphQL building when working with Amazon DynamoDB, a project that will help you introduce chaos without changes to your code, and a couple of really nice demos of using generative AI that allows you to use natural language to query your data. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-166/ Mon, 24 Jul 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-166/ July 24th, 2023 - Instalment #166 Welcome to #166 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks new projects include a library to help you managed and validate your environment variables when working with AWS Lambda, a new Rust based tool for interacting with your S3 buckets, an essential tool to help CDK developers remove a lot of the setup work, and a tool that helps you run Yocto embedded Linux build jobs in AWS. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-165/ Mon, 17 Jul 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-165/ July 17th, 2023 - Instalment #165 Welcome to #165 of the AWS open source newsletter, the only* newsletter that brings you the best and latest open source content. We have some great new projects this week, including a tool for IoT developers to help you validate your SQL statements, a command line interface tool for Amazon Verified Permissions, an Amazon DynamoDB estimation tool, and more. Also featured this week is content on Apache Iceberg, OpenSearch, PostgreSQL, Kubernetes, Power Tools for AWS Lambda, Spring Boot, Babelfish for Aurora PostgreSQL, Karpenter, Apollo GraphQL, JupyterHub, dbt, Apache Airflow, Cedar, and Apache Flink. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-164/ Mon, 10 Jul 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-164/ July 10th, 2023 - Instalment #164 Welcome to #164 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. New projects this week will help you implement single table designs easily on Amazon DynamoDB, an experimental project to help you get to grips with Cedar, a comprehensive clickstream analytics project for your applications, web sites, and mobile applications, and some cool projects to help you with edge and hybrid use cases. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-163/ Mon, 03 Jul 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-163/ July 3rd, 2023 - Instalment #163 Welcome to #163 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. This weeks featured projects include a Cedar authorisation service and demo examples, a tool to help you find dangling DNS records, a new CLI for those using Amazon ECR, an accelerator for observability on AWS, a serverless web analytics solution (so good, that I implemented it myself), and several more projects. https://blog.beachgeek.co.uk/deploying-open-source-clickstream-analytics/ Thu, 29 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/deploying-open-source-clickstream-analytics/ Update, August 1st I have been running this project for five weeks now, so have a better understanding of costs. My bill in July was $0.85, and I suspect this will be reasonably stable over the coming months. I think this represents great value! I will report back at the end of the year and update this Like many folk, I run a personal blog. This blog runs Hugo and turns my markdown pages into static content, which I then deploy on Netlify. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-162/ Mon, 26 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-162/ June 26th, 2023 - Instalment #162 Welcome to #162 of the AWS open source newsletter. As always, we search high and low for the best and latest open source content, and I think you will love what we have lined up this week. If you are looking for new projects to try out, then this weeks projects include a very handy tool for Amazon EKS admins, a new experimental project that looks to use ChatGPT to manage your AWS resources, a workshop on Generative AI on AWS, a new tool that helps simplify how you can connect to RDS resources, a PHP library to help you verify your JWT tokens, and a great example application of how you can use Cedar and Amazon Verified Permissions. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-161/ Mon, 19 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-161/ June 19th, 2023 - Instalment #161 Welcome to #161 of the AWS open source newsletter, and another week for fresh, new open source projects and code for you to practice your four freedoms. This weeks projects include tools that will help you create temporary elevated credentials, a new Java library that provides methods for encrypting and decrypting cryptographic materials, an AWS DynamoDB wrapper for Node/TypeScript developers, and a solution to help you find and visualise data assets. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-160/ Mon, 12 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-160/ June 12th, 2023 - Instalment #160 Welcome to #160 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you build data workflows, Terraform modules to help you incorporate temporary elevated access controls, integrating Tailscale to change your traffic flows, a neat AWS Lambda debugging tool, Go bindings for Cedar, and more. https://blog.beachgeek.co.uk/keycloak-on-aws-part-two/ Mon, 12 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/keycloak-on-aws-part-two/ This is the follow up post to Integrating Keycloak as my Identity Provider for IAM Identity Centre: Part one, deploying Keycloak on AWS, where I looked at how to deploy Keycloak on AWS in order to have an Identity Provider to use when configuring AWS Identity Centre. In this post, I am going to use that setup, and show you how I configured it to integrate with AWS Identity Centre to provide access to my AWS resources. https://blog.beachgeek.co.uk/active-directory-using-cdk/ Mon, 12 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/active-directory-using-cdk/ CIFS (Common Internet File System) and SMB (Server Message Block) are both Windows file-sharing protocols used in storage systems. As part of a new demo/blog post that looks at how to use data stored on SMB/CIF file shares with Apache Airflow, I have been exploring the various options of creating SMB/CIF compatible resources. (There are LOTS of ways you could do this, so there is plenty for me to play around with! https://blog.beachgeek.co.uk/keycloak-on-aws-part-one/ Tue, 06 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/keycloak-on-aws-part-one/ Integrating Keycloak as my Identity Provider for IAM Identity Centre: Part one, deploying Keycloak on AWS “It was the best of times, it was the worst of times…” A Tale of Two Cities It started out innocently enough. As part of working on a new blog post, I needed a way to use an open source tool called saml2aws that generates AWS short lived credentials that you can use to access your AWS resources. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-159/ Mon, 05 Jun 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-159/ June 5th, 2023 - Instalment #159 Welcome to #159 of the AWS open source newsletter, where we try and share all the important open source news, projects, events, and content that open source builders want. This week we have new projects that include tools to help you generate test data, an accelerator for stable diffusion, tools to help you with managing application credentials and variables, a new connector for Apache Kafka, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-158/ Tue, 30 May 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-158/ May 30th, 2023 - Instalment #158 Welcome Hello and welcome to the AWS open source newsletter, #158. I hope some of you were able to catch the last episode of season two of Build on Open Source where we looked at some of the projects featured in this newsletter (specctl, eksdemo, and ec2-spot-placement-score-tracker). As always we pride ourself on this newsletter on giving you the newest, shiniest open source projects and this week we have some really great ones to share with you. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-157/ Mon, 22 May 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-157/ May 22nd, 2023 - Instalment #157 Welcome Hello and welcome to the AWS open source newsletter, #157. Apologies for the lack of newsletter last week, but hopefully this week will make up for that as we have a bumper selection of great open source content for you. This weeks new projects include repos that help you get OpenEMR up and running (“host-openemr-on-aws-fargate”), two new security related open source projects that you definitely need to check out, (“cedar” and “snapchange”), integration of clickstream analytics using Swift (“clickstream-swift”), deployment of Backstage to serve up access to your AWS resources, (“app-development-for-backstage-io-on-aws”), a tool to help you clean up ecs tasks definitions (“aws-ecs-task-definition-cleanup”) and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-156/ Mon, 08 May 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-156/ May 8th, 2023 - Instalment #156 Welcome Hello and welcome to the AWS open source newsletter, #156, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. So what do we have for you this week? Coming up later in this newsletter we have projects such as “sustainability-scanner” helps you check your Cloudformation templates against sustainability good practices, “synthtable” helps you create synthetic data for different use cases, “neptune-gremlin-client” a Java based Gremlin client, “s3zipper” a tool to quickly download entire S3 buckets, “chataws” a nice demo of how you can use ChatGPT to aid your AWS deployments, and plenty of other great projects. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-155/ Sat, 29 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-155/ May 1st, 2023 - Instalment #155 Welcome Hello and welcome to the AWS open source newsletter, #155, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. This week’s new projects include “aws-cloudformation-controller-for-flux” provides a way to use flux to orchestrate your CloudFormation deployments, “threat-composer” is a nice React based tool to help you create Threat Models for your systems and applications, “cdk-integ-tests-sample” a tool to allow you to do integration tests with your CDK stacks (these three were all featured in the latest episode of Build on Open Source, you can watch it here), “iam-access-key-report” generates reports from your AWS accounts about your AWS access keys, “personalize-kafka-connector” provides an integration into Apache Kafka for this AWS service, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-154/ Mon, 24 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-154/ April 24th, 2023 - Instalment #154 Welcome Hello and welcome to the AWS open source newsletter, #154, the newsletter that just keeps on giving….in this case, keeps giving you brand new open source projects to practice your four freedoms on. We have another great selection of projects for you as always, starting off with “cfn-teleport” an essential cli tool for Cloudformation users, “aither” an interesting collaborative development tool using virtualised desktops on containers, “tabular-column-semantic-search” a tool to help you find similar types of data in your data lakes, “resource-lister” and “komiser” tools that help you manage your AWS resources, “resource-utilization” helps you track your AWS resource utilisation, “iot-network-traffic-control-and-load-testing-simulator” an interesting load and chaos testing example, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-153/ Mon, 17 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-153/ April 17th, 2023 - Instalment #153 Welcome Hello and welcome to the AWS open source newsletter, #153 as featured in the latest episode of Build on Open Source (S2E5) . We have lots of great projects for you this week, with a strong chatGPT influence. “pg_gpt”, “cw-logs-insights-gpt”, and “aiws” all integrate chatGPT to help you do different things on AWS, “semantic-search-aws-docs” is a very interesting demo on how to build a more coherent search for your documentation, “aws-chime-chat-demo” a very nice demo using the Chime SDK, “ckia” is an open source AWS Trusted Advisor tool, “AWS_ED” helps you keep your local IP in sync with external DNS records, “cfnctl” provides a Terraform like cli experience to CloudFormation, and more! https://blog.beachgeek.co.uk/mwaa-startup-scripts/ Mon, 17 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/mwaa-startup-scripts/ Managed Workflows for Apache Airflow (MWAA) recently launched a new feature that a lot of folk had been asking for, which was the ability to add additional libraries, binaries, or environment variables when launching Airflow workers. If you missed the announcement, Amazon MWAA now supports Shell Launch Scripts, this new capability allows you to easily do this by creating a script and then configuring your MWAA environments to use that script during the start-up phase. https://blog.beachgeek.co.uk/mwaa-local-runner-on-c9/ Mon, 17 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/mwaa-local-runner-on-c9/ Here is a quick recipe if you are looking to get mwaa-local-runner up and running on your Cloud9 developer setup. This might not be the most optimised way, so I am very happy to received suggestions on how to improve this. What I will cover here is how to deploy mwaa-local-runner onto a standard Cloud9 IDE, deployed in a default VPC. Updating my AWS Cloud9 environment The first thing I needed to do was to increase the size of my local disk as Cloud9 only provides 10gb of storage. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-152/ Mon, 10 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-152/ April 10th, 2023 - Instalment #152 Welcome Hello and welcome to the AWS open source newsletter, #152 an Easter special. This week sees more great new projects including, “redshift-test-drive” a set of essential tools for Amazon Redshift users, “simple-database-archival-solution” a nice tool to help you archive your data, “attribution-gen” a Go tool to help you build open source attribution documents, “aws-glue-data-catalog-federation” a library to help you federate your Glue catalog, “subnet-utilization-monitor-for-amazon-vpc” a handy tool to keep on top of your IP address allocation, “AlexaGPT” a demo of integrating Alexa with you know what, and more! https://blog.beachgeek.co.uk/using-redshift-with-mwaa/ Fri, 07 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/using-redshift-with-mwaa/ Working with Managed Workflows for Apache Airflow (MWAA) and Amazon Redshift I was recently looking at some Stack Overflow questions from the AWS Collective and saw a number of folk having questions about the integration between Amazon Redshift and Managed Workflows for Apache Airflow (MWAA). I thought I would put together a quick post that might help folk address what I saw were some of the common challenges. There is some code that accompanies this post, which you can find at the GitHub repository cdk-mwaa-redshift. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-151/ Mon, 03 Apr 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-151/ April 3rd, 2023 - Instalment #151 Welcome Hello and welcome to the AWS open source newsletter, #151. This week sees more great new projects, including those covered in the latest episode of Build on Open Source, such as “ec2-former2” a way to host this great project to reverse engineer your CloudFormation templates, “protonizer” a cli tool for those using AWS Proton, “fortuna”, a library for Uncertainty Quantification, “aws-resilience-hub-tools” a set of tools and scripts for working with the AWS Resilience Hub, “jenkins-unity-build-on-aws” a nice reference solution for those needing to build Unity projects, “amazon-cognito-passwordless-auth” a nice demo of how to do authentication sans password, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-150/ Mon, 27 Mar 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-150/ March 27th, 2023 - Instalment #150 Welcome Hello and welcome to a milestone edition of the AWS open source newsletter, #150. Over two hundred thousand words later, thousands of contributors, hundreds of new open source projects, I hope this newsletter brings as much joy for readers as it does for me to put this together. Thank you all for your amazing support so far. What do we have in store for you this week? https://blog.beachgeek.co.uk/self-managed-apache-airflow-using-doeks/ Wed, 22 Mar 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/self-managed-apache-airflow-using-doeks/ I have written in the past about how you can get started with Apache Airflow using the AWS managed service, Managed Workflows for Apache Airflow. But what if you want to self managed Apache Airflow? When I speak with developers, there are sometimes reasons why a managed service might not fit their needs. Some of the common things that come up include: whether you need the increase level of access, a greater level of control of the configuration of Apache Airflow have the need to have the very latest versions or features of Apache Airflow if you have the need to run workflows that use more resources that managed services provide (for example, need significant compute) Total Cost Ownership One thing to consider when assessing managed vs self managed is the cost of the managed service against the total costs of you having to do the same thing. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-149/ Sun, 19 Mar 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-149/ March 20th, 2023 - Instalment #149 Welcome Hello and welcome to edition #149 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. I hope some of you were able to catch this episode reviewed on our last Build on Open Source livestream. If not, you can catch the replay here. This week we have projects such “mountpoint-s3”, “s3-access-for-squash”, and “amazon-s3-tar-tool” which provide some useful tools for managing your files on S3, “aws-serverless-ai-stories” a creative masterclass in storytelling, “earthquake-notifier” a serverless solution to keep you alerted and ready, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-148/ Sun, 12 Mar 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-148/ March 13th, 2023 - Instalment #148 Welcome Hello and a warm welcome to edition #148 of the AWS open source newsletter, the only newsletter on the planet that serves you up a weekly dose of the freshest, latest open source projects on AWS. This week we have projects such as “iam-ape” a tool to help you grapple with your IAM policies, “amazon-emr-cli” a nice command line tool to package and deploy your Spark jobs on Amazon EMR, “duckdb-athena-extension” that helps you import data from Amazon Athena into DuckDB, “terraform-aws-email-files-dropped-in-s3” a helpful tool to easily email you attachments automatically, “cloud-queue-for-quantum-devices” a tool to help Quantum researchers across the world, “aws-private-ca-matter-infrastructure” a sample reference architecture for setting up a secure, private certificate authority, “aws-sam-cli-java-examples” will help you deploy your Java apps via AWS SAM, “mpartman” a PostgreSQL partition manager, “aws-do-pcluster” simplifying how to run AWS ParallelCluster, “staticwebsite-cli” a very nice too to help you easily deploy static web sites, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-147/ Mon, 06 Mar 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-147/ March 6th, 2023 - Instalment #147 Welcome Welcome to edition #147 of the AWS open source newsletter, featured in the latest episode of Build on Open Source. This week we have new projects such as “metahub” and “savings-estimator” that we looked at in closer detail on the Build on Open Source livestream, “aws-iot-core-credential-provider-session-helper” a Python library to help simplify working with AWS IoT, “traffic-inspection-architectures-aws-cloud-wan” code that provides examples of different network architectures and how to do traffic inspection, “neptune-export” a tool to help you export your data in Amazon Neptune, “aws-organizations-tool” a command line tool to help you configure AWS Organisations, “sagemaker-external-repo-access” a nice reference architecture for Amazon Sagemaker, “aws-cdk-cfn-hook” a Python CDK app that will get you up and running quickly working with Cloudformation template hooks, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-146/ Mon, 27 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-146/ Feb 27th, 2023 - Instalment #146 Welcome to edition #146 of the AWS open source newsletter. This week we have another great selection of brand new, shiny open source projects for you to practice your four freedoms on. Some of the projects this week include “aws-lambda-web-adapter” that will help you build portable Lambda functions, “aws-marketplace-cli” if you want to escape the GUI when working with AWS Marketplace, this one is for you, ““otel-config-validator” helps you sanity check your configuration files, “aws-serverless-openai-chatbot-demo” build a personal assistance powered by ChatGPT, “drone-video-analysis” if you have wanted to use AI services to process your drone video footage, check this project out, “mask-words-in-image” a nice command line tool to quick mask data based on your needs, and many more cool projects. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-145/ Mon, 20 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-145/ Feb 20th, 2023 - Instalment #145 Welcome to edition #145 of the AWS open source newsletter. I hope some of you were able to catch the new Build on Open Source show we live streamed last Friday. You can catch up and replay the session by clicking on this link, where we went over a number of projects from this and a few previous newsletters, and we had special guest Valter who walked us through his project terraform-dev-containers. https://blog.beachgeek.co.uk/using-vscode-with-airflow/ Mon, 20 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/using-vscode-with-airflow/ VSCode and Apache Airflow In this short post, I wanted to highlight how you can use a VSCode plugin to work with a local running instance of Apache Airflow to improve the developer experience. This post was inspired by a tweet from Kaxil Naik who was asking about what features developers are looking for when using VSCode and Pycharm and Apache Airflow. In this post I will show you how you can configure mwaa-local-runner, an open source project that provides you with an easy way to get a local Apache Airflow environment up and running (that is configuration wide, aligned to the Amazon Managed Workflows for Apache Airflow service MWAA), together with some VSCode plugins. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-144/ Sun, 05 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-144/ Feb 5th, 2023 - Instalment #144 Welcome to edition #144 of the AWS open source newsletter, and another week of great new open source projects for you to try out. Some of the treats in store for you this week include “dynamodb-shell”, a project that provides a cli to your favourite AWS database, “precloud” a tool to help you catch issues with your configuration before you deploy, “node-latency-for-k8s” a tool to analyse your node logs, “stepfunctions-lambda-ec2-ssm” a very nice way of using step functions to overcome the 15 minute timeout of your lambda functions, “terraform-ec2-image-builder-container-hardening-pipeline” a very cool example of how to build an EC2 image hardening pipeline using Terraform, and “cloudtrail-event-fuzzy-viewer” a tool to copy your AWS CloudTrail events and then fuzzy search them on the command line. https://blog.beachgeek.co.uk/sbomqs-an-open-source-tool-to-qa-sboms/ Thu, 02 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/sbomqs-an-open-source-tool-to-qa-sboms/ When putting together a previous post on how to use open source tools to create a software bill of materials (SBOM), Ritesh Noronha alerted me to another project, sbomqs that aims to simplify the evaluation of SBOM quality for both producers and consumers. A quality SBOM is one that is accurate, complete, and up-to-date. It should accurately reflect the components and dependencies used in the software application, including their version and optionally any known vulnerabilities. https://blog.beachgeek.co.uk/building-sbom-with-syft/ Wed, 01 Feb 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/building-sbom-with-syft/ This is the second post exploring how you can use open source tools to help you build a stronger defence against common software supply chain attacks. In this blog post, I look at syft, an open source CLI tool and Go library for generating a Software Bill of Materials (SBOM) from container images and filesystems. We will use examples and build on the previous post, Getting hands on with Sigstore Cosign on AWS. https://blog.beachgeek.co.uk/getting-hands-on-with-sigstore-cosign-on-aws/ Tue, 31 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/getting-hands-on-with-sigstore-cosign-on-aws/ Getting hands on with Sigstore Cosign on AWS I am currently putting together some content around how you can use a number of open source tools to help build a stronger defence against common software supply chain attacks. In this blog post, I look at emerging tools from Sigstore, and focus in this post on Cosign, a tool that supports container image signing, verification, and storage in an Open Container Initiative (OCI) registry. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-143/ Mon, 30 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-143/ January 30th, 2023 - Instalment #143 Welcome to edition #143 of the AWS open source newsletter, and another week of great new open source projects for you to try out. This week we feature projects including “aws-cdk-in-electron”, a project that lets you put AWS CDK in a graphical user interface, “lightsail-k8s-installer” that helps you deploy Kubernetes into Amazon Lightsail, “porting-advisor-for-graviton” a great project to help you migrate to Arm based AWS Graviton instance types, “aws-ebook-downloader” a browser tool to help you easily download pdf’s on AWS topics, “lake-formation-permissions-sync” a useful tool to help you keep on top of your Lake Formation setups, and many more. https://blog.beachgeek.co.uk/mwaa-eks-no-oidc/ Thu, 26 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/mwaa-eks-no-oidc/ Configuring the KubernetesPodOperator on Managed Workflows for Apache Airflow (MWAA) - non OIDC Amazon EKS Clusters Today I came across an interesting question around the use of the KubernetesPodOperator working on EKS Clusters where you have not configured OIDC. They had followed my blog post, and when it came to running the DAG, they got the following error: [2023-01-26, 13:03:18 UTC] {{kubernetes_pod.py:566}} INFO - Creating pod mwaa-pod-test.0ab20a7075b84175b2a9a3fe32796f53 with labels: {'dag_id': 'kubernetes_pod_example_iam_authenticator', 'task_id': 'pod-task', 'execution_date': '2023-01-26T130310. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-142/ Mon, 23 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-142/ January 23rd, 2023 - Instalment #142 Welcome Welcome to edition #142 of the AWS open source newsletter. We have another great round up of new projects for you to get stuck into. Here are just a taste of some of the projects, kicking off with “sls-mentor” a new tool to help you assess your serverless applications, “subnet-watcher”, a tool to help you monitor your IP addresses, “aws-cdk-web-administered-apps” a very nice reference solution for applications that have a user and admin component, “serverless-newsletter-app” if you are looking for a newsletter solution and want to host your own, look here first, “aws-iot-with-privatelink” shows you how you use private networks for your IoT traffic, “emr-spark-benchmark” benchmarking tool for assessing your Amazon EMR environments, and “update-aws-ip-ranges” keep automatically updated on Amazon’s IP address ranges. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-141/ Sun, 15 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-141/ January 16th, 2023 - Instalment #141 Welcome Welcome to the AWS open source newsletter of 2023, edition #141. This week we have more new projects for you to practice your four freedoms, including “distributed-compute-on-aws-with-cross-regional-dask”, a solution to simplify distributed compute using Dask, “amazon-emr-serverless-image-cli” a tool to verify your Amazon EMR custom container images, “serverless-run-watch” a tool to help accelerate your local development if you are using the Serverless Framework, “aws-sso-auto-expand-accounts” a quick browser extension for those using AWS SSO, “basti” a cool Bastion Host alternative, “klotho” generate cloud native code from your code, “amazon-route53-hosted-zone-sync” a nice solution for hybrid DNS use cases, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-140/ Mon, 09 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-140/ January 9th, 2023 - Instalment #140 Welcome Happy New Year and welcome to the first AWS open source newsletter of 2023, edition #140. If you have not already checked it out, I put together a short retrospective summary of 2022 in the post, AWS open source newsletter - 2022 in review. There are some interesting facts and figures in there. I am also taking time to collect feedback from readers to help shape where this newsletter goes in 2023. https://blog.beachgeek.co.uk/mwaa-eks-multi-aws/ Mon, 09 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/mwaa-eks-multi-aws/ Running KubernetesPodOperator in different AWS accounts update August, 14th I wanted to update to newer version of MWAA, so I have tested the original blog post against EKS 1.24 and MWAA version 2.4.3. I also had a few messages about whether this would work across different AWS regions. The good news is that it does. I have also put together a repo for this here I thought that I would also check/update that it works for newer versions of MWAA, so I had 2. https://blog.beachgeek.co.uk/newsletter/aws-open-source-newsletter-2022-review/ Thu, 05 Jan 2023 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-newsletter-2022-review/ The AWS open source newsletter - review of 2022 I wanted to kick off 2023 by sharing some data points and things of interest that came up in 2022 as part of writing and putting together this open source newsletter. Given the nature of the newsletter, and that transparency and openness is core to open source, I hope these might be interesting to some of you. In 2022, I published 45 newsletters over the course of the year. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-139/ Sun, 18 Dec 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-139/ December 18th, 2022 - Instalment #139 Welcome Welcome to the last AWS open source newsletter of 2022, edition #139. I am planning on take a few weeks off to recharge, and wish readers of this newsletter a fabulous Christmas and New Year. Over 100K of you have read this newsletter, so I want to thank you all for your continued support. This newsletter is only possible because of the passion and enthusiasm of open source Builders, and I look forward to seeing what 2023 will bring. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-138/ Mon, 12 Dec 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-138/ December 12th, 2022 - Instalment #138 Welcome Welcome to the AWS open source newsletter, edition #138. After a week off due to re:Invent, this edition is packed with content on many of the open source related announcements. As always, we have a great line up of new projects for you to practice your four freedoms on. In no particular order, we have projects like “eks-node-viewer”, a nice visualisation tool for your Amazon EKS clusters, “pg_tle” a great new project to make your PostgreSQL environments safer, “dyna53” a fun project that finally turns Amazon Route 53 into a database, “dynamodb-mass-migrations” a tool to help you migrate to Amazon DynamoDB, “visual-asset-management-system” a very nice digital asset management tool, “fast-differential-privacy” implement differential privacy in your PyTorch models, “migration-hadoop-to-emr-tco-simulator” a handy total cost of ownership calculator for Amazon EMR, “realtime-toxicity-detection” a tool to help you stay on top of your online communities, “functionclarity” a very cool tool to check the integrity of your serverless functions before executing, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-137/ Fri, 25 Nov 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-137/ November 25th, 2022 - Instalment #137 Welcome Welcome to the AWS open source newsletter, edition #137. As it is re:Invent next week, I will be publishing the newsletter early as I am heading out on Monday. I will be in Las Vegas talking with open source Builders, hanging out on the Open Source Kiosk in the AWS Village, and doing some talks. If you are coming, I would love to meet some of you, so get in touch. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-136/ Mon, 21 Nov 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-136/ November 21st, 2022 - Instalment #136 Welcome Welcome to the AWS open source newsletter, edition #136, as featured on the latest episode of Build on Open Source. This week we feature new projects including “dynamoit” a JavaFX gui for Amazon DynamoDB, “building-apache-kafka-connectors”, “msk-config-providers”, and “msk-serverless-data-pipeline” projects to help make your life easier when working with Apache Kafka, “stowrs-to-s3” a tool for working with STOWRS data on AWS, “aws-device-lobby” a tool to make onboarding devices into AWS IoT Core easier, “aws-graviton-run-confidential-ml-workloads-using-nitro-enclaves” a nice example of how you can do Confidential Computing for machine learning use cases, “aws-hpc-builder” a tool to help you manage your open source HPC tools, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-135/ Fri, 11 Nov 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-135/ November 11th, 2022 - Instalment #135 Welcome Welcome to the AWS open source newsletter, edition #135. What do we have in store for you in this weeks instalment? I am happy to report that we have yet more great new projects this week. These include “sovereign-keys” and “nitrogen” are new projects to help you secure and get started working with enclaves, “aws-serverless-scheduler” helps you schedule your events, “aws-resource-explorer-cli” provides a command line tool for this new capability, “workload-discovery-on-aws” helps you stay on top of your AWS workloads, ““image-content-moderation” provide a sample project for image moderation you can integrate into your workflows, “cloudenv” is a proof of concept that explores managing secrets and prameters, “cdk-schema-watcher” is a tool to help you stay notified of schema changes in your event driven applications, and several other projects to check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-134/ Mon, 07 Nov 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-134/ November 7th, 2022 - Instalment #134 Welcome Welcome to the AWS open source newsletter, edition #134. This weeks newsletter was featured in the latest Build on Open Source on twitch.tv/aws, so I hope some of you were able to tune in and watch. New projects that we featured include “enclaver”, a toolkit to make working with enclaves easier, “s3crets_scanner” a new secrets scanning tool, “sandbox-accounts-for-events” a way to easily vend temporary environments, “frontend-discovery” helps you define and drive adoption of a frontend discovery patterns, “cf-sam-openapi-file-organization-demo”, a tool to help you get started with API development, “decoupling-microservices-lambda-amazonmq-rabbitmq” a sample solution to get you started on how to use micro services with RabbitMQ, “how-to-write-more-correct-software-workshop” a workshop to get you developing better software, and more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-133/ Fri, 28 Oct 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-133/ October 28th, 2022 - Instalment #133 Welcome Welcome to the AWS open source newsletter, edition #133. This week has been all about KubeCon, and there were some important announcements from AWS. If you missed these, I have tried to capture the important ones here, but I want to start off with probably my favourite which was the announcement during Nate Taber keynote on some of the investments we are providing to CNCF and OpenSSF. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-132/ Fri, 21 Oct 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-132/ October 21st, 2022 - Instalment #132 Welcome Welcome to the AWS open source newsletter, edition #132. This newsletter was covered in last Friday’s Build on Open Source, so if you missed it, don’t worry as you can view episode five of Build on Open Source. In this episode special guest Abhishek Gupta walked us through how to use cdk8s using Golang, building a Wordpress site in minutes. New projects this week include “duvet” a tool to help honour RFC in code, “aws-lambda-explorer” a gui tool to explore your AWS Lambda functions, “k3s-aws-terraform-cluster” deploy k3s on AWS via Terraform, “snow-transfer-tool” a tool to help you transfer data via Snowball devices, “amazon-emr-vscode-toolkit” a new VSCode plugin for Amazon EMR users, “aws-cdk-for-discourse” a quick way to deploy the open source discourse tool, “image-optimization” a reference example of how to do image optimising, and “gtfs-serverless-ticketing-sample” a sample application using public transport data. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-131/ Mon, 17 Oct 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-131/ October 17th, 2022 - Instalment #131 Welcome to the AWS open source newsletter, edition #131. This week’s new projects include “metahub”, a command line way to interact with AWS Security Hub, “somod” a framework for creating micro applications in serverless, “terraform-aws-guardduty-multiaccount” a Terraform module to help you automate your AWS Guard Duty configuration, “aws-glue-cdk-cicd” a sample project to automate the creation data pipelines using AWS Glue, “go-kafka-event-source” an Apache Kafka client in Go, “project-tools” a tool to help you get insights from your GitHub repo, “eks-event-watcher” a command line tool to tail your Amazon EKS logs, “listmonk-based-edm-solution” an example of how to deploy this open source mailing list tool, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-130/ Mon, 10 Oct 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-130/ October 10th, 2022 - Instalment #130 Welcome Welcome to the AWS open source newsletter, edition #130. This newsletter was featured in the Build on Open Source episode four, which you can check out here if you missed it. New projects for you to practice your open source four freedoms this week include “grucloud” a new infrastructure as code tool with some nice features, “stepfunctions-sdk-autocomplete” a VSCode plugin for all you AWS Step Functions fans, “AWS_Billing_Overage_Shutdown” a very new repo that has some code to help you automate shutting down resources on alerts, “aws-secrets-manager-github-action” if you are using GitHub Actions, this one is for you, “meta-aws”, tools and recipes for those using and building with Yocto, “data-on-eks” a number of sample solutions to configure self managed open source data analytics tools, “cql-replicator” a tool to help you migrate from self managed Apache Cassandra to Amazon Keyspaces, “ec2-imagebuilder-ami-lifecycle” provides some new capabilities for those building AMIs, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-129/ Fri, 30 Sep 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-129/ September 30th, 2022 - Instalment #129 Welcome Welcome to the AWS open source newsletter, edition #129. We have loads of great new projects this week, with plenty of variety to keep you all interested. We have “aws-ecr-cleaner”, a great tool to help you manage your container images, “dotnet-lambda-sql-server-proxy” that shows you how you can use RDS Proxy with SQL Server and why, “minecraft-server-dashboard” perfect for those running their own minecraft servers, “YATAS” and “aws-security-survival-kit” for those working on security and governance, “aws-lambda-handler-cookbook” useful recipes to get you going, “autonomous-driving-data-framework” for folks working in the automotive space, and many more - make sure you check all the projects out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-128/ Fri, 23 Sep 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-128/ September 23rd, 2022 - Instalment #128 Welcome Welcome to the AWS open source newsletter, edition #128. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed our special guest, Gethin Webster as he walked us through the open source Cloudscape project. If you want to catch up on that event, check out the video here. This weeks opens new open source projects include “Guardian”, a command line tool that produces nice reports on your AWS environments, “cdk-scheduler”, a new construct that helps you schedule your CDK deployments, “terraform-iam-policy-validator” a script that helps you validate your Terraform scripts, “aws-cdk-golden-ami-pipeline” an example of how to build an automated pipeline to build Amazon Machine Images (AMI’s), and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-127/ Fri, 16 Sep 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-127/ September 16th, 2022 - Instalment #127 Welcome Welcome to the AWS open source newsletter, edition #127. I hope some of you were able to catch Derek and myself sharing a peek at this edition, and enjoyed as our special guest, AWS Hero Ian Mckay walked us through some of his open source projects. It was very cool indeed, and if you have not yet watched, Ian shares an early glimpse of a new project - so make sure you check that out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-126/ Fri, 09 Sep 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-126/ September 9th, 2022 - Instalment #126 Welcome Welcome to the AWS open source newsletter, edition #126. Exciting news this week includes the second episode of the Build on AWS open source show, and the release of a new AWS open source project, event-ruler (more in a bit). As always, this weeks newsletter includes more great new open source projects from AWS and the AWS Community. We have “aws-integration-for-apache-guacamole” that provides a guide of how you can deploy this open source project, “xcodeinstall” a tool to help you heedlessly install Xcode, “soci-snapshotter” a very cool project for Container lovers, “credentials-fetcher” a new Linux demon for those wanting to integrate with Windows environments, “imds-credential-server” a very nice tool to help you vend AWS credentials, “automated-data-analytics-on-aws” a new data tool that will help you accelerate time to insights, and “event-ruler” a very cool new project allowing you to match Rules to Events, and many other projects for you to check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-125/ Fri, 02 Sep 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-125/ September 2nd, 2022 - Instalment #125 Welcome After a couple of weeks off, it is great to welcome to back to the AWS open source newsletter, edition #125. As it has been a couple of weeks, this edition contains even more open source goodness to keep you occupied. As always, we kick things off we a round up of new open source projects. Over the past couple of weeks, there were so many that it was hard to select them (I will include the others in next weeks newsletter). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-124/ Fri, 12 Aug 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-124/ August, 12th, 2022 - Instalment #124 Welcome Welcome to edition #124 of the AWS open source newsletter. This is a very special edition as this will be the first edition that we cover in the new Build on AWS Open Source fortnight show on twitch.tv/aws. I hope some of you were able to attend, but if not don’t worry we will be sharing links to the recording. To keep up to date on future episodes, make sure you follow @buildonopen. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-123/ Fri, 05 Aug 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-123/ August, 5th, 2022 - Instalment #123 Welcome Welcome to the AWS open source newsletter episode #123. I sometimes speak with builders who are experienced developers but perhaps new to open source. A common question I get asked is what the impact of them working on open source might be on their careers. Whilst it is never a guarantee, open source can be a great career accelerator. I was reminded of that last week when reading the excellent post from Ran Isenberg, who shared his experience in his post How One Open-Source Code Donation Got Me Promoted. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-122/ Fri, 29 Jul 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-122/ July 29th, 2022 - Instalment #122 Welcome Welcome back to my regular readers and hello to new readers, I hope you will enjoy and come back again to the AWS open source newsletter episode #122. This week we have another great collection of community and AWS related open source tools, demos and samples for you to practice your open source four freedoms. “rds_auto_encrypt” helps you encrypt your Amazon RDS databases, “middy-profiler” is an interesting looking tool to help you understand performance characteristics of your AWS Lambda functions, “simpleiot” is a very nice looking IoT framework to help simplify how you can onboard devices into AWS IoT, “aws-secrets-manager-hybrid-secret-replication-from-hashicorp-vault” (bit of a mouthful to say that one) helps you synchronise your secrets across different secret providers, “automated-forensic-orchestrator-for-amazon-ec2” is a very nice reference solution for automating some of your operational security activities, and we have several other projects for you to dive deep into. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-121/ Fri, 22 Jul 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-121/ July 22nd, 2022 - Instalment #121 Welcome to regular and new readers alike, to the AWS open source newsletter episode #121. Am super excited about this weeks new projects, including a number of AWS CDK related projects so if you are a fan of AWS CDK then make sure you check them all out. We feature projects such as “openrolesanywhere”, a proof of concept client for the recently released AWS IAM Roles Anywhere, “amazon-redshift-odbc-driver” an open source ODBC driver for Amazon Redshift, “spot-interruption-simulation” a very handy tool to help you test and simulate spot interuptions for your EC2 workloads, “magento-ecs-cdk” a quick way to deploy a scalable Magento environment, “using-rekognition-to-detect-sounds” a very interesting project that will help you hear sounds from your pictures (yes, you did not read that wrong! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-120/ Fri, 15 Jul 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-120/ July 15th, 2022 - Instalment #120 Welcome to regular and new readers alike, to the AWS open source newsletter episode #120. The observant will have noticed that it has been two weeks since the last newsletter. We all need some time off, and I spent most of the time cycling around the hills of a new cycle route called King Alfreds Way - highly recommended. There has been some great new projects created over the past couple of weeks, and of course I have you covered and have shared them below. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-119/ Fri, 01 Jul 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-119/ July 1st, 2022 - Instalment #119 Welcome to regular and new readers alike, to the AWS open source newsletter episode #119. This week we feature more new open source projects, such as “cdk-bill-bot”, a tool that can help you reduce AWS bill surprises, “steampipe-mod-aws-perimeter” helps you look for resources that are publicly accessible, “aws-cloudformation-diagrams” is a nice visualisation tool for CloudFormation users, “aws-swagger-ui” a project to help you set up Swagger UI for API Gateway, “kinesis-hot-shard-advisor” a handy tool that helps you identify whether you have hot key or hot shard issues on your Kinesis data streams, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-118/ Fri, 24 Jun 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-118/ June 24th, 2022 - Instalment #118 Welcome to regular and new readers alike, to the AWS open source newsletter episode #118. This week we feature more new open source projects, such as “seed-farmer”, and orchestration tool modelled after GitOps deployments, “aws-proton-plugins-for-backstage” Backstage plugins for interacting with AWS Proton, “dcv-gnome-shell-extension” is a GNOME Shell extension to provide functionalities required by NICE DCV, “simpleiot-arduino” an Arduino library to integrate with the SimpleIOT framework, “event-driven-weather-forecasts” an event driven weather forecasting demo, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-117/ Fri, 17 Jun 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-117/ June 17th, 2022 - Instalment #117 Welcome to regular and new readers alike, to the AWS open source newsletter episode #117. A little behind schedule this week, as I have been speaking at a couple of events this week. It has been good to get back on the stage and to talk and engage with real people. It seems that things are quickly returning back to normal. So this week we have some great new projects for you. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-116/ Fri, 10 Jun 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-116/ June 10th, 2022 - Instalment #116 Welcome to regular and new readers alike, to the AWS open source newsletter episode #116. Another selection of useful and interesting new open source projects for you to try out this week. First up, we have “aws-exec” a tool to help you do adhoc shell execution in AWS Lambda functions, “edgy” helps you simplify writing tests for Node.js based AWS CloudFront Lambda@Edge functions, “cdk-app-cli” a really nice cli that every AWS CDK user should know about, “Accumulus” a great looking reporting tool for AWS Lambda users, “sqldef-gitops-cdk” is a schema management for several open source databases, “log-hub” helps you to build your own log analytics tool using OpenSearch, “verifiable-controls-evidence-store” a very cool solution that builds a mechanism to centrally store findings and results of cloud security controls governing AWS workloads, and many more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-115/ Fri, 03 Jun 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-115/ June 3rd, 2022 - Instalment #115 Welcome to regular and new readers alike, to the AWS open source newsletter episode #115. This week we have another great selection of brand new open source projects for you to explore, including “firec” a Rust client library for interacting with Firecracker, “sfn-cli” a tool that helps you quickly build StepFunctions definitions, “ssm-cloner” a tool to help you replicate across AWS regions your AWS System Manager documents, “amazon-lambda-compute-tuning” an AWS Lambda function benchmarking tool, “aws-iam-root-user-activity-monitor” a sample project to help you keep track of your root user, “hpc-cost-simulator” a tool to help estimate costs running your HPC workloads on AWS, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-114/ Fri, 27 May 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-114/ May 27th, 2022 - Instalment #114 Welcome to the AWS open source newsletter #114. This weeks new open source projects feature a variety of community related projects such as “instance-scheduler” a tool to help you schedule AWS resources, “libaws” an opinionated tool that helps you simplify creation and deletion of some AWS resources, “elasticspot” a nice tool to help you reassign elastic IPs, and “auto-close-aws-accounts” that allows you to close AWS accounts if you are using AWS Organisations. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-113/ Fri, 20 May 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-113/ May 13th, 2022 - Instalment #113 Newsletter #113. A little later than usual this week thanks to KubeCon, #113 of the AWS open source newsletter provides you with yet more new open source projects. “aws-iam-utils” is a Python library to help you work with IAM, “iot-app-kit” is a new IoT visualisation framework, “s3pathlib-project” that provides the Pythonic objective oriented programming (OOP) interface to manipulate AWS S3 object / directory, “collaboration-chambers-on-aws” which is a cool and very comprehensive project to help you do Scale-Out Computing on AWS, and many more! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-112/ Fri, 13 May 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-112/ May 13th, 2022 - Instalment #112 Newsletter #112. Welcome to this weeks round up of AWS open source news. This weeks new projects features projects such as “aws-dataall” an open source framework for building a data marketplace, “backpack” a set of tools to help you work with the AWS Panorama devices, and we have other projects that help you automate DNS tasks, manage game servers, automate data ingestion, and more. https://blog.beachgeek.co.uk/creating-digital-lanyards/ Mon, 09 May 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/creating-digital-lanyards/ Experimenting with digital lanyards As someone who attends events on a regular basis, I have spent a fair bit of time over the years looking at interesting ways to engage with attendees. One of the problems I was looking to solve was how do I share useful information with attendees without having to interrupt the conversations (something that typically happens as I try and find those links on my mobile phone). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-111/ Fri, 06 May 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-111/ May 6th, 2022 - Instalment #111 Newsletter #111. Welcome to edition #111 of the AWS open source newsletter, a bit later this week but that was so I could pack in even more great open source content. This week we have another round up of new open source projects from the AWS community that include tools to help you manage your AWS CloudFront distributions, resource providers for CloudFormation for Confluent users, managing Amazon Route53 via the command line, a nice tool for Rust developers working with AWS Lambda, a nice tool to help you find your CIDR address ranges, and many more including some great samples. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-110/ Fri, 29 Apr 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-110/ April 29th, 2022 - Instalment #110 Newsletter #110. Welcome to edition #110 of the AWS open source newsletter. It has been a busy week, with the AWS Summit London happening this week (where I was lucky enough to do a session on Apache Airflow) meaning I am publishing this a little later than I had planned. We have more great new projects this week, including a project that helps make it easier to deploy your static and dynamic applications, a tool that provides help in managing the long term health of your AWS Data Lake, a cool project to help you replicate data from a Kinesis Data Stream across regions, a nice CloudWatch dashboard widget that summarises your CloudFormation stacks, and many more - so check them out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-109/ Fri, 22 Apr 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-109/ April 22nd, 2022 - Instalment #109 Newsletter #109. Welcome to edition #109 of the AWS open source newsletter. Big news, I have shaken things up and will be changing the publish date to Friday mornings, starting today with this edition. Over the months I have received some feedback about changing the published date to Fridays, so I am hoping this will give everyone plenty of time to check out the projects, read the posts and provide everyone with something to do over the weekend (if they want! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-108/ Mon, 11 Apr 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-108/ April 11th, 2022 - Instalment #108 Newsletter #108. A little later the usual as it was a busy week last week, and I was lucky enough to speak at some great events. It certainly seems that things are returning to normality now on the tech events scene, and it was great to meet so many customers and builders who were enthusiastic champions of open source. The AWS Summit season is upon us, with the Brussels summit just gone and Paris Summit happening this week. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-107/ Mon, 04 Apr 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-107/ April 4th, 2022 - Instalment #107 Newsletter #107. Welcome to edition #107 of the AWS open source newsletter, and we have a bumper edition this week packed with more great new open source projects and content for you to consume. Topics featured this week include optimising open source big data tools, developer tooling, case studies and we even some some great open source content for .NET core developers. This weeks projects include a really nice handy browser plugin called “aws-search-extension”, that lets you search and find developer information from the AWS docs, a tool that will help you detect whether you have configured or using dockershim in your Kubernetes clusters, a library to help you integrate Amazon Cognito in your Laravel PHP applications, and plenty more developer tools and sample projects. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-106/ Mon, 28 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-106/ March 28th, 2022 - Instalment #106 Newsletter #106. Welcome to the AWS open source newsletter, and this week we have more great new open source projects to tell you about. We have “access-undenied-aws”, a tool that helps you better understand your CloudTrail logs and suggest remediation. “aws-slack-clickoops-watcher” provides you with a way to alert you when changes are made to your AWS environment. “kronicle” provides a way of illustrating your tech stack automagically, and we have many more tools, demos and sample projects to help get you started on a number of topics. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-105/ Sun, 20 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-105/ March 21st, 2022 - Instalment #105 Newsletter #105. Welcome to edition #105 of the AWS open source news and updates, where we bring you the latest open source projects, posts, events, and much more. This weeks new projects include the latest work in progress from AWS Hero Ian Mckay, “iamfast” is an AWS IAM policy generation tool that is in early stages but promises to be very useful indeed. “iasql-engine” is a tool that models cloud infrastructure as data, “ssm-patch-portal” provides a nice gui front end to simplify patching with AWS System Manager, a new crowdsource guide that contains learning resources for AWS, a business intelligence platform built using open source technologies from the NHS, and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-104/ Mon, 14 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-104/ March 14th, 2022 - Instalment #104 Newsletter #104. Welcome to #104 of the AWS open source news and updates newsletter, bringing you the latest updates from around the AWS and Communities. This week we have yet more great new open source projects, including a Deno runtime for your Lambda functions, data lineage and data testing tools, a performance testing tool for Apache Kafka, an ELT tool for Amazon Redshift, an Amazon S3 archive tool, and many more. https://blog.beachgeek.co.uk/contributing-to-the-apache-airflow-project-part-two/ Fri, 11 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/contributing-to-the-apache-airflow-project-part-two/ This is the second and concluding post providing an overview of the experience and journey contributing to the Apache Airflow project. You can catch Part One here. Contributing to Apache Airflow - Part Deux In Part One of this series, we took our first steps in contributing to the Apache Airflow project. With a little bit more knowledge and experience, our first interactions with the Airflow community, we are ready to start exploring how the code works and see how we might go about fixing this. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-103/ Mon, 07 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-103/ March 7th, 2022 - Instalment #103 Newsletter #103. Welcome to edition #103 of the AWS open source news and updates. This weeks featured new open source projects include botocove (a decorator that helps you run your functions across your AWS accounts easily), functionless (a TypeScript plugin that transforms TypeScript code into Service-to-Service integrations), replibyte (a tool to replicate your PostgreSQL data), aws-security-bulletin-alert (notifies you of new AWS Security Bulletins) and sends out E-Mail notifications via Amazon SES), and many more. https://blog.beachgeek.co.uk/orchestrating-hybrid-workflows-with-apache-airflow/ Mon, 07 Mar 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/orchestrating-hybrid-workflows-with-apache-airflow/ Using Apache Airflow to orchestrate hybrid workflows In some recent discussions with customers, the topic of how open source is increasingly being used as a common mechanisms to help build re-usable solutions that can protect investments in engineering and development time, skills and that work across on premises and Cloud environment. In 2021 my most viewed blog post talked about how you can build and deploy containerised applications, anywhere (Cloud, your data centre, other Clouds) and on anything (Intel and Arm). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-102/ Mon, 28 Feb 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-102/ Feb 28th, 2022 - Instalment #102 Newsletter #102. Welcome to edition #102 of the AWS open source news and updates newsletter, and this week we have a super collection of new open source projects that I am really excited to share. First up we have the AWS DataOps Development Kit, which uses AWS CDK under the covers, and is an open source development framework to help you build data workflows. Threatmapper is an open source cloud native security observability platform, which looks easy to use and has some good visualisations. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-101/ Mon, 21 Feb 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-101/ Feb 21st, 2022 - Instalment #101 Newsletter #101. There is nothing basic and fundamental about edition 101 of the AWS open source newsletter, with another great round up of new open source projects including eks-creation-engine from the folks at Lightspin helping you all to stay safer with this handy tool you should check out, idp-scim-sync to help users of AWS SSO who want to synchronise with their Google Workspace Directory, typecart an analysis tool for proof evolution and many other great projects and sample code. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-100/ Mon, 14 Feb 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-100/ Feb 14th, 2022 - Instalment #100 Newsletter #100. Happy Valentines everyone, and welcome to this landmark 100st edition of this newsletter. This week we celebrate the love that many builders have for open source with more great new open source projects and content. Cuddle up to new projects that will help you build scalable systems, simplify your work with AWS DynamoDB, integrate your .NET applications with OpenSearch, keep on top of your VPC networks, and more. https://blog.beachgeek.co.uk/contributing-to-the-apache-airflow-project-part-one/ Thu, 10 Feb 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/contributing-to-the-apache-airflow-project-part-one/ Contributing to Apache Airflow Introduction In this series of posts, I am going to share what I learn as embark on my first upstream contribution to the Apache Airflow project. The purpose is to show you how typical open source projects like Apache Airflow work, how you engage with the community to orchestrate change and hopefully inspire more people to contribute to this open source project. I will post regular updates as a series of posts, as the journey unfolds. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-99/ Mon, 07 Feb 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-99/ Feb 7th, 2022 - Instalment #99 Newsletter #99. While Nena gave you 99 red balloons, I give you the latest version of the AWS open source news letter. This week we feature more great new open source projects including a project to help you with drift detection in your CloudFormation stacks, new Terraform modules, an open-source prometheus exporter, some AWS CDK resources and sample projects and more. This weeks AWS and Community posts cover PostgreSQL, Apache Airflow, AWS CDK, Redis, GraphQL, Apollo GraphQL, Kubernetes, AWS EKS and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-98/ Sat, 29 Jan 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-98/ Jan 31st, 2022 - Instalment #98 Newsletter #98. Welcome to another edition of AWS open source news and updates, featuring more new open source projects. This week, these include eventbridge-assistant (a VScode plugin to help you whilst you are developing with Amazon EventBridge), stratus-red-team (a tool you can use to emulate offensive attack techniques), critter (AWS Config rule integration testing), syne-tune-s3-transfer (an example of how to apply the distributed parameter search library to optimise download performance), karpenter-terraform (a Terraform module to help you automate deployment of karpenter), and a couple of super interesting open source solutions covering last mile delivery and software defined radio. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-97/ Sat, 22 Jan 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-97/ Jan 22nd, 2022 - Instalment #97 Newsletter #97. Welcome to another edition of the AWS open source newsletter, packed with more great new open source projects, content, and events. This week, we have new projects that help you improve security by de-obfuscating strings, a library to help you automate the configuration of your build pipelines, a new Terraform module, a nice new VSCode plugin that will help you when working with IAM, and several more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-96/ Mon, 17 Jan 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-96/ Jan 17th, 2022 - Instalment #96 Newsletter #96. Welcome to another great round up of open source projects, news and great content. This week, we have new open source projects such as Event Catalog (that helps you to discover, explore and document your Event Driven Architectures), AWS Powertools for Lambda TypeScript edition, flowdog (an application/framework for inspection and manipulation of network traffic in AWS VPCs), ai-doorbell (a serverless AI enabled door bell) and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-95/ Mon, 10 Jan 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-95/ Jan 10th, 2022 - Instalment #95 Newsletter #95. Feliz Ano and a very happy new year to you all in this first newsletter in 2022. In this weeks update I reflect on some of the interesting stuff I learnt running this newsletter in 2021, before diving into the usual round up of new open source projects, AWS and community blog posts, videos and events. This weeks projects include tfdevops, a tool for Terraform uses to integrate with DevOps Guru, a tool to validate your custom container images on Amazon EMR, a Python wrapper for DynamoDB local and more. https://blog.beachgeek.co.uk/hugo-site-migraiton/ Fri, 07 Jan 2022 00:00:00 +0000 https://blog.beachgeek.co.uk/hugo-site-migraiton/ Running my dev.to blog using Hugo on Netlify I am a big fan of dev.to, and the work that the team do to foster a great community of builders is something that keeps me there. I have always maintained another blog (running on Netlify, which is also super awesome), kind of like a mirror. Up until last year, I was able to publish to dev.to and it would take care of publishing to that mirror. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-94/ Mon, 20 Dec 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-94/ December 20th, 2021 - Instalment #94 Newsletter #94. This will be the last newsletter of 2021 before I break for Christmas and New Year. I hope you have found this newsletter a useful resource for finding out about new or interesting open source projects, both from what AWS contributes to, but also from the wider builder and open source developer communities. To finish up for 2021 we have more new open source projects, covering Amazon Location Services, AWS Fault Injection Simulator (FIS) experiment templates that are AWS CDK ready, Media Replay Engine (MRE)a really nice project to help you automate the creation of replays, a transcribe, post call analytics solution and more. https://blog.beachgeek.co.uk/setting-up-mwaa-to-use-a-kms-key/ Tue, 14 Dec 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/setting-up-mwaa-to-use-a-kms-key/ Introduction In a previous post, I shared how you can using AWS CDK to provision your Apache Airflow environments using the Managed Workflows for Apache Airflow service (MWAA). I was contacted this week by Michael Grabenstein, who flagged an issue with the code in that post. The post used code that configured a kms key for the MWAA environment, but when trying to deploy the app it would fail with the following error: https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-93/ Mon, 13 Dec 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-93/ December 13th, 2021 - Instalment #93 Updated Jan 18th, to remove dead links Newsletter #93. We took a week off last week to recover from re:Invent, so this week we have extensive coverage of the open source related news and announcements so be sure to check those out. This week we have some great new open source projects, from a project that will help you get started with data meshes, an alternative way to provide internet connectivity to those private subnets, a nice new CDK construct to quickly deploy single page applications and a cool IoT simulator solution which I know I am going to try out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-92/ Mon, 29 Nov 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-92/ November 29th, 2021 - Instalment #92 Updated 18th Jan, to remove dead links Newsletter #92. This is the re:Invent edition of the weekly newsletter, and whilst I am not there this year, I will still be covering all the announcements and topics of interest in this and next weeks newsletter. Outside of re:Invent, this weeks letter also brings you lots more new open source projects including something for DynamoDB fans, a serverless GraalVM project, a very nice AWS SSO project, new Grafana recipes and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-91/ Mon, 22 Nov 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-91/ November 22nd, 2021 - Instalment #91 Newsletter #91. This week I feature eleven new open source projects, covering a diverse array of use cases. From securing your Kubernetes clusters, a couple of nifty Amazon Neptune tools, a Python library that provides state-of-the-art distributed hyper parameter optimising, a sample NFT marketplace and more. This weeks AWS community and AWS content features topics including AWS SAM, Bottlerocket, Babelfish, Apache Airflow, PartiQL, Suricata, Slurm, Apache Kafka, AWS Amplify, PHP and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-90/ Mon, 15 Nov 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-90/ November 15th, 2021 - Instalment #90 Updated, 18th Jan to remove dead links Newsletter #90. Another packed edition of his newsletter, with some great new open source projects such as ploomber (a project to help you build production pipelines for your notebooks), slic-starter (a complete starter project for production-grade serverless applications) and many more interesting projects covering RStudio, Spring Boot, a serverless software vending solution, Kubernetes on the edge and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-89/ Mon, 08 Nov 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-89/ November 8th, 2021 - Instalment #89 Newsletter #89. This week we have another selection of great new projects for you to take a look at. Kicking things off with the latest open source project from Airbnb, ottr, a Public Key Infrastructure framework that handles end-to-end certificate rotations, the other projects include cloudkey, clock-bound, aws-recon, cdk-dia and more. Make sure you check these out. As always, we have a wide selection of new blog posts from the AWS and Community bloggers covering topics from Alphafold, BayerCLAW, and Babelfish to OpenSearch, AWS CDK, ffmpeg, Amazon Corretto, Spring Boot, Bottlerocket, Snyk, MariaDB and GitHub actions. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-88/ Mon, 01 Nov 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-88/ November 1st, 2021 - Instalment #88 Newsletter #88. Number 88 symbolises fortune and good luck in Chinese culture (I hope that is correct, so please let me know if that is not) and I hope you will feel you are all the luckier for chancing upon this weeks selection of open source projects and posts. This week, the big news was the publishing of the Babelfish repository. Check out the launch post as well as additional content and links to this interesting open source project. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-87/ Mon, 25 Oct 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-87/ October 25th, 2021 - Instalment #87 Newsletter #87. As we approach Halloween (or Dia de los Muertos/All Saints as I remember it), rest assured there is nothing scary in this weeks round up of all things open source on AWS. This weeks projects include a project that helps you implement a GitOps workflow that includes Crossplane and Argo CD, and a static analysis tool for CloudFormation templates. We have some great blog posts this week, featured topics include Apache Kafka, StackGres, Spinnaker, OpenShift, Envoy, Porting Assistant for . https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-86/ Mon, 18 Oct 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-86/ October 18th, 2021 - Instalment #86 updated Jan 18th, to remove dead links Newsletter #86. This week we have a very broad variety of topics. Starting off with some fresh open source projects such as cfn-diagram, aws-jwt-verify, damo, aws-dotnet-deploy, automated-account-configuration, BayerCLAW and more. For mains, we have new AWS and community authored posts on MySQL, OpenSearch, .NET, miniwdl, OpenMRS, Apache Hudi, Apache Spark, ROS, cdk8s, Jax, Deep Graph Library and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-85/ Mon, 11 Oct 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-85/ October 11th, 2021 - Instalment #85 Newsletter #85. This week we have an interesting gaming flavour to this newsletter, with a couple of projects that are influenced or are directly related to gaming. We also have other new open source projects including one that shows you how you can run an OpenVSCode Server for AWS Graviton2. This weeks blog post and tutorials cover Apache Airflow, Apache Spark, Apache Kafka, Apache Ranger, Apache Flink, OpenSearch, Apache Lucene, PostgreSQL, AWS CDK, and Kubernetes. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-84/ Mon, 04 Oct 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-84/ October 4th, 2021 - Instalment #84 updated Jan 18th, to remove dead links Newsletter #84. Welcome to issue #84 of this newsletter, and we have more great new open source projects for you this week. We have a couple of great security/compliance/governance tools that will help you with security in cloudgraphdev and (the amazingly named) wonk, placebo, a tool to help you mock tests, a new cli from AWS to help you simplify those of you working with genomics workloads, and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-83/ Mon, 27 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-83/ September 27th, 2021 - Instalment #83 Newsletter #83. Welcome to issue #83 of this newsletter, and more great new open source projects to check out. For infrastructure as code practitioners we have several projects for both CDK and Terrafrom, a CI/CD project to help you scale GitHub Actions runners, a simple hosting project with some nice features you can use as a baseline for your own project, a reference architecture for data analytics on AWS with some comprehensive CDK stacks you can inspect and borrow for your own, a project to help you visualise some of your key cloud metrics and more. https://blog.beachgeek.co.uk/integrating-amazon-timestream-in-your-amazon-managed-workflows-for-apache-airflow-v2x/ Thu, 23 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/integrating-amazon-timestream-in-your-amazon-managed-workflows-for-apache-airflow-v2x/ Integrating with Amazon Timestream in your Apache Airflow DAGs Amazon Timestream is a fast, scalable, and serverless time series database service perfect for use cases that generate huge amounts of events per day, optimised to make it faster and more cost effective that using relational databases. I have been playing around with Amazon Timestream to prepare for a talk I am doing with some colleagues, and wanted to see how I could integrate it with other AWS services in the context of leveraging some of the key capabilities of Amazon Timestream. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-82/ Mon, 20 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-82/ September 20th, 2021 - Instalment #82 Newsletter #82. Welcome to issue #82 of this newsletter, bringing you the latests updates on open source on AWS. This weeks featured new projects include cdk-nag (helping CDK developers to shift left and check their stacks against best practices), cfn-alarms (a nice tool to automate the creation of your CloudWatch alarms), aws-lambda-adapter (a project to help accelerate your web applications to serverless), as well as some new open source solutions including aws-security-hub-automated-response-and-remediation and eks-preventative-controls. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-81/ Mon, 13 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-81/ September 13th, 2021 - Instalment #81 Updated 18th Jan, remove dead links Newsletter #81. Welcome new and existing readers of this newsletter to another edition with plenty to excite you. This weeks brand new open source projects include some great new AWS CDK constructs to help you with things such as Apache Airflow, a tool to help you with your IAM policies, a really nice tool to explore and interact with AWS SQS and something for Minecraft fans. https://blog.beachgeek.co.uk/reading-and-writing-data-across-different-aws-accounts-with-amazon-managed-workflows-for-apache-airflow-v2x/ Tue, 07 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/reading-and-writing-data-across-different-aws-accounts-with-amazon-managed-workflows-for-apache-airflow-v2x/ Reading and writing data across different AWS accounts in you Apache Airflow DAGs As regular readers will know, I sometimes lurk in the Apache Airflow slack channel to see what is going on. If you are new to Apache Airflow, or want to get a deeper understanding then I highly recommend spending some time here. The community is super welcoming and eager to help new participants. It was during a recent session I came across an interesting problem that one of the builders was having, which was how to access (read/write) data in an S3 bucket which was in a different account to the one hosting Amazon Managed Workflows for Apache Airflow (MWAA). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-80/ Mon, 06 Sep 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-80/ September 6th, 2021 - Instalment #80 Newsletter #80. So what delights does #80 of this newsletter offer this week? We have plenty of new open source projects, such as aws-o11y-recipes (observability recipes), dassana-io (contextual alerts), sgCheckup (security), aws-lambda-scheduler (developer tool to simplify scheduling of AWS Lambda functions), aacli (AWS cli authentication/SSO) as well as Terraform modules and AWS open source solutions covering Hugging Face, reporting on your AWS accounts and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-79/ Fri, 27 Aug 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-79/ August 27th, 2021 - Instalment #79 Newsletter #79. The combination of having been away on PTO for the past few weeks, and this coming Monday being a national holiday in the UK, I thought I would post the newsletter today. Covering nearly three weeks, a lot has happened so there is a lot to cover. We have 17 new open source projects and solutions, including EventBridge Canon, an essential project if you are working with event driven architectures on AWS, kics a security scanning tool for your IaC, open source solutions such as aws-security-analytics-bootstrap and amazon-msk-with-apache-kafka-streams-api, and other new projects like aws-python-utilities, snap-xcompile, riFT, rds_iamauth_proxy, aws-simple-websocket, ecs-external-instance-network-sentry and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-78/ Mon, 02 Aug 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-78/ August 2nd, 2021 - Instalment #78 Newsletter #78. This is the last newsletter for the next three weeks, as I will be taking some time off and shutting down my laptop. I will look forward to bringing you a very full edition when I return, but in the meantime enjoy another great collection of open source projects and blog posts to help you get the most out of open source on AWS. https://blog.beachgeek.co.uk/working-with-parameters-and-variables-in-amazon-managed-workflows-for-apache-airflow/ Tue, 27 Jul 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/working-with-parameters-and-variables-in-amazon-managed-workflows-for-apache-airflow/ Maximising the re-use of your DAGs in MWAA During some recently conversations with customers, one of the topics that they were interested in was how to create re-usable, parameterised Apache Airflow workflows (DAGs) that could be executed dynamically through the use variables and/or parameters (either submitted via the UI or the command line). This makes a lot of sense, as you may find that you repeat similar tasks in your workflows, and so this approach allows you to maximise the re-use of that work. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-77/ Mon, 26 Jul 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-77/ 26th July, 2021 - Instalment #77 Newsletter #77. This week we have more new open source projects including schema-manager, maildog, ddbcereal, ecr-scan-reporter and more. This weeks AWS and community blog posts cover topics such as PartiQL, ConsoleMe, Yor, Kubernetes, Debezium, Apache Kafka, Apache Spark, Redis, HPC and more. Also, don’t miss the great video on getting up and running with Amazon EMR on Apache Airflow. Observability (o11y) newsletter If you had not already signed up for this, then perhaps now is a great time. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-76/ Mon, 19 Jul 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-76/ 19th July, 2021 - Instalment #76 Newsletter #76. This week, we have new oss projects such as ecs-files-composer, lucid-dynamodb, kubectl-trace, tailscale-layer and more. AWS and community blog posts featuring OpenSearch, Kubernetes, COBOL, Jamulus, Firecracker, Apache Hudi, Apache Kakfa, Apache Flink, Redis and more. In the videos section we catch up with a couple of the sessions from the Airflow Summit and finally, some new events for your diary. Celebrating open source contributors The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created. https://blog.beachgeek.co.uk/creating-a-multi-architecture-cicd-solution-with-amazon-ecs-and-ecs-anywhere/ Fri, 16 Jul 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/creating-a-multi-architecture-cicd-solution-with-amazon-ecs-and-ecs-anywhere/ Please let me know how I can improve posts such as this one, by completing this very short survey. $25 AWS credits will be provided for the first 20 completed - take the survey Organisations are moving their workloads to the cloud as quickly as they can. While most applications can be easily migrated to the cloud, some applications need to remain on-premises due to low-latency or data sovereignty requirements. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-75/ Mon, 12 Jul 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-75/ 12th July, 2021 - Instalment #75 Newsletter #75. This week we have a bumper edition, due to the fact I did not publish last week and it looks like everyone has been very busy. We have new open source projects include a light weight Java client, a tool to help you manage your AWS resources and some sample applications to help you get started with location based services, Bottlerocket and algorithmic trading. https://blog.beachgeek.co.uk/newsletter/aws-open-source-newsupdates-74/ Mon, 28 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-newsupdates-74/ 28th June, 2021 - Instalment #74 Newsletter #74. This week we have new open source projects that help you access your AWS EFS data without the need for a VPN, a new Red Team security tool that is in the very early stages and a number of new AWS projects to help you easily deploy open source projects such as Nextcloud or manage your own SQL Server deployments. Community and AWS posts covering Apache Airflow, Rust, Prometheus, DevOps, Apache Spark, R Studio, Grafana Loki and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-73/ Mon, 21 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-73/ 21st June, 2021 - Instalment #73 updated 18th, Jan to remove dead link Newsletter #73. This week’s new projects include a project than can help you reduce your costs if you are running Amazon EKS workloads, an AWS CDK pattern to help you easily create internal and external access points for your applications, a GraphQL solution and some sample AWS projects. We have community and AWS authored posts featuring Kubernetes, Apache Flink, Firecracker, OpenSearch, Apache Tinkerpop, Apache Kafka, as well as . https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-72/ Mon, 14 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-72/ 14th June, 2021 - Instalment #72 Newsletter #72. This week we have new open source projects such as Lift, that makes it super easy to deploy applications to production, a couple of new mods for the Steampipe project that let you do cost optimisation and security auditing, a nice project for tmux fans as well as a project that will get you started with ECS Anywhere. Community and AWS posts covering security, DevOps and IoT/Robotics, as well as Kubernetes, Open Shift, Apache Airflow, Linux and many more. https://blog.beachgeek.co.uk/working-with-amazon-eks-and-amazon-managed-workflows-for-apache-airflow-v2x/ Thu, 10 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/working-with-amazon-eks-and-amazon-managed-workflows-for-apache-airflow-v2x/ Introduction The Apache Airflow slack channel is a vibrant community of open source builders that is a great source of feedback, knowledge and answers to problems and use cases you might have when trying to do stuff with Apache Airflow. This week I picked up on someone seeing errors with Amazon EKS, and so I thought what better time to try out the new Apache Airflow 2.x version that was recently launched in Amazon Managed Workflows for Apache Airflow (MWAA). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-71/ Mon, 07 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-71/ 7th June, 2021 - Instalment #71 Newsletter #71. This week we have a number of security related projects, covering reference/best practice deployments of open source security tools as well as new tools that will help you identify misconfigured assets. Another interesting project this week is moot, a serverless project to help yo simplify your deployments. On top of the new projects, we have some great community and AWS blog posts on Kubernetes, OpenSearch, Eventbridge Atlas, Keycloak, Apache Kafka, SQLAlchemy, AWS Copilot, OpenShift and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-70/ Tue, 01 Jun 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-70/ 1st June, 2021 - Instalment #70 Due to it being a bank holiday in the UK, Newsletter #70 is a day later than usual. Make sure you check out this weeks “Quick Updates” as there are some updates that I know a lot of people will be happy about, and I always share great nuggets that sometimes folk miss. More great projects this week, from iamzero which helps you simplify your identity and access management, PMapper that you will find helpful for identifying risks in your IAM configurations, an AWS CDK construct to help you deploy a VSCode server, Orkestra, a super nice project that lets you create workflows using Lambda functions a la Apache Airflow and many more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-69/ Mon, 24 May 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-69/ May 24th, 2021 - Instalment #69 Newsletter #69. This week we celebrate more new open source projects, covering tools that can help you lock down and monitor your IAM policies, reference solutions that make it easy to deploy a number of open source projects, and a great tool to help you monitor/debug your serverless functions. On top of that the usual round up of community and AWS blog posts, featuring lots of updates on Kubernetes, performance tuning HTTP on EC2, LLVM, Apache Kafka, Triton inference, the next version of Cloudformation guard, Bottlerocket, AWS Graviton2, Tensorflow and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-68/ Mon, 17 May 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-68/ May 17th, 2021 - Instalment #68 Newsletter #68. What better way that to celebrate my 100th post on dev.to with the latest AWS open source news and updates. This week we have posts covering Rust, OpenSearch, SaaS Boost, Apache Airflow, Kubernetes, Taurus, Spring Boot, Jenkins, GraphQL, Redis and more. If you are looking for projects, make sure you check out SaaS Boost which generated a lot of buzz last week, as well as the first beta of OpenSearch, sls-test-tools, aws-assume-role-lib and more. https://blog.beachgeek.co.uk/working-with-the-redshifttos3transfer-operator-and-amazon-managed-workflows-for-apache-airflow/ Sat, 15 May 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/working-with-the-redshifttos3transfer-operator-and-amazon-managed-workflows-for-apache-airflow/ Introduction Inspired by a recent conversation within the Apache Airflow open source slack community, I decided to channel the inner terrier within me to tackle this particular issue, around getting an Apache Airflow operator (the protagonist for this post) to work. I found the perfect catalyst in the way of the original launch post of Amazon Managed Workflows for Apache Airflow (MWAA). As is often the way, diving into that post (creating a workflow to take some source files, transform them and then move them into Amazon Redshift) led me down some unexpected paths to here, this post. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-67/ Mon, 10 May 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-67/ May 10th, 2021 - Instalment #67 Newsletter #67. This week more great open source projects for you to get stuck into. The big news last week was the release in alpha of the new Rust SDK for AWS, so make sure you check that out if you are exploring the world of Rust. We also have a couple of interesting new projects on awslabs, always a great place to explore if you have the time, awsclii a nice little tool that generates groovy ascii graphics as well as some significant updates to some projects I have covered in earlier newsletters. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-66/ Tue, 04 May 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-66/ May 4th, 2021 - Instalment #66 Updated Jan 18th, to remove dead links Newsletter #66. This week we have a really outstanding collection of new open source projects, including eventbridge-atlas, ecsk, spotinfo, pecos and more, so make sure you spend some time checking those out. Following on from CDK Day, we have plenty of great posts for CDK fans. As always, there are lots of great community and AWS blog posts covering event driven architectures, containers, big data, and so happy to see the AWS DeepRacer open source announcements last week. https://blog.beachgeek.co.uk/using-aws-cdk-to-deploy-your-amazon-managed-workflows-for-apache-airflow-environment/ Wed, 28 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/using-aws-cdk-to-deploy-your-amazon-managed-workflows-for-apache-airflow-environment/ update I am grateful to Michael Grabenstein for spotting some mistakes in the original post/code. I hope these have now been rectified in this post. Using AWS CDK to deploy your Amazon Managed Workflows for Apache Airflow environment What better way to celebrate CDK Day than to return to a previous blog where I wrote about automating the installation and configuration of Amazon Managed Workflows for Apache Airflow (MWAA), and take a look at doing the same thing but this time using AWS CDK. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-65/ Mon, 26 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-65/ April, 26th, 2021 - Instalment #65 Newsletter #65. This week we have new projects covering security, AWS CDK, serverless and a very handy tool if you find yourself having to record your screen to do demos and wondering how to make sure you do not disclose sensitive information such as your AWS credentials. We have AWS and community blog posts covering Kubernetes, AWS Copilot, Rust, GraphQL, Apache Airflow, Linux, we have a couple of workshops on AWS Greengrass v2 and Observability on AWS and much more. https://blog.beachgeek.co.uk/automating-your-elt-workflows-with-managed-workflows-for-apache-airflow-part-one/ Wed, 21 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/automating-your-elt-workflows-with-managed-workflows-for-apache-airflow-part-one/ update: I have changed the post to use standard Apache Airflow variables rather than using AWS Secrets Manager. Part One - Automating Amazon Athena As part of an upcoming DevDay event, I have been working on how you can use Apache Airflow to help automate your Extract, Load and Transform (ELT) Workflows. Amazon Athena and Amazon EMR are two AWS services that help customers who have existing SQL skills/expertise and are looking at tools such as Presto or Apache Hive when undertaking those transformations. https://blog.beachgeek.co.uk/automating-your-elt-workflows-with-managed-workflows-for-apache-airflow-part-two/ Wed, 21 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/automating-your-elt-workflows-with-managed-workflows-for-apache-airflow-part-two/ Part Two - Automating Amazon EMR In Part One, we automated an example ELT workflow on Amazon Athena using Apache Airflow. In this post, Part Two, we will do the same thing but automate the same example ELT workflow using Amazon EMR. Make sure you recap the setup from Part One. All the code so you can reproduce this yourself can be found in the GitHub repository here. Automating Amazon EMR https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-64/ Mon, 19 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-64/ April, 19th, 2021 - Instalment #64 Newsletter #64. Another great selection of posts this week, starting off with the announcement last week of OpenSearch and OpenSearch Dashboards, the name of the community driven open source fork of Elasticsearch and Kibana. We have a great selection of community posts covering topics such as Apache Zeppelin, Rust, OpenJDK as well as an exciting new project called Lift to watch out for. Some great new open source projects including how to run Haskell on AWS Lambda, a nice project to make it easy to run EKS Distro on your desktop, so make sure you check those out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-63/ Mon, 12 Apr 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-63/ April, 12th, 2021 - Instalment #63 Newsletter #63. No newsletter last week due to the holidays, which means that this week we have a bumper edition. Check out the AWS CDK content this week, as there is both lots of it, but also all if it is great. We then have some great content if you are into containers, and the usual round up of other open source posts from AWS and the community covering topics such as Selenium, Apache Airflow, Apache Flink, GraphQL, Java and much more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-62/ Mon, 29 Mar 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-62/ March 29th, 2021 - Instalment #62 Newsletter #62. This week we have some really interesting new projects for you to take a look at, including someones first. We have cli tools to make it easier to work with the recently announced ECS Exec, to a serverless security tool, a very nice project that incorporates AWS CDK as part of an ArchOps project and more. We also have some great reads for you this week - check out the back story of Jupyter from Matt, a few posts on how AWS and Hugging Face are working together, some nice posts for you DevOps enthusiasts and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-61/ Mon, 22 Mar 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-61/ March 22nd, 2021 - Instalment #61 Newsletter #61. This week we have a lot of love for Apache projects, covering Apache Lucene, Parquet, Airflow, Cassandra and HBase, with a couple of must read posts. On top of that, we have more new open source projects, including a couple of curated lists of essential resources as well as some new open source tools from AWS. Finally, the usual round up of open source posts from the community and AWS, as well as a couple of videos and short updates. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-60/ Mon, 15 Mar 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-60/ March 15th, 2021 - Instalment #60 Newsletter #60. This week is packed with posts for data lovers, with posts covering Presto, Apache Airflow and Apache Hudi, we have some Java goodies in the form of a nice deep dive on Heapothesys and a couple of posts on Kotlin, a couple of great whitepapers - the first will help you move your workloads (and open source projects) to Arm based AWS Graviton instance types, and the other is an update to the Redis whitepaper, and the usual round up of community and AWS related posts. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-59/ Mon, 08 Mar 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-59/ March 8th, 2021 - Instalment #59 Newsletter #59. This week we have a really great selection of open source projects for you to take a look at. Quail, not just a fancy egg you enjoy on those special occasions but an interesting project that helps you easily provision resources for your developers was my pick from a very good bunch. Aside from that, the usual round up of fresh blog posts from AWS and the community, some new events that are happening later this week and next and a new newsletter for you to sign up to. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-58/ Mon, 01 Mar 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-58/ March 1st, 2021 - Instalment #58 Newsletter #58. This week we have posts covering some of my favourite topics, AWS Graviton and AWS CDK, we have some new events to check out, more great videos from the Containers on the couch folk, as well as the usual round up of new open source projects, AWS and community related posts and quick updates. Before we crack on, why not start by reading this post, The real value of open source in the cloud that Matt Asay wrote last week that talks about the freedom and choice that open source provides, whether that is in the Cloud or not. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-57/ Mon, 22 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-57/ February 22nd, 2021 - Instalment #57 Newsletter #57. This week we have another great selection of content to share with you. Starting off with a look at open source at AWS, which is a must read this week, we meander through a look at a write up of the open source technology stack that supported Fossdem a few weeks ago. Then it is off to the usual round up of latest open source projects, blog posts from the community and AWS as well as a look at some quick updates, videos and more. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-56/ Mon, 15 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-56/ February 15th, 2021 - Instalment #56 Newsletter #56. This week we have the latest update on the Elasticsearch/Kibana fork, events for your diary, the usual round up of blog posts and new open source projects as well as white papers, a nice selection of videos, workshops and case studies. Make sure you read the Rust Foundation blog post this week and check out Didier’s post on running a serverless mainframe…well kind of! https://blog.beachgeek.co.uk/monitoring-and-logging-with-amazon-managed-workflows-for-apache-airflow/ Tue, 09 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/monitoring-and-logging-with-amazon-managed-workflows-for-apache-airflow/ Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging <- this post Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 6, where to find logs to help you understand and troubleshoot your Apache Airflow workflows, and how you can monitor your Apache Airflow environments. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-55/ Mon, 08 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-55/ February 8th, 2021 - Instalment #55 Newsletter #55. Another newsletter full of great content for you this week. Make sure you read the essential read this week, Rights Ratchet Model, keep on top of the latest news on the fork of Elasticsearch, some events for your diary, more great videos, a new workshop and of course the usual open source projects and posts from the community and AWS. Pick of the week has to be Ian Mckay’s new open source project, iamlive - make sure you check it out in the projects section below. https://blog.beachgeek.co.uk/a-simple-cicd-system-for-your-amazon-managed-workflows-for-apache-airflow-development-workflow/ Wed, 03 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/a-simple-cicd-system-for-your-amazon-managed-workflows-for-apache-airflow-development-workflow/ updated Feb 19th Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow <- this post Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 5, how you can setup a very simple CI/CD setup to enable faster development of your Apache Airflow DAGs. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-54/ Mon, 01 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-54/ February 1st, 2021 - Instalment #54 Newsletter #54. Lots to choose from this week. Catch up with the latest from the Open Distro for Elasticsearch community, an event for your diary in the shape of Innovate AI/ML where I will be covering open source tools in your AI/ML pipeline, and the usual round up of AWS and community open source posts. We have some great open source projects that you need to check out - from tools and utilities that solve real pain points to complete solutions you can use as the base for your projects. https://blog.beachgeek.co.uk/interacting-with-amazon-managed-workflows-for-apache-airflow-via-the-command-line/ Mon, 01 Feb 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/interacting-with-amazon-managed-workflows-for-apache-airflow-via-the-command-line/ Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow environments Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line < this post Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 4, how you can interact and access the Apache Airflow via the command line. https://blog.beachgeek.co.uk/accessing-your-amazon-managed-workflows-for-apache-airflow-environments/ Thu, 28 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/accessing-your-amazon-managed-workflows-for-apache-airflow-environments/ Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow environments < this post Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 3, how you can interact and access the Apache Airflow environments. https://blog.beachgeek.co.uk/working-with-permissions-in-amazon-managed-workflows-for-apache-airflow/ Wed, 27 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/working-with-permissions-in-amazon-managed-workflows-for-apache-airflow/ Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow Part 2 - Working with Permissions <- this post Part 3 - Accessing Amazon Managed Workflows for Apache Airflow environments Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 2, how to ensure that you control access to Apache Airflow following best practices such as default no access/least privilege. https://blog.beachgeek.co.uk/automating-the-installation-and-configuration-of-amazon-managed-workflows-for-apache-airflow/ Tue, 26 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/automating-the-installation-and-configuration-of-amazon-managed-workflows-for-apache-airflow/ updated, August 25th Thanks to Philip T for spotting a typo in the cloudformation code below - it is ok in the GitHub repo, but I have fixed it now below. Part of a series of posts to support an up-coming online event, the Innovate AI/ML on February 24th, from 9:00am GMT - you can sign up here Part 1 - Installation and configuration of Managed Workflows for Apache Airflow <- this post Part 2 - Working with Permissions Part 3 - Accessing Amazon Managed Workflows for Apache Airflow environments Part 4 - Interacting with Amazon Managed Workflows for Apache Airflow via the command line Part 5 - A simple CI/CD system for your development workflow Part 6 - Monitoring and logging Part 7 - Automating a simple AI/ML pipeline with Apache Airflow In this post I will be covering Part 1, automating the installation and configuration of Managed Workflows for Apache Airflow (MWAA). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-53/ Mon, 25 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-53/ January 25th, 2021 - Instalment #53 Newsletter #53 This weeks newsletter has another great variety of posts and projects for you to check out. First up though, and probably the most important news from last week was the announcement around how AWS is looking to keep Elasticsearch and Kibana open source (read the post below). In addition to that news, we have some interesting projects for builders interested in infrastructure as code, a couple of great benchmarking posts, including another great AWS Graviton2 story and my new favourite open source project, Apache Airflow. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-52/ Mon, 18 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-52/ January 18th, 2021 - Instalment #52 Newsletter #52 This week we have a number of posts covering AWS Cloud Development Kit, (AWS CDK) as well as Managed Workflows for Apache Airflow (MWAA) which you should check out (ok, I’ll admit I might have been involved in some of those) as well as a couple of interesting projects. Don’t miss the summary of re:Invent from last week - still plenty of time to catch up with the on demand videos. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no51/ Mon, 11 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no51/ January 11th, 2021 - Instalment #51 Welcome to Newsletter #51. This week we have a carefully selected group of blog posts, projects and more. Make sure you check out this weeks must read post on how to prepare and plan for migrating your existing .NET workloads to .NET Core. We have a couple of new projects that you need to take a look at; first of we have Querypal, essential for Amazon Athena users, and following that make sure you check out the preview of the MySQL JDBC driver (in Quick updates section). https://blog.beachgeek.co.uk/til-testing-an-amazon-cloudwatch-alarm/ Thu, 07 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/til-testing-an-amazon-cloudwatch-alarm/ Today I was setting up an application load balancer that sits in front of a test application I have put together. Setting this up was super easy, and very quickly I had my domain pointing to the alias and serving requests. As part of the setup, I wanted to monitor the application load balancer to let me know when requests were failing to the downstream application (anything other than an HTTP 200) and so I set this up super easily in Amazon Cloudwatch. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no50/ Mon, 04 Jan 2021 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no50/ January 4th, 2021 - Instalment #50 Newsletter #50 and the first one this year. I hope you all had a good break over the festive season. I am busy catching up with all the open source posts, projects, case studies and more, much of which I have shared this week. I have also covered what is happening next week with the concluding week of re:Invent - plenty more open source sessions to check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no49/ Mon, 21 Dec 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no49/ December 21st - Instalment #49 Week No.49 and this will be the last newsletter this year. It is good to go out on a high, and this week we have a round up of the third week of re:Invent, following Dr Werner Vogels’s keynote and announcements. There are plenty of great posts related to those launches as well as re:Invent sessions to find out more. We also have the usual round up of blog posts, case studies, videos and open source projects which you can think of as stocking fillers as we head into Christmas. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no48/ Mon, 14 Dec 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no48/ December 13th - Instalment #48 Week No.48 going into the final week of re:Invent this year (don’t worry, we still have more sessions in the 2nd week of 2021) we have another great selection of posts. This week a favourite project of mine gets a lot of love, as well as a roundup of the second week of re:Invent. If that was not enough for you, then I throw in some new open source projects which you will definitely need to check out, with some really great ones including the latest project from Netflix that might make you Weep! https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no47/ Mon, 07 Dec 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no47/ December 7th - Instalment #47 Week No.47 and with the first week of re:Invent over, it was good to see so many great open source related announcements. You can expected detailed coverage of those in this weeks roundup, including links to the various sessions and blog posts that have been published this week to support those announcements. If that was not enough, this week still has a great round up of other open source blog posts, some really interesting open source projects and of course, more posts from the community. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-46/ Mon, 30 Nov 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-46/ November 30th - Instalment #46 Week No.46 and this week marks the beginning of re:Invent 2020 so expect a lot of re:Invent related content in this episode and the next couple. re:Invent has not stopped the relentless march of great open source blog posts, projects and more this week, and we have some great stuff this week including…the launch of Amazon Managed Workflows for Apache Airflow, an unmissable post on Rust from Matt Asay, a bumper selection of Elasticsearch updates this week, a new project from the Amazon Neptune team and a couple of fantastic videos, one covering AWS CDK and projen and the other kube-bench. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no45/ Mon, 23 Nov 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no45/ November 23rd - Instalment #45 Week No.45 and this is the last edition before re:Invent so look out this week for some blog posts sharing news about the open source track and open source sessions at re:Invent this year. This week we have another great selection of posts, projects and more. Make sure you check out the Karpenter project that was announced last week during AWS Container Day at KubeCon, a great selection of Kubernetes/container related posts and some more great posts on AWS Graviton2 and Nitro Enclaves. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no44/ Mon, 16 Nov 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no44/ November 16th - Instalment #44 Week No.44 and in a weekend just gone where Lewis Hamilton was crowned the world champion for the seventh time, it was interesting to learn that he has used the number 44 since 2014. From the grand prix to the grand prize of open source, and this week we have open source posts from a number of the AWS Hero communities, Spring Boot fans and a selection for those interested in GraphQL as well as the usual round up of projects, events and case studies. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no43/ Mon, 09 Nov 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no43/ November 9th - Instalment #43 Week No.43 or 101011 if you prefer binary notation. This week we have the usual collection of open source projects, blog posts, events, case studies and workshops. Of note this week is the GA of the Lambda Powertools for Java, news of the announcement last week of the new RabbitMQ message broker service, more AWS Nitro Enclave goodness, a brand new workshop from Nader Dabit and more events and webinars for your diary. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no42/ Mon, 02 Nov 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no42/ November 2nd - Instalment #42 Week No.42 - 42 may be the answer to the ultimate question of Life, the Universe and Everything, but for today it is just the latest roundup of all the open source news, projects, events, case studies related to AWS. This week we have a great case study from Intuit and their journey to Kubernetes, we have a couple of nice updates from the Open Distro for Elasticsearch, sleemo a nice new open source GraphQL framework and the Stelligent University, an open source curriculum to help bootstrap your learning on AWS. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no41/ Mon, 26 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no41/ October 26th - Instalment #41 Episode No.41 - As we approach Halloween this week, there is nothing scary or frightening in this episode, just a shockingly good amount of new open source projects, blog posts, case studies and events to add to your diary. Last week was dominated by the Open Distro for Telemetry preview announcement (read all about that in a minute) but there is also great stuff such as the unboxing of HashiCorp’s Waypoint by the Containers from the Couch team, something for Java folk and another Graviton2 post. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no40/ Mon, 19 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no40/ October 19th - Instalment #40 Week No.40 - if life begins at 40 then I am pleased that this newsletter has reached this milestone. We are only just getting started, and since producing this in January we have covered over 800 articles and over 300 different authors covering open source projects and topics. This week we have the usual round up of new projects, a variety of blog post topics including a couple of unmissable posts on how you can combine Rancher, Kubernetes and the AWS Snowball family of products for some interest ‘edge of edge’ deployment models and a great post covering an old favourite of mine, AWS DeepRacer. https://blog.beachgeek.co.uk/newsletter/podcast-open-source-builders-arpit-mohan/ Sat, 17 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/podcast-open-source-builders-arpit-mohan/ In this podcast I speak with Arpit Mohan, CTO and Co Founder of Appsmith an innovative no/low code project that can accelerate how you build solutions for your customers. In this session I chat with Arpit and ask him about his journey in tech, the leap from hardware to software, the ups and downs of startups and of course open source software. Here are some of the points we cover in this podcast. https://blog.beachgeek.co.uk/amazon-aurora-setting-up-and-configuration-four-ways/ Thu, 15 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/amazon-aurora-setting-up-and-configuration-four-ways/ In this post I want to share four different approaches to installing and configuring your Amazon Aurora database clusters. Everything in this post is covered in detail in the embedded video, but I wanted to share some additional information that I did not include in the video that was easier done in this blog. {% youtube wZfh9PurE9E %} Why four ways? The approach in the video was to look at the journey you might take when learning a new technology and then how you move to productise that technology. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-39/ Mon, 12 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-39/ October 12th - Instalment #39 Week No.39 - The 39 Steps is a pretty famous film, a spy thriller if you are into those types of films and I recently found out that the name came from a location not too far from me. I am pleased to say that episode 39 of this newsletter is equally thrilling, combining the usual mix of new open source projects (including one so fresh, it is still warm to the touch), blog posts, case studies and events for you to check out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-38/ Mon, 05 Oct 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-38/ October 5th - Instalment #38 Week No.38 and following on from the very first CDK Day, there is plenty of AWS CDK stuff including a link to the recording of the event if you missed it. Aside from that, there is the usual round up of blog posts, including another excellent post featuring honeycomb.io doing some benchmarks on running AWS Graviton2 instance types on a number of open source projects, the latest new AWS related open source projects, events, case studies and we also have a workshop for you, covering how to get started with TorchServe. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-37/ Mon, 28 Sep 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-37/ September 28th - Instalment #37 Week No.37 and plenty of open source goodness to sink your teeth into this week. We have the usual projects round up, including projects to help you work with your AWS Secrets via the CLI or quickly spin up AWS infrastructure, we have posts covering topics such as Spring Boot, tagging of AWS resources and a must read post on Kubernetes and then finally we have the usual round up of AWS open source goodies and case studies. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-36/ Mon, 21 Sep 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-36/ September 21st - Instalment #36 Week No.36 and this week have the usual round up of open source goodies, but I do want to call out the Lambda Power Tool UI project and the AWS Graviton2 posts this week as must reads. There is also a a couple of excellent deep dives from Alex Casalboni on optimising Lambda and from Blair Hudson, head of data engineering at Faethm AI. Finally, learn more about how Boston is tackling urban deforestation with the use of open data sets, machine learning and is open sourcing the project. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-35/ Mon, 14 Sep 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-35/ September 14th - Instalment #35 Week No.35, this week we have more great blog posts, projects, events and case studies for you. This week we have the first open source themed Dev Day (see below) which is something I encourage you all to check out as some AWS’s best speakers will be covering some great open source topics. As always, thanks for everyone who contributes these posts - please follow them to keep up with future posts and updates. https://blog.beachgeek.co.uk/long-running-data-import-jobs-with-aws-session-manager/ Thu, 10 Sep 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/long-running-data-import-jobs-with-aws-session-manager/ Yesterday I was looking to import the TPC-H dataset (some 600 or so million rows) into Amazon Aurora from a workstation that I connect to using AWS Session Manager. AWS Session Manager is a great way to simplify your life by allowing you to connect to a machine via the AWS console and not worry about having to manage ssh keys or remembering to lock down external public access from the net. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-34/ Mon, 07 Sep 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-34/ September 7th - Instalment #34 Week No.34, and another packed issue with some great posts, projects and events covering all your favourite open source projects. This week there has been a lot of focus on Bottlerocket, which went GA last week, so plenty of stuff to read as well as several videos to watch. There are a couple of events happening later this week, so check the events just a little below and save the date in your diary. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-33/ Mon, 31 Aug 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-33/ August 31st - Instalment #33 Week No.33, and as we come to the end of the summer season with people returning back from holiday, it is good to see that there has been no slow down in open source activities. This week we have plenty of blog posts, projects for you to check out and customer stories. We also have a growing list of events to add to your diary, so make sure you check these out too. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-32/ Mon, 24 Aug 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-32/ August 24th - Instalment #32 Week No.32 and after two weeks taking some time off visiting sunny Scotland, I return refreshed with a bumper edition with the pick of posts from the past few weeks. As always, some great posts and projects as well as some events you might want to add to your diary and a few customer case studies for you to check out. Your feedback matters! I have put together a short feedback survey, which I would ask you to take - it will take no more than 2 minutes. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-31/ Mon, 03 Aug 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-31/ August 3rd - Instalment #31 Week No.31 and the last update for a few weeks. I will be taking a break from all things open source and tech, seeking solace in nature and recharging my curiosity batteries for the next couple of weeks, so there will be no updates August 10th and 17th. In the meantime, enjoy another packed edition - there appears no slow down when it comes to open source. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-30/ Mon, 27 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-30/ July 27th - Instalment #30 Week No.30 and another week of great projects and posts. We have a new open source builder story, the usual selection of projects from robotics to compliance/governance tools and blog posts that cover topics from machine learning to security and serverless. Another good selection of cases studies and customers who are using open source to make a difference as well as some events you should check out and add to your diary. https://blog.beachgeek.co.uk/newsletter/podcast-open-source-builders-justin-garrison/ Wed, 22 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/podcast-open-source-builders-justin-garrison/ In this podcast I speak with Justin Garrison, Developer Advocate in the Containers team at AWS, and ask him about his journey in open source. From user to contributor According to PwC’s annual CEO Survey (which you can find easily enough via your preferred search tool), one of the top challenges keeping CEO’s up at night is how to tackle their digital skills shortage. In fact, 74% were concerned about the availability of key skills. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-29/ Mon, 20 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-29/ July 20th - Instalment #29 Week No.29, and another epic edition packed with lots of great projects and posts, as well as a larger than normal number of case studies this week. Pick of the bunch from me (always hard) is the walkthrough of the CDK Patterns from Matt, the customer case studies and the finala and inframap projects. Remember, if you have a project you want me to mention or talk about, then please reach out. https://blog.beachgeek.co.uk/building-a-culture-of-security-in-open-source-software-development/ Wed, 15 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/building-a-culture-of-security-in-open-source-software-development/ Updated on Jan 18th to remove broken link to report According to a number of recent studies, the use and adoption of open source software continues to rise. From studies such as the State of Enterprise Open Source by Red Hat (in which nearly 70% of respondents stated that open source software is either extremely or very important) or TideLift’s April 2019 survey report (that found more than 90% of professional developers use open source in building their applications) it is clear that developers from startups to highly regulated enterprises have embraced open source solutions. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-28/ Mon, 13 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-28/ July 13th - Instalment #28 Week No.28, and this week we have another fantastic collection of open source posts covering robotics, containers, serverless, machine learning and more. I cover a number of projects you can get stuck into, including robotics projects and resources, a continuous machine learning project posts and the usual collection of indispensable projects that you will wonder how you ever managed without. Finally there are some events you might want to put in your diary. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-27/ Mon, 06 Jul 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-27/ Updated, 18th Jan to remove dead links July 6th - Instalment #27 Week No.27, and as the days start getting shorter, these weekly newsletters just keep getting longer. There is so much activity and energy in open source, and I am continuously amazed at what new stuff I unearth and uncover. This week we have more machine learning goodness, containers, a splattering of serverless, some very interesting .NET updates as well as some more esoteric articles. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-26/ Mon, 29 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-26/ June 29th - Instalment #26 No.26 and officially the half way point of the year. There has been no let up in open source projects and posts. This week we have machine learning deep dives and projects, including a reinforcement learning project that might help you win at Poker, security, serverless and modern application posts. It was really good to catch up this week with Arpit Mohan, CTO and co-founder of Appsmith about the topic of open source, growing awareness and different licensing models. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-25/ Mon, 22 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-25/ June 22nd - Instalment #25 No.25 is another packed edition with plenty of interesting projects and stories for you to read, whether you are into machine learning, robots, cutting your teeth on code or looking at how to automate and secure your deployments, there is something for you. As we past the summer equinox and very close to the half way point of the year, I wanted to share some of the data I have collected over the past six months when putting together this digest and speaking with the builders and business' using open source. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-24/ Mon, 15 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-24/ June 15th - Instalment #24 Another expansive instalment in No. 24, as we approach the half way point of the year. In this episode we have a number of PHP related posts, fitting as it rapidly approaches its 25th anniversary. If you are a PHP builder, then keep your eyes/ears posted, as we have something special for you soon. Aside from PHP, we have some great new projects as well as important new releases for existing ones that you need to know about. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-23/ Mon, 08 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-23/ June 8th - Instalment #23 Episode 23 - I was reminded this week that I have now posted over 30 posts to dev.to since I joined the platform late last year. I am currently putting together some stats that I will share with you around the breakdown of various open source topics I have seen over that time. Watch this space. This week I have added a Retro section as one of the things that keeps coming up is cool open source projects that are not new, but I had never heard of before and are getting new contributions or releases. https://blog.beachgeek.co.uk/automating-aws-sso-and-g-suite-synchronisation-with-sso-sync/ Wed, 03 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/automating-aws-sso-and-g-suite-synchronisation-with-sso-sync/ update-July 28th The ssosync tool has had a lot of interest and the community has updated the tool. This means that you should refer to the project home page https://github.com/awslabs/ssosync and check out the README.md for what changes you might need to make to get this tool working. Next level ssosync In a previous post, I talked about setting up AWS Single Sign On (AWS SSO) with G-Suite, and then using an open source project called ssosync to syncronise users and groups from G-Suite into AWS SSO. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-22/ Mon, 01 Jun 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-22/ June 1st - Instalment #22 Episode 22, and another great collection of open source stories, updates and projects. Whether it learning about new open source application run times like Deno, impactful projects like AutoSpotting that might help you reduce your costs or those simple but every so useful projects that you just could not get by without, such as ssosync or EKStender. Please contact me with your AWS related open source projects. https://blog.beachgeek.co.uk/setting-up-g-suite-aws-sso-and-ssosync/ Wed, 27 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/setting-up-g-suite-aws-sso-and-ssosync/ update-July 28th The ssosync tool has had a lot of interest and the community has updated the tool. This means that you should refer to the project home page https://github.com/awslabs/ssosync and check out the README.md for what changes you might need to make to get this tool working. Enabling AWS SSO with Google G-Suite Many customers have existing directory technologies where they manage their users, and then use this central identity store as a way to simplify the way they authenticate and provide access to applications and other resources. https://blog.beachgeek.co.uk/newsletter/aws-open-sources-new-and-updates-no-21/ Mon, 25 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-sources-new-and-updates-no-21/ May 25th - Instalment #21 Episode 21, another full edition. We have some significant announcements of new projects from Uber, a variety of different posts and code for those interested in containers, plenty of serverless goodness and as always, some great Amplify and AWS AppSync posts. We also have a couple of posts on how to get some open source projects you might be using up and running on AWS. Before you dive in, a couple of things you check out first. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-20/ Mon, 18 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-20/ May 18th - Instalment #20 Episode 20, another packed episode with plenty to check out, and some really great announcements and projects to share. With that, let’s get started with one of our big announcements last week. cdk8s The big news this week though was the launch of CDK for Kubernetes, an open-source software development framework for defining Kubernetes applications and reusable abstractions using familiar programming languages and rich object-oriented APIs. https://blog.beachgeek.co.uk/newsletter/aws-open-sources-new-and-updates-no-19/ Mon, 11 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-sources-new-and-updates-no-19/ May 11th - Instalment #19 Episode 19, and this week’s edition is bursting at the seams with probably the biggest amount of news and updates to share (hence the later posting). Looks like everyone has been busy, and there were some things I had to leave out for another time. Before I get started though, I think it is worth reflecting on this blog post by Matt Asay, The most important part of an open source project, where he talks about the value of all contributions in open source projects, not just the developers cutting code. https://blog.beachgeek.co.uk/making-the-most-of-mentoring/ Fri, 08 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/making-the-most-of-mentoring/ Some recent experiences mentoring has provided the motivation for this piece. It is not intended to be right or wrong, but just my personal opinion and experience and I hope it is read that way. I have put this together to share what I think are the critical things that make a mentoring relationship work for both the mentor and mentee. So with that out of the way, I invite you to read on… https://blog.beachgeek.co.uk/newsletter/aws-open-sources-news-and-updates-no-18/ Mon, 04 May 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-sources-news-and-updates-no-18/ May 4th - Instalment #18 Episode 18, is the open source Force strong in you? A post from colleague Matt Asay this week, Remembering when open source is fun made me think about the first open source projects I got my hands on (Apache httpd server, back in 1998). Good times indeed, but it wasn’t until later that I did my first contribution (a security module for Atlassian’s Confluence to enable SSO). https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-instalment-no-17/ Mon, 27 Apr 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-instalment-no-17/ April 27th - Instalment #17 Episode 17, and as we leave April and head into May, we have a bumper edition with some very interesting new open source projects that AWS launched this week, TorchServe and Amazon Keyspaces as well as the usual round up of interesting projects, blog posts and other essential reading materials to keep you up to speed with the world of AWS and open source. Celebrate open source contributors The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-16/ Mon, 20 Apr 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-16/ April 20th - Instalment #16 Episode 16, and like most folk confining myself to my home has provided me with lots of time to search the four corners of the internet to bring you all the latest news, updates and interesting things happening where open source meets AWS. This week I want to share a couple of posts in which both Amazon and open source developers and communities are helping to tackle the COVID pandemic. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-15/ Mon, 13 Apr 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-15/ April 13th - Instalment #15 Episode 15, the Easter special and even though this is a holiday in most of Europe, that was not going to stop me posting this weeks latest and greatest updates from the confluence of AWS and open source. Celebrate open source contributors The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-14/ Mon, 06 Apr 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-14/ April 6th - Instalment #14 Episode 14, and yet more abundance of open source to share with you. Fourteen is an interesting number, and very quickly googling this, I learnt that the number fourteen has a number of interesting facts: the moon waxes for fourteen days and then wanes for fourteen days, a golf player can have no more than fourteen clubs in their caddy, it is the atomic number for silicon and for those who enjoy their open source with the literature, 14 is also the number of lines in a sonnet. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-13/ Mon, 30 Mar 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no-13/ March 30th - Instalment #13 Episode 13, lucky for some, superstitious for others. I can promise you no superstitious when you read this, nothing but the finest open source news and updates from around the globe and hopefully a few projects that you will find useful. First though, let us celebrate those people that without them, this newsletter would be just an empty vessel. Interesting to see a higher than normal number of new projects and first time projects this week which is awesome. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no12/ Mon, 23 Mar 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-no12/ March 23rd - Instalment #12 Episode 12 in the series of open source news and updates on AWS brings you another mixed bag of treats. I wanted to start this instalment however with some of the projects that are looking to help respond to the current COVID-19 situation. You can read more about some of the initiatives at Amazon in the blog post that shows how we are helping researchers and scientists accelerate diagnostics, research and testing. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-11/ Mon, 16 Mar 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-11/ March 16th - Instalment #11 Another packed weekly instalment of open source goodness for you, including a very hot announcement we made this week on Bottlerocket. Whether you are interested in security, devOps or the latest open source projects that run on AWS or make your life easier, then read on as there is something for you. Celebrate open source contributors The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-10/ Mon, 09 Mar 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-10/ March 9th - Instalment #10 Another bumper packed edition of everything new and interesting in the world where open source and AWS comingle. I have been asked a few times as to how do I choose the articles that go into these posts, so I thought I would very quickly share that; what does and does not go into these posts. The idea of this series is to provide a curated list of open source projects that are either created by AWS, by the builders within AWS and open source projects that are created by customers and builders that either help other customers use AWS services and open source projects. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-9-dart-quarkus-firecracker-and-much-more/ Mon, 02 Mar 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-9-dart-quarkus-firecracker-and-much-more/ As we head into March and instalment #9 of AWS open source news and updates, over the past two months I have shared eight posts covering over 100 unique articles on open source and AWS. It is great to see so much activity and across such a broad spectrum of interests. This instalment is representative of that, with everything from security, machine learning, big data and analytics to new programming runtimes. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-8/ Mon, 24 Feb 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-8/ Another episode of the open source news and updates from AWS, and in this installmant I talk a little about the recent trip to Lagos, Nigeria where I talked about why developers should care about open source at the Open Source Festival, as well as more of the usual updates from around the AWS services catalog as well as some interesting customer projects. Open Source Fesitval - Lagos, Nigeria Last week I was invited to speak at the Open Source Festival in Lagos, Nigeria. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-7-networking-data-analytics-security-and-more-/ Mon, 17 Feb 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-7-networking-data-analytics-security-and-more-/ Episode #7 of the open source news and updates for AWS. More security posts in this weeks updates, together with some other cool updates from machine learning, networking and data analytics. I am always looking for interesting open source projects that run on AWS, so if you are working on or know about any, please let me know as I would love to make more people aware. Open Distro for ElasticSearch This tweet announced that the AWS managed Amazon Elasticsearch service had now incorporated the security features that have been available on the Apache 2. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-6-keep-up-to-date-with-everything-that-is-happening/ Mon, 10 Feb 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-6-keep-up-to-date-with-everything-that-is-happening/ With still so much to digest post FOSDEM, SustainOSS and CHAOSS, this weeks updates are a little more lightweight and easy to consume. I am going to work on some tutorials/coding posts so would be interested (use comments) on what open source AWS projects you would like to see material on. Modernising with open source Following on from the previous post on the essential open source tools for serverless, I came across this blog post by Matt Billock called “Essential Open Source Serverless Tools” - it is a great reference guide, so check it out. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-5/ Mon, 03 Feb 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-5/ So, hello February and welcome to open source updates and news at AWS #5, the FOSDEM edition. Sadly I was unable to attend due to my passport being held to get a VISA, but I have managed to speak with a number of attendees and get some updates from the event. CHAOSCON and SustainOSS The day before FOSDEM we had Sustain Open Source, an event thinking about the sustainability of open source software. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-4/ Wed, 29 Jan 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-4/ Welcome to open source updates and news at AWS #4 the end of January 2020 edition. Keeping you up to speed with all things open source and AWS. Let’s dive right in. Important announcement If you are using the Amazon Linux AMI (this was launched back in 2010, and then subsequently we released the Amazo Linux 2 AMI in 2017) then you should be aware that this AMI is now end-of-life. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-3/ Thu, 23 Jan 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-3/ So, welcome to open source updates and news at AWS #3 - I should really try and thing of a more entertaining sequence. Next time perhaps… This update has been inspired by a recent trip away with some colleagues. On the way home, I started talking to the person next to me. He was an SA working on HPC, High Performance Computing, an area that I had read about a tiny amount but something I really didnt know that much. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-2-/ Fri, 17 Jan 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-2-/ This is update #2 of open source at AWS (#1 here), the regular update where I will share updates and interesting content from stuff we are doing as well as sharing interesting projects our customers are working on. This post has a bit of a Security theme, with a number of interesting open source related projects and content. But dont worry, there is lots more cool stuff on machine learning and AWS open source projects too, So lets dive straight on in. https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-1/ Sat, 11 Jan 2020 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/aws-open-source-news-and-updates-1/ This is the first in a regular series that will keep you posted on the open source projects, communities and activities that are going on in AWS as well as bringing you some interesting open source projects that builders have put together and that I have stumbled across. Open Source projects of the week A few open source projects caught my eye, and I havent not yet had a chance to try them out yet, they are on my weekend project todo list. https://blog.beachgeek.co.uk/mentoring-and-reverse-mentoring/ Sun, 29 Dec 2019 00:00:00 +0000 https://blog.beachgeek.co.uk/mentoring-and-reverse-mentoring/ As I reflect on 2019, one of the common themes whilst engaging with builders at the start of their career, has been how do those of us who have deep experience working in the IT industry and technology help bring those who are just starting out? Some common themes when talking that have come up include; How do I get started on Cloud or AWS? What tools and languages should I learn? https://blog.beachgeek.co.uk/reinvent-2019-workshop-list/ Mon, 09 Dec 2019 00:00:00 +0000 https://blog.beachgeek.co.uk/reinvent-2019-workshop-list/ So here is a list scraped from Twitter and following various other folk, of just a small taster of the workshops that ran during reInvent. As I find more I will update, and feel free to add yours in the comments (oh, and let me know if any of these are dead links) Serverless - https://github.com/aws-samples/aws-serverless-workshop-innovator-island/ Serverless image process workshop - https://image-processing.serverlessworkshops.io/ Amplify preductions workshop - https://github.com/mlabieniec/IonicPredictions Full stack serverless Amplify lab - https://github. https://blog.beachgeek.co.uk/newsletter/open-source-reinvent-2019-/ Fri, 06 Dec 2019 00:00:00 +0000 https://blog.beachgeek.co.uk/newsletter/open-source-reinvent-2019-/ So, with reInvent drawing to close and many of the attendees recovering from the after party (re:Play), I thought I would put together a curated list of the open source sessions that have been running this week. We had a great variety of open source sessions, covering topics from data and data analytics to robotics. If you missed these sessions, you can check out the videos in this post below. They are sorted by category to help you find those that are of most interest to you. https://blog.beachgeek.co.uk/make-your-business-more-resilient-in-the-digital-age/ Thu, 17 Oct 2019 00:00:00 +0000 https://blog.beachgeek.co.uk/make-your-business-more-resilient-in-the-digital-age/ Very humbled to write a guest post on Adrian Hornsby excellent blog where he provides guidance to help customers build resilient architecture and champions operational excellence. In this post I talk about what you need to think about to build a more resilient business fit for the digital age. Here is the link: https://medium.com/@adhorn/make-your-business-more-resilient-in-the-digital-age-888da3f5deaf https://blog.beachgeek.co.uk/innovate-machine-learning-and-ai-learn-how-to-kick-start-your-journey/ Fri, 04 Oct 2019 00:00:00 +0000 https://blog.beachgeek.co.uk/innovate-machine-learning-and-ai-learn-how-to-kick-start-your-journey/ On October 17th we have a free, online event covering several tracks on Machine Learning. Whether you are a complete beginner or seasoned data scientist, we have gentle introductions to deep dives. What I am most excited about however, is that we will have an AWS DeepRacer racing challenge. You will learn how to create your first reinforcement learning model that will race a virtual car, with prizes for the fastest times. https://blog.beachgeek.co.uk/about/ Wed, 09 Apr 2014 00:00:00 +0000 https://blog.beachgeek.co.uk/about/ About Me Ricardo is a principal developer advocate at Amazon Web Services; he works with builders, technology leaders and enterprise executives to help them transform their businesses. Prior to joining AWS Ricardo worked for one of the largest professional services firms. He has over twenty years of experience leading open source, emerging technology and innovation programmes. He has been working with cloud technologies since 2008 and open source since 1997. https://blog.beachgeek.co.uk/blog/ Mon, 01 Jan 0001 00:00:00 +0000 https://blog.beachgeek.co.uk/blog/