In this Halloween-themed episode, Eoin and Luciano tell some AWS horror stories! Get ready for some trick or treat!
Of course we have to start with billing and we tell some of our failures with predicting cost ending up with a nightmarishly bad billing surprise! We also discuss some horror stories from the perspective of AWS developer experience and finally we touch on some Cloudformation terrors!
In this episode, Eoin and Luciano talk about how to manage AWS credentials and different ways to manage them. From the more traditional (and not recommended) IAM credentials to SSO.
In this episode we mentioned the following resources:
- GitHub integration with OIDC: https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/configuring-openid-connect-in-amazon-web-services
- MFA access for assumed roles: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_mfa_configure-api-require.html
- AWS vault: https://github.com/99designs/aws-vault
- AWS SSO utils: https://github.com/benkehoe/aws-sso-util
- AWS SSO export credentials: https://github.com/benkehoe/aws-export-credentials
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
...
https://www.youtube.com/watch?v=X4uA6EtNyos
If you've been using AWS for a while, you might have heard the term "well-architected". But what does it really mean? Don't worry if you're not quite sure, because we are here to help!
In this episode of AWS Bites, we will be diving into the world of well-architected and explaining what it means, both in general and in the specific context of AWS. We will be covering the well-architected framework, the different tools, and facets that come with it, and answering some practical questions like "should you care about building well-architected workloads?" and "how do you know if your workloads are well-architected?".
Whether you're a startup or a mature organization, learn why building well-architected systems is crucial for the long-term success of your business.
By the end of this episode, you'll have a solid understanding of the world of well-architected and why it's so important. Let's dive in!
? SPONSORS ?
AWS Bites is sponsored by fourTheorem (https://fourtheorem.com). fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture.
? Chapters:
00:00 Intro
01:18 A generic definition of "Well-architected"
02:36 "Well-architected" in the context of AWS (The framework, the pillars, lenses, the tool, etc)
06:05 Should you care about building "Well-architected" workloads?
08:22 How do you know if you are "Well-architected"?
10:33 What if you find out you are NOT "Well-architected"?
12:29 Examples of Well-architected review questions.
15:09 Should I do the Well-architected review alone or do I need a partner?
18:45 Closing notes
In this episode, we mentioned the following resources:
- The well-architected framework: https://aws.amazon.com/architecture/well-architected/
- The well-architected paper by AWS: https://docs.aws.amazon.com/wellarchitected/latest/framework/welcome.html
- The well-architected tool: http://aws.amazon.com/well-architected-tool/
- Well-architected labs: https://www.wellarchitectedlabs.com/
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#AWS #architecture #wellarchitected
...
https://www.youtube.com/watch?v=ruvT4PGbuOY
A quick description of what technical debt is, when it is acceptable and how it might eventually bankrupt your company if you are not careful.
Brought to you from the AWS Bites podcast! You can watch the full episode about how we work as cloud consultants here: https://www.youtube.com/watch?v=IFsX9TGfHDY
...
https://www.youtube.com/watch?v=RHisI1iJYmQ
In this episode of AWS Bites, we take you on a captivating migration journey. Together, we'll explore how we transformed fullstackbulletin.com's automation process, leaving behind the complexities of a monolithic AWS Lambda and embracing the efficiency of Step Functions.
Join us as we dive into the challenges of automating a weekly newsletter, trying to strike the perfect balance between automation and manual curation. We'll discover the risks of relying on external services and how we navigated these obstacles during our migration.
Together, we'll uncover the step-by-step process of breaking down the monolithic Lambda architecture and orchestrating a more manageable approach with Step Functions. We will also briefly touch on alternative social platforms like Mastodon and other Twitter alternatives during our migration adventure.
Learn with us about different migration strategies and the crucial role of observability for smooth operations. Finally, we will share some valuable lessons that you can apply to your production workloads.
? SPONSORS ?
fourTheorem is the company that makes AWS Bites possible. If you are looking for a partner to accompany you on your cloud journey, check them out at fourtheorem.com !
? Chapters:
00:00 Intro
00:45 The context: a weekly newsletter automated using AWS Lambda
01:21 The different steps in the automation
03:58 The balance between automation and manual curation
06:06 The problems of relying on external services: what happens when they change?!
09:51 Decomposing all this complexity into steps orchestrated by a step function
11:54 The advantages of using a step function
12:55 A segway about Mastodon and other Twitter alternatives
14:35 Migration strategies: big bang migrations vs incremental steps
17:23 Observability considerations: how do we know when things go wrong?
19:00 Lessons learned we can use for more serious production workloads
22:09 Resources and closing notes
In this episode, we mentioned the following resources:
- Fullstack Bulletin: https://fullstackbulletin.com/
- Fullstack Bulletin on GitHub: https://github.com/FullStackBulletin/
- Fullstack Bulletin remake recordings (YouTube playlist): https://www.youtube.com/playlist?list=PLbNOKnE-Oyr1tsUft4j0QZDyk5iFcVVy_
- SLIC Watch for automated observability: https://github.com/fourTheorem/slic-watch
- Eoin on Mastodon: https://mastodon.ie/@eoins
- Luciano on Mastodon: https://mastodon.ie/@loige
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#AWS #lambda #stepfunction
...
https://www.youtube.com/watch?v=vTplQSIipKE
Are you tired of feeling overwhelmed by the vast AWS landscape? Do you find yourself constantly struggling to keep up with all the tasks at hand? Look no further! In this episode of AWS Bites podcast, Eoin and Luciano share their top six time-saving tools to help you reclaim your productivity and make the most of your AWS experience. These tools are designed to make your life easier and allow you to achieve more in less time.
But don't worry, this won't be a boring lecture. Get ready to have some fun as they reveal their top tricks and tips, from profiles and SSO to terminal gems and CLI magic. These tools will have you feeling like a kid in a candy store, soaring through your AWS work with ease. And if that wasn't enough, they've got a few extra special surprises in store to take your AWS skills to new heights.
So buckle up and get ready for a wild ride, it's time to have some fun with AWS!
? SPONSORS ?
AWS Bites is sponsored by fourTheorem (https://fourtheorem.com). fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture.
? Chapters:
00:00 Intro
00:51 1. Security, IAM and SSO (granted.dev + aws-sso-util)
04:19 2. Starship terminal with integrated AWS profile
05:53 3. AWS Shell & aws --cli-auto-prompt
07:04 4. jq for parsing JSON in the CLI and jqi to learn jq filter language + other CLI tips
11:32 5. Dash app for easy access to documentation
13:00 6. Github Copilot
14:52 Eoin's honorable mentions: IAM policy simulator, AWS SDK for pandas, CloudShell
16:45 Luciano's honorable mentions: SLIC Watch, Middy Serverless Framework for Node.js, Lambda power tools libraries
In this episode, we mentioned the following resources:
- Our previous episode discussing SSO and OIDC identity providers: https://awsbites.com/45-what-s-the-magic-of-oidc-identity-providers/
- CLI application to switch profiles and roles easily: https://granted.dev/
- AWS SSO CLI tool: https://github.com/synfinatic/aws-sso-cli
- Starship universal terminal prompt: https://starship.rs/
- jq CLI helper: https://stedolan.github.io/jq/
- ijq (interactive jq): https://github.com/gpanders/ijq
- AWS CLI --filter option: https://docs.aws.amazon.com/cli/latest/userguide/cli-usage-filter.html
- Dash documentation app for Mac: https://kapeli.com/dash
- GitHub Copilot: https://github.com/features/copilot
- IAM Policy Simulator: https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_testing-policies.html
- AWS SDK for Pandas: https://github.com/aws/aws-sdk-pandas
- AWS CloudShell: https://aws.amazon.com/cloudshell/
- SLIC Watch: https://github.com/fourTheorem/slic-watch
- Our previous episode on SLIC Watch: https://awsbites.com/34-how-to-get-the-most-out-of-cloudwatch-alarms/
- Middy Serverless Framework for Node.js: https://middy.js.org/
- Our previous episode on Middy: https://awsbites.com/41-how-can-middy-make-writing-lambda-functions-easier/
- Our article on AWS Power tools for TypeScript: https://fourtheorem.com/aws-lambda-powertools/
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#AWS #tips #productivity
...
https://www.youtube.com/watch?v=wlZqFtYmWZ4
We do love AWS, but sometimes we have to admit that it’s not always a silver bullet. There are definitely use cases where it might be worth considering alternatives to AWS.
In this episode we will discuss some of these use cases and try to highlight what are the advantages that other platforms or services can have over AWS in very specific circumstances. First of all we clarify why we like AWS and why (and when) it’s worth sticking with it. Then, we discuss what are some of the reasons why it might be worth considering alternatives to AWS. At this point we go into the specifics and talk about authentication services (Auth0), search services (ElasticSearch, Algolia), CDN Services (GitHub Pages, Netlify, Vercel, CloudFlare, Fastly, Akamai), Databases (MongoDB Atlas, Digital Ocean managed databases, IBM Compose, CloudFlare D1, Upstash, Confluent Kafka), Headless CMS services (ContentFul, Storyful, AirTable, Google Spreadsheet), Virtual Machine services (Digital Ocean, Linode).
Chapters
0:00 Intro
0:28 Why go all-in on AWS?
1:23 When to use other vendors
3:11 Authentication and authorisation providers
5:30 Search services and logs
9:26 CDN providers
11:04 Database as a service
16:28 API as a service
20:33 EC2 alternatives
22:48 Drop-in replacements for S3 and more
25:34 Closing
In this episode, we mentioned the following resources:
- Previous Episode “3. How do you deploy a static website on AWS?”: https://awsbites.com/3-how-do-you-deploy-a-static-website-on-aws/
- Auth0: https://auth0.com/
- Amazon OpenSearch: https://aws.amazon.com/opensearch-service/the-elk-stack/what-is-opensearch/
- Elastic Cloud: https://www.elastic.co/cloud/
- Algolia: https://www.algolia.com/
- Vercel: https://vercel.com/
- Netlify: https://www.netlify.com/
- MongoDB Atlas: https://www.mongodb.com/atlas/database
- Digital Ocean managed database: https://try.digitalocean.com/managed-databases/
- Compose (now IBM Cloud Databases): https://www.compose.com/
- Upstash: https://upstash.com/
- Confluent: https://www.confluent.io/
- AirTable: https://airtable.com/
- Linode: https://www.linode.com/
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#aws #cloud #alternatives
...
https://www.youtube.com/watch?v=HTPtVIhIf2s
Do you know what horrors lurk in your AWS account? Aren't you afraid of the murky waters of an old and cluttered AWS account, which might be rife with security risks and other unexpected dark forces?
Fear no more!
In this episode, we share our best tips to discover every resource in your neglected AWS account and, whether you decide to clean things up, delete what's needed, or just put some order into the mess, we give you some practical suggestions on what kind of tools or services you could you to achieve your task.
Throughout the episode, we reveal some of the secrets and hidden potential of AWS Config, Resource Explorer, Resource Groups, and CloudTrail.
Finally, We talk about third-party services and open-source projects such as Resmo, Steampipe, and CloudQuery, which can even span the realms of AWS and help you with other clouds and services.
? SPONSORS ?
AWS Bites is sponsored by fourTheorem (https://fourtheorem.com). fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture.
? Chapters:
00:00 Intro
00:53 Why is useful to look at what's in your cloud account?
03:50 What kind of tools can you use in AWS to inspect your cloud account?
04:11 AWS Config
07:40 Resource Explorer
09:04 Resource Groups and Tag Editor
09:50 CloudTrail
11:00 Tools and resources outside AWS
11:48 Resmo (paid tool)
13:34 Steampipe (free)
14:38 Cloudquery
16:12 What do you do with resources that you don't want anymore?
17:50 What if there are things that you want to keep?
21:16 Closing notes
In this episode, we mentioned the following resources:
- AWS Config: https://aws.amazon.com/config/
- AWS Resource Explorer: https://aws.amazon.com/resourceexplorer/
- AWS Resource Groups: https://docs.aws.amazon.com/ARG/latest/userguide/resource-groups.html
- AWS Tag Editor: https://docs.aws.amazon.com/tag-editor/latest/userguide/tagging.html
- CloudTrail: https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-user-guide.html
- Resmo https://www.resmo.com/
- Steampipe: https://steampipe.io/
- CloudQuery: https://www.cloudquery.io/
- Our previous episode: "How do you move away from the management console?": https://awsbites.com/11-how-do-you-move-away-from-the-management-console/
- cloud-nuke: https://github.com/gruntwork-io/cloud-nuke
- aws-nuke: https://github.com/rebuy-de/aws-nuke
- terraformer: https://github.com/GoogleCloudPlatform/terraformer
- Former2: https://github.com/iann0036/former2
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#AWS #resources #catalogue
...
https://www.youtube.com/watch?v=Sh2nE7_-ews
In this episode, we discuss how we automated generating YouTube descriptions, chapters and tags for our podcast using Amazon's new GenAI tool: Bedrock.
We provide an overview of Bedrock's features and how we built an integration to summarize podcast transcripts and extract relevant metadata using the Anthropic Claude model. We share the prompt engineering required to instruct the AI, and details on our serverless architecture using Step Functions, Lambda, and EventBridge.
We also discussed Bedrock pricing models and how we built a real-time cost-monitoring dashboard. Overall, this automation saves us substantial manual effort while keeping costs low. We hope this episode inspires others to explore building their AI workflows with Bedrock.
? SPONSORS ?
AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com !
? Chapters:
00:00 Introduction
00:49 Manual process before Bedrock: what did we want to automate?
04:27 Overview of Bedrock
09:24 Design goals for automation
12:30 Prompt engineering
16:06 Bedrock pricing models and our pricing dashboard
20:23 Conclusion
In this episode, we mentioned the following resources:
- The GitHub repository with the code for the AWS Bites website: https://github.com/awsbites/aws-bites-site
- Episoder: the open source project we created to handle this Bedrock-based automation: https://github.com/fourTheorem/episoder
- Podwhisperer: out other open source automation that creates accurate transcripts for our podcast: https://github.com/fourTheorem/podwhisperer/
- Amazon Bedrock Workshop: https://catalog.us-east-1.prod.workshops.aws/workshops/a4bdb007-5600-4368-81c5-ff5b4154f518/en-US
- Using generative AI on AWS for diverse content types (workshop): https://catalog.workshops.aws/genai-on-aws/en-US/01-introduction
- Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS: https://github.com/aws-samples/aws-genai-llm-chatbot/tree/main
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on X, formerly Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
#aws #genai #bedrock
...
https://www.youtube.com/watch?v=u945tsm4p7M
Luciano and Eoin deep dive into SNS discussing what it does, how it differs from EventBridge and SQS and how you can use it to send messages to customers but also for microservices communication. In this new episode dedicated to AWS events and messaging services, we learn everything there is to know about SNS including advantages, limitations and cost. This episode complements the episode about EventBridge, giving another perspective on when to use SNS and when to pick EventBridge instead.
00:00 Intro
00:48 What is SNS?
02:10 The advantages of SNS
04:16 How to use SNS?
06:54 SNS Message filtering and limits
07:50 SNS Pricing
08:19 Reliability
09:36 Integrating SNS and SQS
10:35 Comparison between SNS and EventBridge
13:50 Integration with other services
14:55 Additional resources & Closing
In this episode, we mentioned the following resources:
- Our previous episode about EventBridge: https://www.youtube.com/watch?v=UjIE5qp-v8w
- Our previous episode about all things SQS: https://www.youtube.com/watch?v=svoA-ds8-8c
- Our introductory episode about what services you should use for events: https://www.youtube.com/watch?v=CG7uhkKftoY
- A comparison between EventBridge and SNS by Cloudonaut: https://cloudonaut.io/eventbridge-vs-sns/
You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017
- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q
- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==
- Breaker: https://www.breaker.audio/aws-bites
- RSS: https://anchor.fm/s/6a3312a0/podcast/rss
Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige
...
https://www.youtube.com/watch?v=9uzQVr7fFIQ