Skip to content

Latest commit

 

History

History
247 lines (177 loc) · 14.2 KB

technology.md

File metadata and controls

247 lines (177 loc) · 14.2 KB

Technology

Types of Services

  • Compute: Provision compute resources from AWS.
  • Storage: Store data securely and efficiently.
  • Content Delivery: Distribute content globally with low latency.
  • Networking: Connect local environments to AWS.
  • Databases: Store and manage structured and unstructured data.
  • Migration and Transfer: Move applications and data to the AWS cloud.
  • Analytics: Gain insights from data using various AWS tools.
  • Machine Learning: Leverage AI and ML to add intelligence to applications.
  • Developer Tools: Accelerate software development and deployment.
  • Deployment and Infrastructure Management: Use tools to manage and provision infrastructure.

Elastic Compute Cloud (EC2)

  • Rent and manage virtual servers in the cloud.
  • Supports various instance types for different use cases (e.g., on-demand, spot, reserved).
  • Provides features like load balancing, auto-scaling, and high availability.

Lambda

  • Serverless compute service to run code without managing servers.
  • Supports multiple programming languages.
  • Scales automatically based on demand.

Additional Compute Services

  • AWS Fargate: Serverless compute engine for containers.
  • AWS Lightsail: Quick deployment of small projects and applications.
  • AWS Outposts: Run cloud services in internal data centers.
  • AWS Batch: Process large workloads in smaller chunks.

Simple Storage Service (S3)

  • Object storage service with virtually unlimited storage capacity.
  • Supports various storage classes (e.g., S3 Standard, Glacier) for different use cases.
  • Provides features like versioning, access controls, and data durability.
Feature S3 Standard S3 Intelligent-Tiering S3 Standard-IA S3 One Zone-IA S3 Glacier S3 Glacier Deep Archive
Description General-purpose storage for frequently accessed data Automatically moves data to the most cost-effective access tier based on usage Infrequently accessed data, but rapid retrieval needed Infrequently accessed data stored in a single availability zone Long-term archive with retrieval times in minutes to hours Lowest-cost storage for data that is rarely accessed
Retrieval Time Milliseconds Milliseconds Milliseconds Milliseconds Minutes to hours Up to 12 hours
Use Cases Frequently accessed data, low-latency needs Data with unknown or changing access patterns Infrequent access but needs quick retrieval Infrequently accessed, non-critical data Archival data that doesn't require immediate access Long-term data retention and compliance needs
Cost (Storage) Higher cost per GB Variable cost, optimized based on access patterns Lower cost than S3 Standard Lower cost than S3 Standard-IA Lower cost than S3 Standard-IA Lowest cost
Cost (Retrieval) No retrieval cost Charges apply when moving to IA or Glacier tiers Retrieval costs apply Retrieval costs apply Retrieval costs apply Retrieval costs apply
Minimum Storage Duration No minimum 30 days (infrequent tier), 90 days (archive tiers) 30 days 30 days 90 days 180 days

S3 Storage Tiers

EC2 Storage

  • EBS Volumes: Persistent storage attached to EC2 instances.
  • EC2 Instance Store: Temporary storage directly attached to EC2 instances, faster with higher I/O speed.
  • Amazon Elastic File Systems (EFS): Serverless network file system for sharing files among multiple instances.
  • FSx: Storage shelf tailored for specific conditions which supports Windows workloads with a seamless integration.
  • Elastic Disaster Recovery: Backup source to minimize downtime and data loss with a quick recovery time and a cost-effective solution.

Storage Gateway

  • Hybrid storage service connecting on-premises environments with AWS cloud storage.
  • Useful for backup, data migration, and reducing costs.

AWS Backup

  • Centralized backup service for AWS resources, providing backup plans and retention policies.

Content Delivery Network

  • Delivers content based on geographic location, improving speed and reducing latency.

Amazon CloudFront

  • Content delivery network that caches content at edge locations.
  • Supports low-latency delivery for static and dynamic content.

Amazon Global Accelerator

  • Directs users through AWS's global network, improving latency and availability.

Amazon S3 Transfer Acceleration

  • Speeds up transfers to and from S3 using CloudFront edge locations.

Amazon Virtual Private Cloud (VPC)

  • Isolated network in AWS to launch resources securely.
  • Supports features like subnets, route tables, internet gateways, and VPC peering.

VPC Architecture

Domain Name System (DNS)

  • Connects domain names with web servers, facilitating internet traffic routing.

Amazon Route 53

  • DNS service that routes users to applications and provides domain name registration.

AWS Direct Connect

  • Dedicated physical network connection from on-premises to AWS for secure data transfer.

AWS VPN

  • Secure connection between internal networks and AWS VPCs over the internet.

API Gateway

  • Build and manage APIs, facilitating data exchange between systems.

Database Services

  • Amazon Relational Database Service (RDS): Managed relational databases.
  • Amazon Aurora: MySQL and PostgreSQL compatible relational database.
  • Amazon DynamoDB: NoSQL key-value and document database.
  • Amazon DocumentDB: Managed MongoDB-compatible document database.
  • Amazon ElastiCache: In-memory datastore compatible with Redis and Memcached.
  • Amazon Neptune: Managed graph database service for connected datasets.

Database Migration Service (DMS)

  • Migrate databases to or within AWS with minimal downtime and data replication.

Snow Family

  • Physical devices to transfer large amounts of data to AWS.
Feature AWS Snowcone AWS Snowball Edge AWS Snowmobile
Storage Capacity Up to 8 TB usable storage Up to 80 TB usable storage per device Up to 100 PB per Snowmobile truck
Pricing Pay per use (low cost) Pay per use (medium cost) Pay per use (high cost due to scale and operation complexity)
Migration Size Small-scale data transfer Medium to large-scale data transfer Massive-scale data transfer (exabyte-level)

DataSync

  • Online data transfer service for moving data from on-premises to AWS.

Data Warehousing

  • Aggregates historical data for querying, reporting, and analytics.

AWS RedShift

  • Scalable data warehouse solution for handling exabyte-scale data.

Elastic Container Service (ECS)

  • Fully managed and serverless using Fargate
  • Supports Docker and Docker Compose CLI

Elastic Kubernetes Service (EKS)

  • Fully open source and runs with EC2, Fargate, Multiple Local Zones and Wavelength
  • Supports Kubernetes

Analytics Services

  • Athena: Query data in S3 using SQL.
  • Glue: ETL service for preparing data for analytics.
  • Kinesis: Analyze real-time data streams.
  • Elastic MapReduce (EMR): Process big data with Hadoop
  • QuickSight: Visualize data and create interactive dashboards.

Artificial Intelligence and Machine Learning

  • Rekognition: Automates image and video analysis.
  • Comprehend: Natural language processing service to find relationships in text.
  • Polly: Converts text to speech with natural-sounding voices.
  • SageMaker: Build, train, and deploy machine learning models.
  • Translate: Real-time and batch language translation.
  • Lex: Build conversational interfaces like chatbots.

Developer Tools

  • Cloud9: Web-based IDE for writing and debugging code.
  • CodeCommit: Source control system for private Git repositories.
  • CodeBuild: Build and test application source code.
  • CodeDeploy: Manages code deployment to AWS services.
  • CodePipeline: Automates the software release process.
  • X-Ray: Analyze and debug production applications.
  • CodeStar: Collaborative tool for managing the development pipeline.

Infrastructure as Code (IaC)

  • CloudFormation: Provision AWS resources using templates.
  • Elastic Beanstalk: Deploy web applications and manage resources.
  • OpsWorks: Automate server configuration using Chef or Puppet.

Loose Coupling

  • Simple Queue Service (SQS): Message queuing service for building loosely coupled systems.
  • Simple Notification Service (SNS): Send notifications via email or SMS.
  • Simple Email Service (SES): Send richly formatted HTML emails.

Auditing, Monitoring, and Logging

  • CloudWatch: Monitoring service for cloud resources and applications.
  • CloudTrail: Tracks user activity and API calls for auditing.
  • Amazon WorkSpaces: Virtual desktops in the cloud.
  • Amazon Connect: Cloud-based contact center service.

AWS Core Services Overview

Service Description Use Case Key Features
Amazon EC2 Virtual servers in the cloud Compute instances for applications Scalability, flexible pricing, various instance types
Amazon S3 Scalable object storage service File storage and backup Durability, high availability, lifecycle management
Amazon RDS Managed relational database service SQL database hosting Automated backups, scaling, high availability
Amazon DynamoDB Managed NoSQL database service High-performance, low-latency data storage Fully managed, high throughput, and low latency
AWS Lambda Serverless compute service Running code in response to events No server management, automatic scaling
Amazon VPC Virtual Private Cloud Isolated network setup Customizable network configuration, security
Amazon CloudFront Content delivery network (CDN) Delivering content with low latency Global distribution, edge caching
Amazon IAM Identity and Access Management User and permission management Fine-grained access control, security policies
Amazon CloudWatch Monitoring and observability service Logging, monitoring, and alerts Metrics collection, log management, alarms
AWS CloudFormation Infrastructure as Code Automated resource provisioning Template-based deployment, version control