A demo web application intended as an educational tool for demonstrating how you can generate subtitles for Live to VOD (DVR) using Amazon IVS, the auto-record-to-s3 feature using Amazon S3, Amazon EventBridge and Amazon Transcribe.
This demo also uses AWS Cloud Development Kit (AWS CDK v2).
The following steps describe how to deploy the solution using the Amazon Cloud Development Kit (CDK). Read more about the CDK here.
$ git clone [email protected]:nathanagez/amazon-ivs-dvr-subtitles-web-demo.git
$ cd amazon-ivs-dvr-subtitles-web-demo
$ npm installInstall the AWS CDK.
$ npm install -g aws-cdk Deploying AWS CDK apps into an AWS environment (a combination of an AWS account and region) may require that you provision resources the AWS CDK needs to perform the deployment. These resources include an Amazon S3 bucket for storing files and IAM roles that grant permissions needed to perform deployments. The process of provisioning these initial resources is called bootstrapping.
$ cdk bootstrap aws://<ACCOUNT-NUMBER-1/REGION-1
$ cdk deploy --parameters email="[email protected]"The following tools need to be installed on your system prior to installing the CDK:
- Node.js >= 14.15.0
- We recommend using a version in Active LTS
- Npm >= 8.0.0
- Docker >= 19.03
- the Docker daemon must also be running
The main state machine starts and waits for the MediaConvert Job to finish, it extracts an MPEG-III (MP3) audio file using the m3u master playlist file from Amazon IVS. When the MediaConvert Job successfully completes, it transitions to the Transcribe Job to generate WebVTT using speech recognition.
{
"StartAt": "Start MediaConvert Job and Wait",
"States": {
"Start MediaConvert Job and Wait": {
"Next": "Start Transcribe Job and Wait",
"Retry": [
{
"ErrorEquals": [
"Lambda.ServiceException",
"Lambda.AWSLambdaException",
"Lambda.SdkClientException"
],
"IntervalSeconds": 2,
"MaxAttempts": 6,
"BackoffRate": 2
}
],
"Type": "Task",
"Resource": "arn:aws:states:::lambda:invoke.waitForTaskToken",
"Parameters": {
"FunctionName": "${MediaConvertLambda}",
"Payload": {
"input.$": "$",
"taskToken.$": "$$.Task.Token"
}
}
},
"Start Transcribe Job and Wait": {
"Next": "Publish to SNS",
"Retry": [
{
"ErrorEquals": [
"Lambda.ServiceException",
"Lambda.AWSLambdaException",
"Lambda.SdkClientException"
],
"IntervalSeconds": 2,
"MaxAttempts": 6,
"BackoffRate": 2
}
],
"Type": "Task",
"ResultSelector": {
"mediaConvert.$": "$.mediaConvert",
"transcribe.$": "$.transcribe",
"hls.$": "$.hls",
"srt.$": "$.srt",
"vtt.$": "$.vtt"
},
"Resource": "arn:aws:states:::lambda:invoke.waitForTaskToken",
"Parameters": {
"FunctionName": "${TranscribeLambda}",
"Payload": {
"input.$": "$",
"taskToken.$": "$$.Task.Token"
}
}
},
"Publish to SNS": {
"End": true,
"Type": "Task",
"Resource": "arn:aws:states:::sns:publish",
"Parameters": {
"TopicArn": "${SnsTopic}",
"Message": {
"hls.$": "$.hls",
"srt.$": "$.srt",
"vtt.$": "$.vtt"
}
}
}
}
}{
"version": "0",
"id": "a4c2eacb-eaa1-fbf2-030e-6fba889e54d3",
"detail-type": "IVS Recording State Change",
"source": "aws.ivs",
"account": "000000000000",
"time": "2022-08-16T10:56:01Z",
"region": "us-west-2",
"resources": [
"arn:aws:ivs:us-west-2:000000000000:channel/nc4Pffppp3333"
],
"detail": {
"recording_status": "Recording End",
"recording_status_reason": "",
"recording_s3_bucket_name": "storage-bucket",
"recording_s3_key_prefix": "ivs/v1/000000000000/nc4Pffppp3333/2022/8/16/10/55/xxxxxx",
"recording_duration_ms": 28435,
"channel_name": "my-demo-channel",
"stream_id": "st-XXXXXX"
}
}SNS is used to send notifications when the subtitle generation is finished.
You can test generated subtitles with this webapp here: https://nathanagez.github.io/amazon-ivs-dvr-subtitles-web-demo/
It uses React and VideoJS to read the HLS stream and parse the vtt file to display time-triggered text to the end-user.
Sources are available under /demo-website directory.
If you face an Access Denied error from public.erc.aws related to Docker run the following:
docker logout public.ecr.aws