Amazon S3 migration guide

Planning to migrate api.video from Amazon S3? We got you covered!

There are two methods at your disposal that you can use to migrate all of your video content from S3 to api.video.

Migrate with api.video Import tool
Migrate using your own script

What's the cost?

We understand that when you want to move to a different provider, it takes effort and development resources. You also want to make sure that it is cost-efficient, especially if you are moving to api.video to save costs.

api.video gives you the ability to migrate for free and avoid paying anything for encoding!

api.video Import tool

With api.video, you can use our in-house import tool to migrate all of your videos in a short time from the popular hosting and video provider.

The tool only requires you to authenticate with the provider you are migrating from.

Check out the Import tool now.

How to get the AWS Access Key and Account Secret

To access AWS, you will need to sign up for an AWS account.

Access keys consist of an access key ID and secret access key, which are used to sign programmatic requests that you make to AWS. If you don't have access keys, you can create them by using the IAM console.

We recommend that you use IAM access keys instead of AWS root account access keys. IAM lets you securely control access to AWS services and resources in your AWS account.

To create access keys, you must have permission to perform the required IAM actions. For more information, see Granting IAM User Permission to Manage Password Policy and Credentials in the IAM User Guide.

To get your access key ID and secret access key:

Open the IAM console.
On the navigation menu, choose Users.
Choose your IAM user name (not the check box).
Open the Security credentials tab, and then choose Create access key.
To see the new access key, choose Show. Your credentials resemble the following:


Access key ID: AKIAIOSFODNN7EXAMPLE

Secret access key: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY

To download the key pair, choose Download .csv file. Store the .csv file with keys in a secure location.

Keep the keys confidential to protect your AWS account, and never email them. Do not share them outside your organization, even if an inquiry appears to come from AWS or Amazon.com. No one who legitimately represents Amazon will ever ask you for your secret key.

You can retrieve the secret access key only when you initially create the key pair. Like a password, you can't retrieve it later. If you lose it, you must create a new key pair.

Importing the videos

Once you have all the credentials, you can proceed with the migration.

Navigate to the api.video Import tool.
Select Amazon S3 from the list.
Next, click on Sign in to Amazon S3 and fill in the AWS Access Key and AWS Secret Key you got from Amazon S3.
Select the S3 bucket you would like to import.
Now you can proceed with the import.

The process will show you the status of each video and the encoding status.

Importing with a script

Another way to import your videos is to use your own script and leverage one of the api.video client libraries with the provider's client libraries or API (if there are any).

Setting up

What you'll need to run the script:

api.video API key
AWS credentials
Node.js

Getting the api.video API key

In order to get your API key. Navigate to the api.video dashboard (if you are not already signed up, sign up with api.video) and continue to copy your API key from the Overview page or the API Keys page

What the script will do?

The below script is designed to run through all of the files in a specific S3 bucket, generate a signed URL, and pass it on to api.video as the source. api.video will then take the URL and ingest the video directly from S3.

Make sure that the script is modified according to your needs.

Preparation

If you are new to Node.js, here's how you can run this script.

Make sure that you have Node.js installed, if it doesn't exist on your machine, you can install it by following this guide.

Now that you have Node.js installed, we will have to create the path of the script and install the dependencies.

Create the folder for the script:
```
$ mkdir s3-apivideo-migration
```
Navigate to the folder
```
$ cd s3-apivideo-migration
```
Initialize npm in order to create the package.json file for the module dependacies
```
$ npm init
```

Install the modules that we will need to run

$ npm install @aws-sdk/client-s3 --save
$ npm install @aws-sdk/s3-request-presigner --save
$ npm install @api.video/nodejs-client --save

Now create an index file that you would like the script to exist in:
```
$ touch index.js
```

Copy over the below script and replace the following parameters with your own: videBucket, region, accessKeyId, secrectAccessKey, apivideoCreds

import { S3Client, ListObjectsV2Command, GetObjectCommand, S3 } from "@aws-sdk/client-s3";
import { getSignedUrl } from "@aws-sdk/s3-request-presigner";
import  ApiVideoClient from '@api.video/nodejs-client';

// your S3 bucket name
const videoBucket = "videos-cold-storage-api-video";
// your S3 bucket region
const region = 'eu-north-1';
// your S3 credentails
const s3creds = {
    accessKeyId: 'XXXXXX', 
    secretAccessKey: 'XXXXXXX',
    }
// api.video api key
const apivideoCreds = 'XXXXXXX';


const apivideoClient = new ApiVideoClient({ apiKey: apivideoCreds });

const client = new S3Client({ region, 
credentials: s3creds
});

new S3({ region, 
    credentials: s3creds
});

const bucketName = { 
    Bucket: videoBucket, 
  };
const listBucketObjectsCommand = new ListObjectsV2Command(bucketName);

try { 
    const listObjects = await client.send(listBucketObjectsCommand);
    if (listObjects?.$metadata?.httpStatusCode === 200 && listObjects?.Contents.length > 0) {
        for (let i in listObjects.Contents) {
            const objectKey = listObjects.Contents[i].Key;
            bucketName.Key = objectKey;
            const objectDetailsCommand = new GetObjectCommand(bucketName);
            const objectDetails = await client.send(objectDetailsCommand);
            if(/video/.test(objectDetails.ContentType)) {
                const signedUrl = await getSignedUrl(client, objectDetailsCommand, { expiresIn: 3600 });
                const videoCreationPayload = {
                    title: objectKey,
                    source: signedUrl
                };
                await apivideoClient.videos.create(videoCreationPayload);
                console.log("upload complete")
            }
        } 
    }
} catch (e) {
    console.error(e);
}

Save the file and run the script by:
```
$ node index.js
```