Remote Subscriber Database (RSD) AWS hosting setup guide

From Discovery Data Service
Revision as of 15:23, 8 June 2020 by JoC (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

This deployment guide covers some suggested initial installation steps if you want to run a Discovery remote subscriber database in a new Amazon Web Services account.

The installation is simplified using cloudformation (cfn) scripts that create the AWS resources on your behalf.

The following manual steps are required before and after the scripts are run:

Prerequisites

Amazon Web Services

You will require an Amazon Web Services account to run the infrastructure, If you do not already have an AWS account then you can Sign up for an AWS account here.

Please supply your AWS account number to the Discovery team prior to running the installation. The account number can be found in the AWS console here.

Create a Key Pair

  1. Open the Amazon EC2 console at https://console.aws.amazon.com/ec2/.
  2. In the navigation pane, select Key Pairs.
  3. Select Create key pair.
  4. In Name, type a descriptive name for the key pair.
  5. In File format, select the required save format for the private key. Tip: To save the private key in a format that can be used with OpenSSH, select pem; to save the private key in a format that can be used with PuTTY, select ppk.
  6. Select Create key pair.
    Note: The private key is downloaded in your browser and must be kept safe; this is required to connect to the EC2 instances. Alternatively an existing key pair can be used.

AWS Cloudformation Installation - Network Stack

Note: The following subnets are hardcoded into the cfn script by default. You might need to change these according to your hosting requirements; the ACLs within the cfn script will also need updating.
VPC:

CIDR: "192.168.132.0/22"

Public0:

CIDR: "192.168.132.0/24"

Public1:

CIDR: "192.168.133.0/24"

Private0:

CIDR: "192.168.134.0/24"

Private1:

CIDR: "192.168.135.0/24"

Instructions

  1. In the AWS console, select the Europe (London) eu-west-2 region.
    AWS select region
  2. Navigate to CloudFormation by searching in the services drop-down menu.
  3. Click Create stack and then select With new resources (standard).
    RTENOTITLE
  4. Specify the template:
    1. Select Upload a template file.
    2. Click Choose file.
    3. Browse to the location of the saved network-stack.yaml file.
    4. Click Next.
  5. Specify stack details: type a stack name and VPC name.
    Specify stack details
  6. Configure stack options: leave the default option and then click Next.
  7. Review the selected options and then click Create stack.
    Once the network stack is created (2-3 mins) you can see the resource CloudFormation has created in the Resources tab.
  8. Navigate theServices - VPC to see the resources such as subnets, route tables and ACLs.
    Services - VPC

AWS Cloudformation Installation - VPC Endpoint (PrivateLink)

Prerequisites

Note: Before you run this cfn script, you need to create a security group that will be applied to the filer instance. You then select the security group from a drop-down list when running this cfn script. This will allow the filer instance to access the sftp server via the PrivateLink.
Your AWS account number will need to be whitelisted by Discovery before running the cfn script.

Instructions

  1. In the AWS console select the Europe (London) eu-west-2 region.
  2. In the drop down menu, navigate to CloudFormation.
  3. Click Create stack and then select With new resources (standard)
    RTENOTITLE
  4. Specify the template:
    1. Select Upload a template file.
    2. Click Choose file.
    3. Browse to the location of the saved endpoint-stack.yaml file.
    4. Click Next.
  5. Specify stack details: type a stack name and VPC name.
    Specify private stack details
  6. Configure stack options: leave the default option and then click Next.
  7. Review the selected options and then click Create stack.
    Once the PrivateLink stack is created (2-3 mins) you can see the resource CloudFormation has created in the Resources tab.
    Private link stack
  8. Click the links to view the resources:
  • Security groups
    Security group
  • PrivateLink
    Note: The pending acceptance status will remain until the request has been approved in the Discovery AWS account.
    PrivateLink