Skip to main content

Version 1.0.0 - ami-0166bfe4e72e26222

# Database Stack AMI

**MongoDB + InfluxDB + MySQL** - A plug-and-play multi-database stack for AWS EC2 with persistent EBS storage.

## Overview

This AMI provides a production-ready database stack with three popular databases:

| Database | Version | Port | Use Case |
|----------|---------|------|----------|
| **MongoDB** | 7.x | 27017 | Document/NoSQL database |
| **InfluxDB** | 2.x | 8086 | Time-series database |
| **MySQL** | 8.x | 3306 | Relational database |

All databases share a single EBS volume for persistent storage, making it easy to backup, snapshot, and manage your data.

## Requirements

### Instance Sizing

| Workload | Instance Type | vCPU | RAM | Notes |
|----------|--------------|------|-----|-------|
| Development | t3.small | 2 | 2 GB | Light testing |
| Small Production | t3.medium | 2 | 4 GB | Recommended minimum |
| Medium Production | t3.large | 2 | 8 GB | Better performance |
| Large Production | t3.xlarge+ | 4+ | 16+ GB | Heavy workloads |

### Storage

- **Minimum EBS**: 20 GB (gp3)
- **Recommended**: 50-100 GB+ depending on data volume
- **Type**: gp3 for best price/performance

### Network (Security Group)

| Port | Protocol | Source | Description |
|------|----------|--------|-------------|
| 22 | TCP | Your IP | SSH access |
| 27017 | TCP | Your App/VPC | MongoDB |
| 8086 | TCP | Your App/VPC | InfluxDB |
| 3306 | TCP | Your App/VPC | MySQL |

⚠️ **Security Note**: Never expose database ports (27017, 8086, 3306) to 0.0.0.0/0 in production!

## Building the AMI

### 1. Launch Base Instance

```bash
# Launch Ubuntu 24.04 instance (t3.medium recommended)
# Attach a secondary EBS volume for testing
```

### 2. Upload Scripts

```bash
# From your local machine
scp -i your-key.pem setup-dbstack.sh configure-dbstack.sh cleanup-for-ami.sh \
    first-boot.sh dbstack-firstboot.service dbstack-cli \
    ubuntu@<instance-ip>:/tmp/
```

### 3. Run Setup

```bash
# On the instance
sudo bash /tmp/setup-dbstack.sh
```

### 4. Test Configuration (Optional)

```bash
# Attach an EBS volume first, then:
sudo /opt/dbstack/configure-dbstack.sh

# Verify everything works
dbstack-cli status

# Test connections
docker exec dbstack-mongodb mongosh --eval "db.runCommand({ ping: 1 })"
docker exec dbstack-mysql mysql -u root -p -e "SELECT VERSION();"
```

### 5. Clean Up for AMI

```bash
sudo /opt/dbstack/cleanup-for-ami.sh
```

### 6. Create AMI

1. Stop the instance (do not terminate)
2. AWS Console → EC2 → Instances → Select instance
3. Actions → Image and templates → Create image
4. Name: `dbstack-mongodb-influxdb-mysql-v1.0`
5. Wait for AMI to be available

## Customer Usage

### Option 1: Interactive Setup

1. **Launch Instance** from the AMI
2. **Attach EBS Volume** (20 GB+ recommended)
3. **SSH and Configure**:

```bash
sudo /opt/dbstack/configure-dbstack.sh
```

4. Follow the prompts to set passwords and configure databases

### Option 2: Automated Setup (User-Data)

Launch with this JSON user-data for fully automated configuration:

```json
{
  "mongodb": {
    "root_user": "admin",
    "root_password": "YourSecurePassword123!",
    "database": "myapp",
    "app_user": "appuser",
    "app_password": "AppUserPassword456!"
  },
  "influxdb": {
    "org": "mycompany",
    "bucket": "metrics",
    "user": "admin",
    "password": "InfluxPassword789!"
  },
  "mysql": {
    "root_password": "MySQLRootPass321!",
    "database": "myapp",
    "user": "appuser",
    "password": "MySQLUserPass654!"
  },
  "host": "your-domain.com"
}
```

**Note**: All password fields are required. The `host` field is optional (defaults to public IP).

### CloudFormation Template

```yaml
AWSTemplateFormatVersion: '2010-09-09'
Description: Database Stack Deployment

Parameters:
  InstanceType:
    Type: String
    Default: t3.medium
  KeyName:
    Type: AWS::EC2::KeyPair::KeyName
  VolumeSize:
    Type: Number
    Default: 50
  MongoRootPassword:
    Type: String
    NoEcho: true
  MongoAppPassword:
    Type: String
    NoEcho: true
  InfluxPassword:
    Type: String
    NoEcho: true
  MySQLRootPassword:
    Type: String
    NoEcho: true
  MySQLAppPassword:
    Type: String
    NoEcho: true

Resources:
  DBStackInstance:
    Type: AWS::EC2::Instance
    Properties:
      ImageId: ami-xxxxxxxxx  # Your AMI ID
      InstanceType: !Ref InstanceType
      KeyName: !Ref KeyName
      SecurityGroups:
        - !Ref DBStackSecurityGroup
      UserData:
        Fn::Base64: !Sub |
          {
            "mongodb": {
              "root_user": "admin",
              "root_password": "${MongoRootPassword}",
              "database": "myapp",
              "app_user": "appuser",
              "app_password": "${MongoAppPassword}"
            },
            "influxdb": {
              "org": "myorg",
              "bucket": "metrics",
              "user": "admin",
              "password": "${InfluxPassword}"
            },
            "mysql": {
              "root_password": "${MySQLRootPassword}",
              "database": "myapp",
              "user": "appuser",
              "password": "${MySQLAppPassword}"
            }
          }

  DataVolume:
    Type: AWS::EC2::Volume
    Properties:
      AvailabilityZone: !GetAtt DBStackInstance.AvailabilityZone
      Size: !Ref VolumeSize
      VolumeType: gp3
      Tags:
        - Key: Name
          Value: dbstack-data

  DataVolumeAttachment:
    Type: AWS::EC2::VolumeAttachment
    Properties:
      Device: /dev/xvdf
      InstanceId: !Ref DBStackInstance
      VolumeId: !Ref DataVolume

  DBStackSecurityGroup:
    Type: AWS::EC2::SecurityGroup
    Properties:
      GroupDescription: Database Stack Security Group
      SecurityGroupIngress:
        - IpProtocol: tcp
          FromPort: 22
          ToPort: 22
          CidrIp: 0.0.0.0/0
        - IpProtocol: tcp
          FromPort: 27017
          ToPort: 27017
          CidrIp: 10.0.0.0/8  # VPC only
        - IpProtocol: tcp
          FromPort: 8086
          ToPort: 8086
          CidrIp: 10.0.0.0/8
        - IpProtocol: tcp
          FromPort: 3306
          ToPort: 3306
          CidrIp: 10.0.0.0/8

Outputs:
  InstanceIP:
    Value: !GetAtt DBStackInstance.PublicIp
  MongoDBURI:
    Value: !Sub mongodb://${DBStackInstance.PublicIp}:27017
  InfluxDBURL:
    Value: !Sub http://${DBStackInstance.PublicIp}:8086
  MySQLHost:
    Value: !Sub ${DBStackInstance.PublicIp}:3306
```

## Management Commands

```bash
# Service management
dbstack-cli status          # Show status of all databases
dbstack-cli start           # Start all services
dbstack-cli stop            # Stop all services
dbstack-cli restart         # Restart all services

# Logs
dbstack-cli logs            # All container logs
dbstack-cli logs mongodb    # MongoDB logs only
dbstack-cli logs influxdb   # InfluxDB logs only
dbstack-cli logs mysql      # MySQL logs only

# Configuration
dbstack-cli info            # Show configuration info
sudo dbstack-cli credentials # Show passwords and connection strings

# Maintenance
dbstack-cli update          # Pull latest images and restart
sudo dbstack-cli backup     # Backup all databases
sudo dbstack-cli restore    # Restore from backup

# Database shells
dbstack-cli mongo-shell     # MongoDB shell
dbstack-cli mysql-shell     # MySQL shell
dbstack-cli influx-shell    # InfluxDB CLI
```

## Connection Examples

### MongoDB

```python
# Python (pymongo)
from pymongo import MongoClient

# Using root credentials
client = MongoClient("mongodb://admin:password@your-ip:27017")

# Using app credentials
client = MongoClient("mongodb://appuser:password@your-ip:27017/mydb")
db = client.mydb
```

```javascript
// Node.js
const { MongoClient } = require('mongodb');
const client = new MongoClient('mongodb://appuser:password@your-ip:27017/mydb');
```

### InfluxDB

```python
# Python (influxdb-client)
from influxdb_client import InfluxDBClient

client = InfluxDBClient(
    url="http://your-ip:8086",
    token="your-api-token",
    org="myorg"
)
```

```bash
# CLI
influx write -b mybucket -o myorg -t your-token \
  'temperature,location=office value=72.5'
```

### MySQL

```python
# Python (mysql-connector)
import mysql.connector

conn = mysql.connector.connect(
    host="your-ip",
    port=3306,
    user="appuser",
    password="password",
    database="mydb"
)
```

```bash
# CLI
mysql -h your-ip -P 3306 -u appuser -p mydb
```

## Backup & Recovery

### Manual Backup

```bash
# Create backup of all databases
sudo dbstack-cli backup

# Backups stored in: /mnt/dbstack-data/backups/
```

### EBS Snapshots (Recommended)

For production, use EBS snapshots for point-in-time recovery:

```bash
# Stop services before snapshot for consistency
dbstack-cli stop

# Create snapshot via AWS Console or CLI
aws ec2 create-snapshot --volume-id vol-xxxxx --description "dbstack-backup-$(date +%Y%m%d)"

# Start services
dbstack-cli start
```

### Restore from Backup

```bash
sudo dbstack-cli restore
# Follow prompts to select backup timestamp
```

## Architecture

```
┌─────────────────────────────────────────────────────┐
│                    EC2 Instance                      │
│  ┌─────────────────────────────────────────────────┐ │
│  │                  Docker Network                  │ │
│  │  ┌───────────┐ ┌───────────┐ ┌───────────────┐  │ │
│  │  │  MongoDB  │ │ InfluxDB  │ │     MySQL     │  │ │
│  │  │   :27017  │ │   :8086   │ │     :3306     │  │ │
│  │  └─────┬─────┘ └─────┬─────┘ └───────┬───────┘  │ │
│  └────────┼─────────────┼───────────────┼──────────┘ │
│           │             │               │            │
│           └─────────────┼───────────────┘            │
│                         │                            │
│  ┌──────────────────────┼──────────────────────────┐ │
│  │     /mnt/dbstack-data (EBS Volume)              │ │
│  │  ┌─────────┐ ┌─────────────┐ ┌─────────────┐    │ │
│  │  │ mongodb │ │  influxdb   │ │    mysql    │    │ │
│  │  └─────────┘ └─────────────┘ └─────────────┘    │ │
│  └─────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────┘
```

## Troubleshooting

### Service Won't Start

```bash
# Check Docker status
systemctl status docker

# Check container logs
docker logs dbstack-mongodb
docker logs dbstack-influxdb
docker logs dbstack-mysql

# Check EBS mount
df -h /mnt/dbstack-data
```

### Connection Refused

1. Check security group allows the port
2. Verify UFW rules: `sudo ufw status`
3. Check service is running: `dbstack-cli status`

### Out of Disk Space

```bash
# Check disk usage
dbstack-cli status

# Extend EBS volume in AWS Console, then:
sudo growpart /dev/xvdf 1
sudo resize2fs /dev/xvdf
```

### Reset Everything

```bash
# Complete reset (DESTROYS ALL DATA)
sudo /opt/dbstack/cleanup-for-ami.sh
# Then reconfigure:
sudo /opt/dbstack/configure-dbstack.sh
```

## Security Recommendations

1. **Use VPC**: Keep databases in private subnet
2. **Security Groups**: Restrict ports to application servers only
3. **Strong Passwords**: Use 16+ character passwords
4. **Enable Encryption**: Use encrypted EBS volumes
5. **Regular Backups**: Automate EBS snapshots
6. **Update Regularly**: `dbstack-cli update` for security patches

## Support

- **Logs**: `/var/log/dbstack-firstboot.log`
- **Credentials**: `sudo cat /opt/dbstack/.credentials`
- **Configuration**: `/opt/dbstack/config-info.txt`

## Version History

- **1.0.0**: Initial release with MongoDB 7, InfluxDB 2, MySQL 8

---

**Built for AWS Marketplace** | Ubuntu 24.04 | Docker-based