Skip to content

Quickstart

Get from a new account to a successful job in your own AWS infrastructure. This guide has five stages:

  1. Finish signup
  2. Connect your AWS account
  3. Create a network
  4. Provision a cluster
  5. Run your first job

Budget 10 to 15 minutes of hands-on setup, plus 15 to 25 minutes of background provisioning in AWS.

Before you begin

You'll need:

  • An AWS account where you can deploy a CloudFormation stack (i.e. permission to create IAM roles).
  • The AWS region you want to run workloads in.

1. Finish signup

Signup has three required steps, shown as a progress indicator at the top of the page. MFA appears as a fourth step when your organization requires it.

  1. Set up your organization. Enter a workspace name. This becomes your LakeSail organization. You can add teammates later.
  2. Create your account. Fill in your email, password, and name.
  3. Verify your email. LakeSail sends a verification link to the address you entered. Click the link to confirm.
  4. (Optional) Set up 2FA. If your organization requires two-factor authentication, scan the QR code with an authenticator app and enter the 6-digit code. See MFA for enrollment and recovery details.

Once verified, you land in the LakeSail console and can connect infrastructure.

2. Connect your AWS account

LakeSail provisions clusters inside your own AWS account using a cross-account IAM role deployed via CloudFormation. LakeSail does not store long-lived AWS access keys. It stores the role ARN, assumes the role on demand, and uses temporary credentials issued by AWS. Before approving the connection, your security team can review what the role grants, and what LakeSail can and cannot do, in Security & IAM. For the standalone connection guide, see Connect an AWS account.

  1. In the sidebar, open Settings → Cloud Accounts.
  2. Click Add Account. The Add AWS Account modal opens.
  3. Click Create Stack on AWS and sign in to the target AWS account if prompted.
  4. In AWS CloudFormation, review and create the pre-filled stack.
  5. Wait for CloudFormation to finish creating the stack. LakeSail verifies the connection automatically; you can close the modal while CloudFormation runs and return later.
  6. When the modal reports AWS account connected, optionally enter an Account alias.
  7. Click Save & Setup Network to continue straight to the next step.

Prefer to deploy manually?

After clicking Create Stack on AWS, return to the LakeSail modal, expand Advanced, and click Download Template. Apply it through the AWS Console, CLI, or an IaC tool. When CloudFormation finishes creating the stack, paste its role ARN into IAM Role ARN and click Verify Manually.

3. Create a network

A network is a VPC that LakeSail provisions in your connected AWS account. Clusters run inside this VPC.

  1. Open Settings → Cloud Networks (or continue from step 2's Save & Setup Network).
  2. Click Add Network.
  3. Fill in:
    • Name, e.g. production-network.
    • Cloud Account: the one you connected in step 2.
    • Region: where the VPC should live.
    • IPv4 CIDR Range, e.g. 10.0.0.0/16. Must not overlap the LakeSail platform VPC CIDR or any VPC you intend to peer with.
  4. Click Create Network. The network moves through Pending → Provisioning → Deployed as LakeSail deploys the VPC, subnets, and security groups (typically a few minutes).

LakeSail also creates the network's workspace bucket and begins provisioning its default AWS Glue catalog.

When provisioning completes, click Create Cluster to continue.

4. Provision a cluster

With an account and network in place, you can create your first cluster.

  1. Open Compute → Clusters.
  2. Click Create Cluster. The Create External Cluster modal opens.
  3. Fill in:
    • Network: the one you just created. The cluster inherits its cloud account and region.
    • Cluster Name, e.g. my-first-cluster.
    • Cluster tier: select a tier using the guidance in the picker. The details show its management-node configuration and estimated baseline AWS cost.
    • Allowed IPs List: leave empty for private-only access. You can add CIDRs later if you need to reach the cluster endpoint from outside the VPC.
    • Collect container metrics: leave off unless you need per-pod and per-container metrics in AWS. Container logs are collected either way.
  4. Click Create Cluster.

LakeSail walks through the provisioning stages (preparing, deploying to AWS, and waiting for system readiness) with a live progress bar. Provisioning typically takes 15 to 25 minutes, and the progress bar may remain on a single stage for an extended period. When you see Cluster Ready, the cluster can run workloads.

Compute vs. management nodes

The cluster tier configures management (system) nodes only. Compute nodes for jobs, sessions, and notebooks are selected per-workload, so you don't need to over-provision here. Use Advanced configuration only when you need to set the management instance type, node counts, and disk size yourself.

5. Run your first job

Your cluster is ready for work. Follow Run your first job to create a compute profile, save a table-free query, and run it. You do not need to load data first.

Next steps

Each network includes a default Glue catalog. To query your own tables, connect their catalog. If the S3 files are outside the network workspace bucket, make the data available to LakeSail. Then choose how you want to run work:

When you are ready to collaborate, invite teammates to your organization.

Before the trial ends, set up billing through Stripe or AWS Marketplace to keep workloads running.

API reference

The infrastructure and workload steps are also available through the API:

Can't find the answer here? Email us: support@lakesail.com