Skip to content

Run your first job

A short tutorial. You'll save a table-free query, reference it from a job, run the job, and inspect the result. You do not need to load data first.

For scheduling, versioning, and debugging, see the Jobs section.

Prerequisites

  • A cluster whose Readiness is Ready. See Quickstart.
  • The default Glue catalog created with your network.

1. Save a query

  1. Open Queries in the sidebar and click Create Query.

  2. Enter a Name, e.g. hello-lakesail.

  3. Pick the network's default Glue catalog.

  4. Paste:

    sql
    SELECT 'LakeSail is ready' AS status;
  5. Click Save.

You now have a named SQL statement you can reference from jobs. For more on queries (sharing, tags, editing), see Queries.

2. Create a job that runs the query

  1. Open Jobs in the sidebar and click Create Job.
  2. Enter a Name (e.g. hello-lakesail) and pick a Team.
  3. Choose SQL as the job type.
  4. For the source, pick Saved query and select hello-lakesail from step 1.
  5. Under Compute profile, select an existing profile or click New profile. For a new profile:
    • Enter a name, e.g. first-job.
    • Select your cluster.
    • Keep Standalone execution mode, select a driver instance type, and keep the default EBS settings.
    • Click Create compute profile and select it for the job.
  6. Click Save.

The job now references your query. If you edit the SQL later, the next run picks up the change automatically without a job redeploy.

3. Run it

From the job's detail page, click Run Job. A new job run moves through the run lifecycle and ends at Succeeded.

4. Inspect the result

Click into the run to see its timeline, status, job version, timing, and output. Click Browse results to open the query result.

Next

Can't find the answer here? Email us: support@lakesail.com