Getting started
This guide is for the administrator or platform team who sets up Cloud Certainty SQLark. You subscribe on AWS Marketplace, launch one CloudFormation stack in your own AWS account, sign in, run your first query, connect your other accounts and give your team access. The installation guide has every detail; this page is the short path.
What you need
- The AWS account that will run SQLark (the hub). Subscribe from this account: AWS Marketplace delivers the licence to it through AWS License Manager.
- A supported Region: any Region with Amazon Athena, AWS Glue, AWS Lambda, Amazon API Gateway, Amazon DynamoDB, Amplify Hosting, Amazon Cognito, AWS License Manager and Amazon ECS on Fargate. The Region of the stack doesn't limit which Regions you can query.
- Permission to create the stack's resources, including IAM roles with custom names.
- A VPC with at least one subnet that has outbound HTTPS access, for example through a NAT gateway. Only a one-off installer task runs there, for about a minute at install and at each upgrade.
- The email address of your first administrator.
- Tables in the AWS Glue Data Catalog that Athena can query, and the names of the S3 buckets they read (optional: by default SQLark may read every bucket your policies allow).
1. Subscribe on AWS Marketplace
SQLark is sold on AWS Marketplace with contract pricing, monthly or for 12 months. There are four plans: Starter, Team, Business and Enterprise. On the SQLark listing, Team is the base plan and Business and Enterprise are add-ons: for Business choose Team and the Business add-on; for Enterprise choose all three. An add-on bought on its own grants nothing. Starter is a separate listing, SQLark Starter. See the FAQ for what each plan includes.
- Sign in to the AWS console with the account that will run SQLark, as an identity that may subscribe to AWS Marketplace products.
- Open SQLark on AWS Marketplace (opens in a new tab), choose Continue to Subscribe, choose the plan and the contract length, and accept the offer.
- Choose Continue to Configuration, select the fulfilment option and the Region, and continue to the Launch page. Its usage instructions have a link that opens CloudFormation with the release's template already selected.
2. Launch the stack
Open the launch link from the usage instructions, or this quick-create link with the release version filled in:
https://console.aws.amazon.com/cloudformation/home#/stacks/quickcreate?templateURL=https://cloudcertainty-sqlark-us-east-1.s3.us-east-1.amazonaws.com/pro/<version>/main.yaml&stackName=sqlarkCheck the Region in the console's top bar, then set these parameters (everything else can keep its default):
| Parameter | Value |
|---|---|
VpcId, InstallerSubnetIds | Your VPC and one or more of its subnets with outbound HTTPS access. Set InstallerSubnetsArePublic to true only for subnets that route to an internet gateway. |
BootstrapAdminEmail | Your first administrator. |
IdentityProvider | CognitoOnly is the quickest start. IAMIdentityCenter works on every plan; SAML and OIDC need the Team plan or above. See Identity providers. |
LocalAccessLevel | What SQLark may do in this account: Query (the default: browse the catalogue and run read-only queries) or Full (adds CREATE TABLE AS, INSERT, ALTER, DROP and the like). |
LocalRegions | The Regions to query in this account, for example eu-west-1,us-east-1. Empty means the stack's Region only. |
DataBucketNames | The buckets your tables read, for example sales-lake,clickstream-raw. The default * allows every bucket your bucket policies allow. |
CreateWorkgroup | Keep Enabled for a SQLark workgroup with its own encrypted results bucket, results kept 30 days and a 1 TB limit per query (BytesScannedCutoffPerQuery). |
Acknowledge that AWS CloudFormation might create IAM resources with custom names and create the stack. Creation takes about 10 minutes. The template URL is always in the vendor's public bucket in us-east-1, and the same URL works in every Region:
https://cloudcertainty-sqlark-us-east-1.s3.us-east-1.amazonaws.com/pro/<version>/main.yamlThe installation guide has the AWS CLI command.
3. Sign in
CognitoOnly: the bootstrap administrator receives an email with a temporary password. Every user must register an authenticator app (TOTP MFA is required).IAMIdentityCenterorSAML: create a SAML application in your identity provider with theSamlAcsUrlandSamlAudienceUristack outputs, assign yourself to it, then update the stack and setSamlMetadataUrlto the application's metadata URL. Until then nobody can sign in.OIDC: set the OIDC parameters when you create the stack; there is no second step.
Open the PortalUrl stack output and sign in as the bootstrap administrator. That account is
always an administrator. Grant the Administrator role to a second person or group under
Administration › Roles so you are never locked out.
4. Run your first query
The workspace opens with a query tab. Pick the local connection (the hub account), a Region,
the sqlark workgroup and a database; the schema browser on the left shows its tables and columns,
and the editor completes them as you type. Press Ctrl+Enter (Cmd+Enter on a Mac) to run.
SQLark shows the status, the data scanned, the time taken and the estimated cost, then the rows.
From there you can chart the result, save the query or add it to a dashboard. The
user guide explains every page.
5. Add another AWS account
Each other account gets a small role that only your SQLark stack can assume, with an external ID you choose, and optionally a SQLark workgroup.
- In the other account, deploy the spoke role template. Its URL is the hub's
SpokeTemplateUrloutput. SetTrustedPrincipalto the hub'sSpokeTrustedPrincipaloutput, choose anExternalIdof at least 16 characters, anAccessLevel(Queryby default) and, if you like, narrowDataBucketNames. - In SQLark, open Administration › Connections › Add connection. Enter an id, a name, the
account ID, the same access level, the spoke stack's
RoleArnoutput, the same external ID and the Regions. - Choose Test. SQLark assumes the role and lists the workgroups and databases in each Region.
For an AWS Organization, deploy the role to every account at once with a StackSet. See Deploy the spoke role in other accounts.
6. Give your team access
- Give people a way to sign in. With an identity provider, assign users or groups to the
SQLark application there. With
CognitoOnly, create users in the Cognito user pool and mark their email as verified. - Grant access. A new user sees no workgroups or databases until a grant applies to them. In
Administration › Grants, give a user or a group permissions (
browse,query,download,ddl) on workgroup and database patterns, for example "theanalystsgroup may querysales_*in the workgroupanalysts", on one connection or all, in some Regions or all. See the admin guide. - Send them the
PortalUrland the user guide.
Next steps
- Admin guide: roles, connections, grants, settings, usage, the audit log and your plan.
- Security overview: for your security review.
- Upgrading: installing new releases.
Something unclear or missing? Email [email protected].