Version: Next

Configuring Looker & LookML Connector

Now that you have created a DataHub specific API key with the relevant access in the prior step, it's now time to set up a connection via the DataHub UI.

Configure Looker Ingestion

Configure Secrets

Within DataHub, navigate to the Ingestion tab in the top, right corner of your screen

Navigate to the "Ingestion Tab"

note

If you do not see the Ingestion tab, please contact your DataHub admin to grant you the correct permissions

Navigate to the Secrets tab and click Create new secret.

Secrets Tab

Create a client id secret:

Enter a name like LOOKER_CLIENT_ID - we will use this later to refer to the API Key Client ID
Enter the API Key Client ID
Optionally add a description
Click Create

API Key Client ID

Then, create a secret to store the API Key Client Secret:

Enter a name like LOOKER_CLIENT_SECRET - we will use this later to refer to the client secret
Enter the client secret
Optionally add a description
Click Create

API Key client secret

Configure Recipe

Navigate to the Sources tab and click Create new source.

Click "Create new source"

Choose Looker.

Select Looker from the options

Enter details into the Looker Recipe. You need to set minimum 3 field in the recipe:

Base URL: This is your looker instance URL. (For example https://abc.cloud.looker.com)
Client ID: Use the secret LOOKER_CLIENT_ID with the format ${LOOKER_CLIENT_ID}.
Client Secret: Use the secret LOOKER_CLIENT_SECRET with the format ${LOOKER_CLIENT_SECRET}.

Optionally, use the dashboard_pattern and chart_pattern fields to filter for specific dashboard and chart.

config:
     ...
     dashboard_pattern:
        allow:
          - "2"
     chart_pattern:
        allow:
          - "258829b1-82b1-4bdb-b9fb-6722c718bbd3"

Your recipe should look something like this:

Looker Recipe

After completing the recipe, click Next.

Schedule Execution

Now it's time to schedule a recurring ingestion pipeline to regularly extract metadata from your Looker instance.

Decide how regularly you want this ingestion to run-- day, month, year, hour, minute, etc. Select from the dropdown.

schedule selector

Ensure you've configured your correct timezone.

timezone_selector

Finally, click Next when you are done.

Finish Up

Name your ingestion source, then click Save and Run.

Name your ingestion

You will now find your new ingestion source running.

ingestion_running

Validate Ingestion Runs

View the latest status of ingestion runs on the Ingestion page.

ingestion succeeded

Click the plus sign to expand the full list of historical runs and outcomes; click Details to see the outcomes of a specific run.

ingestion_details

From the Ingestion Run Details page, pick View All to see which entities were ingested.

ingestion_details_view_all

Pick an entity from the list to manually validate if it contains the detail you expected.

ingestion_details_view_all

Configuring LookML Connector

Now that you have created a DataHub specific API key and Deploy Key with the relevant access in the prior step, it's now time to set up a connection via the DataHub UI.