Data Extraction Procedure

Clinical Innovation team will need to extract data from the system for analysis. See example ticket.

Follow the steps below to perform data extraction.

Step 1: Elevate

You need to access prod environment to extract data. Elevate on this page.

Run az login to refresh access and select the Multitenant Production subscription.

Step 2: Get user data

Get the data CSV from the Linear ticket. The CSV must have name and tenant columns, plus either user_id OR interaction_id column.

Export by interaction ID (specific interactions only):

name,tenant,interaction_id
Benjamin,base,42780d01-51de-45d5-ba83-xxxxxxxx

Export by user ID (all interactions for each user):

name,tenant,user_id
Benjamin,base,d2cc42e4-f74f-4656-8847-xxxxxxxx

Save it locally in a csv file e.g.: data.csv.

Step 3: Run data extraction script

Switch k8s context to Prod cluster (prod-weu or prod-us) and set the namespace:

kubectl config use-context prod-weu
kubectl config set-context --current --namespace=base

Choice of Prod cluster depends on user/tenant, and from which geographic region that they are operating.

Run the data extraction script with the CSV as input:

./scripts/data-export-batch.sh data.csv <zip_file_output_path>

You can also run the single export script directly:

# Export by interaction ID
./scripts/data-export.sh <tenant> <export_dir> --interaction-id <interaction-ID>

# Export by user ID
./scripts/data-export.sh <tenant> <export_dir> --user-id <user-ID>

Step 4: Upload the data to 1Password

Upload the zip file generated in Step 3 to 1Password. Save it in your personal Vault, otherwise it would be shared with all Corti.

Naming convention: [<tenant>] <linear_ticket_ID>

Make it available for 7 days.

Share it with the Clinical Innovation team: Laura, Vanessa and Lasse.

Step 5: Notify the Clinical Innovation team

Add link to the 1Password item in the Linear ticket and notify the Clinical Innovation team.