Data Connectors Setup Guide

Connect Scoop to your data sources, manage ingestion, and blend datasets

Data Connectors & Setup

Purpose: Connect Scoop to your data sources, manage data ingestion, and blend multiple datasets. Audience: Admins, Data Analysts


1. Connecting External Data Sources

Scoop integrates with a wide range of business applications and databases.

Workflow: Connect a New Source

  1. Open the New Dataset Modal: Look for an "Add Data" or "Connect Source" option.
  2. Choose Your Source: Select from the list of supported connectors.
    • Popular Connectors: Salesforce, Google Sheets, HubSpot, Pipedrive, Attio, Google Analytics, Google Ads, Amplitude, LinkedIn, QuickBooks, Jira, TikTok, Meta Ads.
    • Note: Some connectors may be disabled if they are under development.
  3. Follow On-Screen Prompts: Each connector has a specific authentication and configuration flow.
    • This typically involves granting Scoop access to your account (e.g., OAuth flow).
    • You might be asked to select specific reports, tables, or data ranges to import.

General Configuration (for most sources)

  • Snapshot Default: Some sources (like Google Sheets) are snapshotted by default, meaning Scoop captures a point-in-time view.
  • Transactional vs. Snapshot: You might need to specify if the data is a continuous stream of transactions or a periodic snapshot.

2. Email Forwarding for Data Ingestion

Automate data loading by forwarding reports to Scoop.

Workflow: Set Up Email Ingestion

  1. Generate Email Address: Scoop will provide you with a unique email address (e.g., [email protected]).
  2. Configure Auto-Forwarding: In your existing reporting system (e.g., Excel, BI tool), set up a rule to automatically email reports (as CSV or Excel attachments) to this unique Scoop address.
  3. Create Dataset: Provide a Report Name and Description. Scoop will automatically create a new dataset (Inbox) for the incoming data.

Email Ingestion Options

  • Keep Only Current: If checked, each new email will replace the previous dataset. If unchecked, data from each email will be appended, building a history.
  • Incremental: For reports that only contain new or changed data.
  • Enable Multiple Same Day Loads: Allows multiple emails (and thus multiple data loads) on the same day.

3. Blending Multiple Datasets

Combine different sources to create a unified view for deeper analysis.

Workflow: Blend Data

  1. Open the Blending Modal: Select the "Blend Data" option when creating a new dataset.
  2. Select Datasets: Choose the Inboxes (datasets) you wish to combine.
  3. Choose Tables: Select the specific tables from each dataset you want to blend.
  4. Query Configuration:
    • Query Name: Give your blended dataset a descriptive name.
    • Advanced Options:
      • Snapshot vs. Date Range: Use the latest available data, or define a specific start date for the blend.
      • Grouping: Define how the blended data should be aggregated (e.g., Daily, Weekly, Monthly, Yearly).
      • Data Retrieval: Choose between Raw data or Change data (to see what's changed across the blended sources).
      • Columns & Filters: Select the specific columns you need from the blended datasets and apply any necessary filters.
  5. Continue: Scoop will process and create your new blended dataset.

4. Generic Dataset Configuration (for any Inbox)

These settings apply to any dataset you create or manage.

  • Dataset Name: The user-friendly name displayed in Scoop.
  • Description: A short summary of the dataset's content.
  • Keep Only Current: (See Email Ingestion Options).
  • Incremental: (See Email Ingestion Options).
  • Multiple Same Day Loads: (See Email Ingestion Options).
  • Workbook Range: If your data source is a spreadsheet, define the specific cell range (e.g., Sheet1!A1:Z100).