Connecting Hardal Analytics with BigQuery

Integrating Hardal Analytics with BigQuery allows for advanced data analysis, reporting, and visualization. Follow these steps to ensure a seamless setup.

Step 1: Create a Google Cloud Project

  1. Log in to Google Cloud Console: Access your Google Cloud account at Google Cloud Console.
  2. Create a new project: If you don’t already have a project, create one by navigating to the project selector and clicking New Project.
  3. Enable BigQuery API:
    • Go to APIs & Services > Library.
    • Search for BigQuery API.
    • Click Enable.

Step 2: Set Up Hardal Gateway

  1. Integrate Hardal with BigQuery:
    • Hardal’s server-side gateway must be configured to stream data directly into your BigQuery dataset.
    • Define the appropriate schema to ensure seamless data ingestion.
  2. Authorize Access:
    • Grant the required permissions to Hardal Gateway for writing data into your BigQuery dataset.
    • Assign roles such as BigQuery Data Editor or BigQuery Admin to the service account Hardal uses.
  3. Verify Data Transmission:
    • Use logging tools such as Cloud Logging to ensure data is being sent correctly.
    • Validate schema mapping to avoid ingestion errors.
  1. Access GA4 Admin Panel:
    • In your GA4 property, navigate to Admin > BigQuery Linking.
  2. Create a New Link:
    • Click Link and select your existing BigQuery project.
  3. Configure Data Export Settings:
    • Select the appropriate data location (e.g., US or EU, based on compliance needs).
    • Choose the export frequency:
      • Daily Export: Sends data once a day.
      • Streaming Export: Sends data continuously.
  4. Submit the Link:
    • Review the configuration and click Submit.
    • It may take up to 24 hours for data to start appearing in BigQuery.

Additional Considerations

  • Permissions:
    • Ensure you have the Owner role for the BigQuery project.
    • You must be an Editor or Administrator in GA4 to link properties.
  • Data Monitoring:
    • Regularly check the BigQuery console to verify incoming data.
    • Set up error alerts in Google Cloud Logging for any ingestion failures.
  • Optimize Data Usage:
    • Use partitioned tables in BigQuery to manage large datasets efficiently.
    • Consider data retention policies to control storage costs.

By following these steps, you will successfully integrate Hardal Analytics with BigQuery, unlocking powerful insights and enhancing your data-driven decision-making capabilities.