FAQ

chevron-rightCan I use BigQuery as both a source and destination?hashtag

Yes. You can query one BigQuery dataset (source) and write results to another BigQuery table (destination). This is useful for building data pipelines, creating aggregated tables, or copying data between projects.

chevron-rightHow do I reference multiple tables in my query?hashtag

Use JOIN to combine data from multiple tables. Always include the full path (project.dataset.table):

SELECT o.order_id, c.customer_name, p.product_name
FROM project.dataset.orders o
JOIN project.dataset.customers c ON o.customer_id = c.customer_id
JOIN project.dataset.products p ON o.product_id = p.product_id

If the tables are in different datasets, use the full reference for each.

chevron-rightWhat SQL dialect does BigQuery use?hashtag

BigQuery uses standard ANSI SQL with some Google-specific extensions. Learn more in the BigQuery SQL referencearrow-up-right. Most common SQL patterns (SELECT, WHERE, GROUP BY, JOIN, UNION) work as expected.

chevron-rightCan I parameterize my query with dynamic values?hashtag

Coupler.io doesn't currently support dynamic parameters in the SQL query field itself. However, you can use Coupler.io's Join transformation to combine BigQuery results with other data sources, or use Append mode to build running logs over time. For more advanced use cases, consider using BigQuery views to encapsulate parameterized logic.

chevron-rightWhat happens if my query returns 0 rows?hashtag

Coupler.io will still run successfully and send an empty result to your destination. If using Replace mode, it will clear the destination range (minus headers). If using Append mode, no new rows will be added. This is normal behavior — check your query filters and date ranges if you expected data.

chevron-rightHow do I avoid duplicates when using Append mode?hashtag

Use date filtering in your SQL query to only fetch new or recently updated records:

SELECT * FROM project.dataset.orders
WHERE updated_at >= DATE_SUB(CURRENT_DATE(), INTERVAL 1 DAY)

This way, each scheduled run only appends truly new data. Alternatively, use Replace mode if you want a fresh snapshot each time.

chevron-rightHow do I reduce BigQuery costs?hashtag

BigQuery charges for bytes scanned (not returned). To reduce costs:

  • Select only needed columns (avoid SELECT *)

  • Add WHERE clauses to filter early

  • Partition and cluster tables by frequently-filtered columns

  • Use date ranges to limit historical data scans

  • Consider scheduling less frequently if the data doesn't change daily

circle-info

See the Performance optimization section in Best Practices for more details.

chevron-rightWhat if my Service Account loses permission to a dataset?hashtag

Your data flow will fail with "Access Denied." To fix it, go to the dataset's Sharing settings in Google Cloud Console and grant the service account the BigQuery Data Viewer role again. Then run the data flow manually.

chevron-rightCan I use nested or repeated fields in BigQuery?hashtag

Yes, but you may need to flatten them using UNNEST(). For example:

This converts array/nested fields into flat rows that Google Sheets can display.

chevron-rightHow do I troubleshoot a slow or timed-out query?hashtag
  1. Run the same query in BigQuery's web UI — check the execution time and bytes scanned

  2. Optimize by selecting fewer columns and filtering more aggressively

  3. Break the query into smaller parts and test each separately

  4. Use LIMIT during development to test quickly

  5. Check for expensive operations like unindexed JOINs or full table scans

circle-info

Refer to Common Issues for more troubleshooting steps.

chevron-rightCan I schedule the same query multiple times per day?hashtag

Yes. In Coupler.io, you can set hourly, 6-hourly, or any frequency you prefer. Keep in mind that more frequent queries increase BigQuery costs. Use date-filtered queries to minimize bytes scanned on each run.

chevron-rightWhat's the difference between Replace and Append modes?hashtag

Replace mode — Clears the destination range and writes all results fresh each time. Use this for daily snapshots.

Append mode — Adds new rows below existing data without clearing. Use this for running logs or time-series data. Always combine with date filtering to avoid duplicates.

circle-info

See the Data refresh and scheduling section in Best Practices for recommendations on when to use each mode.

chevron-rightCan I send BigQuery results to AI platforms like ChatGPT or Claude?hashtag

Yes! Coupler.io supports AI destinations including ChatGPT, Claude, Cursor, Gemini, Perplexity, and OpenClaw. You can send query results to these platforms for automated analysis, summarization, or insight generation. Select the AI destination when configuring your data flow.

Last updated

Was this helpful?