FAQ
Can I use BigQuery as both a source and destination?
Yes. You can query one BigQuery dataset (source) and write results to another BigQuery table (destination). This is useful for building data pipelines, creating aggregated tables, or copying data between projects.
How do I reference multiple tables in my query?
Use JOIN to combine data from multiple tables. Always include the full path (project.dataset.table):
SELECT o.order_id, c.customer_name, p.product_name
FROM project.dataset.orders o
JOIN project.dataset.customers c ON o.customer_id = c.customer_id
JOIN project.dataset.products p ON o.product_id = p.product_idIf the tables are in different datasets, use the full reference for each.
What SQL dialect does BigQuery use?
BigQuery uses standard ANSI SQL with some Google-specific extensions. Learn more in the BigQuery SQL reference. Most common SQL patterns (SELECT, WHERE, GROUP BY, JOIN, UNION) work as expected.
Can I parameterize my query with dynamic values?
Coupler.io doesn't currently support dynamic parameters in the SQL query field itself. However, you can use Coupler.io's Join transformation to combine BigQuery results with other data sources, or use Append mode to build running logs over time. For more advanced use cases, consider using BigQuery views to encapsulate parameterized logic.
What happens if my query returns 0 rows?
Coupler.io will still run successfully and send an empty result to your destination. If using Replace mode, it will clear the destination range (minus headers). If using Append mode, no new rows will be added. This is normal behavior — check your query filters and date ranges if you expected data.
How do I avoid duplicates when using Append mode?
Use date filtering in your SQL query to only fetch new or recently updated records:
SELECT * FROM project.dataset.orders
WHERE updated_at >= DATE_SUB(CURRENT_DATE(), INTERVAL 1 DAY)This way, each scheduled run only appends truly new data. Alternatively, use Replace mode if you want a fresh snapshot each time.
How do I reduce BigQuery costs?
BigQuery charges for bytes scanned (not returned). To reduce costs:
Select only needed columns (avoid
SELECT *)Add WHERE clauses to filter early
Partition and cluster tables by frequently-filtered columns
Use date ranges to limit historical data scans
Consider scheduling less frequently if the data doesn't change daily
See the Performance optimization section in Best Practices for more details.
What if my Service Account loses permission to a dataset?
Your data flow will fail with "Access Denied." To fix it, go to the dataset's Sharing settings in Google Cloud Console and grant the service account the BigQuery Data Viewer role again. Then run the data flow manually.
Can I use nested or repeated fields in BigQuery?
Yes, but you may need to flatten them using UNNEST(). For example:
This converts array/nested fields into flat rows that Google Sheets can display.
How do I troubleshoot a slow or timed-out query?
Run the same query in BigQuery's web UI — check the execution time and bytes scanned
Optimize by selecting fewer columns and filtering more aggressively
Break the query into smaller parts and test each separately
Use
LIMITduring development to test quicklyCheck for expensive operations like unindexed JOINs or full table scans
Refer to Common Issues for more troubleshooting steps.
Can I schedule the same query multiple times per day?
Yes. In Coupler.io, you can set hourly, 6-hourly, or any frequency you prefer. Keep in mind that more frequent queries increase BigQuery costs. Use date-filtered queries to minimize bytes scanned on each run.
What's the difference between Replace and Append modes?
Replace mode — Clears the destination range and writes all results fresh each time. Use this for daily snapshots.
Append mode — Adds new rows below existing data without clearing. Use this for running logs or time-series data. Always combine with date filtering to avoid duplicates.
See the Data refresh and scheduling section in Best Practices for recommendations on when to use each mode.
Can I send BigQuery results to AI platforms like ChatGPT or Claude?
Yes! Coupler.io supports AI destinations including ChatGPT, Claude, Cursor, Gemini, Perplexity, and OpenClaw. You can send query results to these platforms for automated analysis, summarization, or insight generation. Select the AI destination when configuring your data flow.
Last updated
Was this helpful?
