"Import finished successfully, but data was truncated" warning

After running a data flow, the following warning is shown:

Data was partially imported because you have exceeded your current plan limit. Import finished successfully, but data was truncated.

Warning samples:

Data was partially imported because you have exceeded your current plan limit

Import finished successfully, but data truncated because your dataset contains more than 10,000 rows.\ Please upgrade your plan to import more than 10,000 rows.

Import finished successfully, but data was truncated

One or more of your data sources contain more than 100 rows, which exceeds your current plan's limit. Please upgrade your plan to import 100 rows per data source.

This warning indicates you have hit the Data Volume limit . This limit differs per billing plan.

There can be an edge case where you receive this warning even when your rows in the destination file are within your limit.

Why does it happen:

There are 4 stages your data undergoes when you set up an integration in Coupler.io:

• Step 1 - Sources setup
• Step 2 - Data Sets (Transformations)
• Step 3 - Destinations setup
• Step 4 - Flow Settings

This edge case may happen when you reduce your dataset during step 2 - Data Sets, but your original dataset from step 1 - Sources is bigger.

Coupler.io fetches your data fully based on the parameters you've set in step 1 - Sources setup, before showing your data on step 2 - Data Sets. In the Destinations, you see the data that matches the data in step 2 - Data Sets.

This is why your Data Volume limit is getting reached. Because internally, Coupler.io still uses resources to pull all your data during the first stage. The filter is applied later, in the second stage.

Example scenario

You are on the free plan with a 100 rows/run Data Volume limit.

You are running 2 Campaigns in Facebook Ads and want to pull insights for 1 Campaign for the last week. On Step 1 - Sources setup, you used only the date settings. On Step 2 - Data Sets, you applied a filter by campaign name and ran the data flow to a spreadsheet.

The destination spreadsheet showed 70 rows of data, yet you received the "Import finished successfully, but data was truncated" warning.

Why? Your original dataset before Transformations was 150 rows, as it had data for all your Facebook Ads Campaigns for the past week.

To not receive this warning, you can apply all filters on Step 1 - Sources setup instead, so your original dataset is under 100 rows. In our example case, you can apply both date filters & filter by campaign name there.