CSV Web

The CSV Web task in Gaio DataOS allows you to automatically import a CSV file hosted on a public URL directly into your project environment. This feature is ideal for integrating external data, such as publicly shared spreadsheets, third-party system exports, or APIs that provide CSV downloads.


How to Use

1. Open the Task

Navigate to: Tasks > ETL > CSV Web


2. Configure the Task

  • Task label: (optional) Name for identifying this step in your flow.

  • Result table: Name of the table that will be created or populated with the imported data.

  • File URL: Public URL of the CSV file (e.g., https://example.com/data.csv)

  • Params applicable: If the URL includes dynamic elements, you can use environment parameters (example:https://pncp.gov.br/api/pncp/v1/orgaos/{{params}}/csv)

  • Fields terminated by: Define the delimiter used in the CSV file (Comma, Semicolon, Tab, etc.)


3. Advanced Options

  • Auto detect schema (column names) When enabled, the system will detect and assign column names and types based on the first row of the CSV.

  • Insert mode: append records to table When enabled, new data will be appended to the existing records in the table. When disabled, the table will be overwritten with the new data.


4. Save and Use

  • Click Save to add the task to your flow.

  • When executed, Gaio will fetch the CSV from the URL and import the data based on your configuration.


Use Cases

  • Connect to public datasets from government, finance, or climate sources

  • Integrate regularly updated reports hosted via HTTP

  • Import data maintained in external systems that expose CSVs

  • Automate ingestion of live or scheduled data feeds

Last updated