Gaio DataOS
Gaio DataOS
Gaio DataOS
  • 👋 Welcome to Gaio DataOS
  • GETTING STARTED
    • Gaio DataOS Console
    • Quickstart
  • FUNDAMENTALS
    • Data Projects
    • Studio
    • Database
    • Workflow
  • Data Sources
  • TASKS
    • ETL
      • Builder
      • SQL
      • Source SQL
      • Insert Table
      • Insert Row
      • Update
      • Delete
      • Create Table
      • Quick Table
      • Quick Upload
      • Pivot Table
      • Unpivot Table
      • REST
      • Parameters to Table
      • Table to Parameters
      • Define parameter value
      • Users
      • CSV Web
      • CSV Local
      • Google Spreadsheet
    • Analytics
      • Sample
      • Cluster
      • Principal Components
      • Association Rules
      • Forecast
      • Python
    • Delivery
      • Content
      • Form Card
      • Export CSV
    • Map Editor
Powered by GitBook
On this page
  • How to Use
  • 1. Open the Task
  • 2. Configure the Task
  • 3. Advanced Options
  • 4. Save and Use
  1. TASKS
  2. ETL

CSV Web

PreviousUsersNextCSV Local

Last updated 9 days ago

The CSV Web task in Gaio DataOS allows you to automatically import a CSV file hosted on a public URL directly into your project environment. This feature is ideal for integrating external data, such as publicly shared spreadsheets, third-party system exports, or APIs that provide CSV downloads.

How to Use

1. Open the Task

Navigate to: Tasks > ETL > CSV Web

2. Configure the Task

  • Task label: (optional) Name for identifying this step in your flow.

  • Result table: Name of the table that will be created or populated with the imported data.

  • File URL: Public URL of the CSV file (e.g., https://example.com/data.csv)

  • Params applicable: If the URL includes dynamic elements, you can use environment parameters (example:https://pncp.gov.br/api/pncp/v1/orgaos/{{params}}/csv)

  • Fields terminated by: Define the delimiter used in the CSV file (Comma, Semicolon, Tab, etc.)

3. Advanced Options

  • Auto detect schema (column names) When enabled, the system will detect and assign column names and types based on the first row of the CSV.

  • Insert mode: append records to table When enabled, new data will be appended to the existing records in the table. When disabled, the table will be overwritten with the new data.

4. Save and Use

  • Click Save to add the task to your flow.

  • When executed, Gaio will fetch the CSV from the URL and import the data based on your configuration.

Use Cases

  • Connect to public datasets from government, finance, or climate sources

  • Integrate regularly updated reports hosted via HTTP

  • Import data maintained in external systems that expose CSVs

  • Automate ingestion of live or scheduled data feeds