Page Inspect

Meltano: Extract & Load with joy

- Product

- The only EL tool built for data engineers

No more point-and-click-and-cross-your-fingers. Build data pipelines that fit exactly to your needs.

Overview

The only EL tool built for data engineers
- Build a connector for any data source

The Meltano SDK lets you easily built Singer connectors for custom, niche, and internal sources

Meltano/SDK

Build a connector for any data source under the sun
- Integrate any existing data tool for any data source

The Meltano EDK is the fastest way to build custom extensions and utilities for Meltano.

Meltano/EDK

Integrate any existing data tool for any data source
- The joy of creating

Everything you need and more to move, transform, and explore your data. Connectors for 600+ sources and destinations.

Meltano/Hub

Connectors for 600+ sources and destinations
- Pricing
- Pricing

- Pricing

Meltano is an open source project by Arch

Pricing

Open source and free to use, with paid support options
- Resources

- Meltano at a glance

Learn how to use Meltano, how Meltano is built, and where to get started

Documentation

Learn how to use Meltano and where to get started
- Join the Melty Crew!

Join 5,500+ data professionals on Slack and GitHub

Community

Join 5,500+ data professionals on Slack and GitHub
- The latest in Meltano & data engineering

Meltano updates, data engineering trends, tutorials, and other data musings

Blog

Stay up to date on Meltano & data engineering
- Meltano Partners

Bring in help to build connectors and take Meltano into production

Partners

Bring in help to build connectors and take Meltano into production
- Company

- About Meltano

Meltano is an open source project by Arch

About

Meltano is an open source project by Arch

Get started

# Extract & Load
*with joy*

CLI & version control for ELT without limitations

Try live demoInstall open source

Loved by data teams

## Meltano gives data engineers
*control and visibility*
of their pipelines

No more black box. Let your creativity flow.

##### Sources
##### Destinations

SaaS API

Database

File

Custom Source

Database

Vector DB

Data Warehouse

Data Lake

## Your data, where you want it
*the way you want it*

We've got 100% of your data sources & destinations covered:
Databases, SaaS APIs, raw files, and anything niche or internal

Explore 600+ connectors on Meltano Hub

#### Reduce
*cost*

Pay only for the workloads you run, no matter how much the data volume grows, whether you self-manage or deploy on a managed orchestrator.

Learn more

#### Increase
*efficiency*

Build, improve, debug, and fix connectors yourself, without waiting or arguing with support. Support is here to help, not get in your way.

Learn more

#### Centralize
*movement*

Manage all your data pipelines in one place: databases, files, SaaS apps, internal sources, Python scripts, and data tools like dbt.

Learn more

#### Remove
*constraints*

Add that data source. Mask that PII before the warehouse. Tweak that connector. Let other teams contribute pipelines. Go for it!

Learn more

### Customizable
##### Manage all your pipelines in one place

- Custom connectors for niche or internal sources, built with our Meltano SDK
- Custom forks of existing connectors with your own modifications
- Your Python scripts and data tools like dbt

Meltano HubMeltano SDK

Terminal

meltano add extractor tap-postgres

meltano add loader target-snowflake

cookiecutter https://github.com/meltano/sdk \\

\--directory\="cookiecutter/tap-template

\# source\_name: my-api

meltano add \--custom extractor tap-my-api

meltano add utility dbt-snowflake

meltano add \--custom utility my-script.py

meltano run tap-postgres target-snowflake dbt-snowflake

meltano run tap-my-api target-snowflake my-script.py

### Transparent
##### Know exactly what's going on

- Get the full view with detailed pipeline logs
- Inspect the source code of any connector, modify them to your liking, or debug and fix an issue faster than any support agent
- Centrally manage your configuration so anyone can suggest changes

Learn more

Terminal

export MELTANO\_LOG\_LEVEL\=debug

meltano run tap-github target-duckdb

cat .meltano/logs/elt/github-to-duckdb-hourly/\*/\*.log

git clone https://github.com/MeltanoLabs/tap-github.git

git clone https://github.com/jwills/target-duckdb.git

meltano add \--custom extractor tap-github-fork

\# pip\_url: https://github.com/my-org/tap-github.git

meltano run tap-github-fork target-duckdb

### Versionable
##### Increase productivity and collaboration

- Store your pipelines and their configuration in Git and know exactly what is live at any time
- Roll back to the last known-good configuration if a change accidentally broke something
- Propose changes with confidence and get feedback from your team in pull requests

Learn more

meltano.yml

plugins:

extractors:

\- name: tap\-postgres

config:

host: pg.example.com

user: admin

password: $PG\_PASSWORD

select:

\- users.\*

loaders:

\- name: target\-snowflake

schedules:

\- name: app\-to\-dw

interval: @hourly

extractor: tap\-postgres

loader: target\-snowflake

### Testable
##### Make changes with confidence

- Safely experiment with new pipelines, connectors, and configuration changes on your local machine
- Manually verify the impact of any changes in isolated feature-branch and staging environments
- Automatically test your pipelines in CI, and only deploy to production once everything is green

Learn more

Terminal

git clone https://github.com/my-org/my-meltano-project.git

git checkout \-b update-postgres

meltano config tap-postgres set host new-host.example

meltano select tap-postgres new-table "\*"

meltano run tap-postgres target-snowflake

git commit \-am "Update postgres host and table"

git push origin

gh pr create

### Programmable
##### Integrate deeply with your product

- Let your users directly connect data sources and manage pipelines from your application code
- Define pipeline templates and dynamically instantiate them based on API credentials in your database
- Configure connectors at runtime using environment variables or a dynamically generated config file

Learn more

meltano.yml

plugins:

extractors:

\- name: tap\-shopify

\- name: tap\-postgres\-\-shopify\-configs

inherit\_from: tap\-postgres

select:

\- shopify\_configs.\*

loaders:

\- name: target\-snowflake

schedules:

\- name: sync\-all\-shopify

interval: @hourly

config\_source:

tap-shopify: tap\-postgres\-\-shopify\-configs

extractor: tap\-shopify

loader: target\-snowflake

## One tool for all your
*data movement* needs

No more point-and-click-and-cross-your-fingers.
Build data pipelines that fit exactly to your needs

#### Databases and warehouses

Painlessly move data in and out of any database or warehouse: fast imports of large batches plus key-based and log-based (CDC) incremental replication with automatic schema migration. Ensure data security using in-flight filtering and hashing of PII.

See it in action

#### Internal and niche APIs

Quickly build a connector for any API using the Meltano SDK: built-in error and rate limit handling plus zero-effort incremental replication. Develop, test, and iterate locally and in staging, and debug using detailed pipeline logs and alerting.

Experience the tool

#### Files and spreadsheets

Extract data from any common or custom file format, stored in S3, (S)FTP, URLs, or cloud drives – with automatic schema migration. Ensure data security using in-flight filtering and hashing of PII, and debug using detailed pipeline logs and alerting.

Experience the tool

#### SaaS apps and APIs

Choose from the largest connector library of any EL tool, and modify or fix connector behavior without waiting for support. Ensure data security using in-flight filtering and hashing of PII, and debug using detailed pipeline logs and alerting.

See it in action

#### *Join* 4,500+
on Slack
Chat and learn from other users

#### *Contribute*
on GitHub
View code and issue tracker

## *The latest* in Meltano
& data engineering

Community

Data and Analytics

##### Data consultants, are you already productizing your services?

Product

##### We’re bringing powerful data engineering capabilities to software teams with Arch

Data and Analytics

##### Meltastic by Meltano: September 2023 Edition

Get more data engineering insights

## Intrigued?

You haven’t seen nothing yet!

Try live demoInstall open source

Stay current with all things Meltano

Subscribe

Product

- Overview

The only EL tool built for data engineers
- Meltano/SDK

Build a connector for any data source under the sun
- Meltano/EDK

Integrate any existing data tool for any data source
- Meltano/Hub

Connectors for 600+ sources and destinations

Resources

- Documentation

Learn how to use Meltano and where to get started
- Community

Join 5,500+ data professionals on Slack and GitHub
- Blog

Stay up to date on Meltano & data engineering
- Partners

Bring in help to build connectors and take Meltano into production

Company

- About

Meltano is an open source project by Arch

Terms of ServicePrivacy Policy© Arch 2025