View Source Electric

Electric Sync is a lightweight data synchronization service designed to sync small subsets of your Postgres data into various environments and applications, such as web and mobile apps, development environments, edge services, and local AI systems.

Key Use Cases:

• Web & Mobile Apps: Replaces traditional data fetching by syncing necessary data directly into your apps.
• Development Environments: Synchronizes data into embedded databases like PGlite, facilitating local testing.
• Edge Workers & Services: Maintains low-latency data caches for edge services.
• Local AI Systems: Syncs data into AI systems utilizing pgvector for efficient, local data handling.

How it Works:

Electric Sync is powered by an Elixir-based application that connects to your Postgres database via a DATABASE_URL. It consumes the logical replication stream and exposes an HTTP API for replicating data subsets, or "Shapes," to local environments.

For a quick setup and examples, refer to the Quickstart guide.

Running as a Standalone HTTP Endpoint

Run Postgres:

docker compose -f dev/docker-compose.yml create
docker compose -f dev/docker-compose.yml start
copy

Source the .env.dev somehow, e.g.:

set -a; source .env.dev; set +a
copy

Run the Elixir app:

mix deps.get
iex -S mix
copy

Embedding into another Elixir Application

Include :electric into your dependencies:

# mix.exs
defp deps do
  [
  {:electric, ">= 1.0.0-beta.18"}
  ]
endcopy

Add the Postgres db connection configuration to your application's config. Electric accepts the same configuration format as Ecto (and Postgrex) so you can reuse that configuration if you want:

# config/*.exs
database_config = [
  database: "ecto_simple",
  username: "postgres",
  password: "postgres",
  hostname: "localhost"
]
config :my_app, Repo, database_config

config :electric,
  replication_connection_opts: Electric.Utils.obfuscate_password(database_config)copy

Or if you're getting your db connection from an environment variable, then you can use Electric.Config.parse_postgresql_uri!/1:

# config/*.exs
{:ok, database_config} = Electric.Config.parse_postgresql_uri(System.fetch_env!("DATABASE_URL"))

config :electric,
  replication_connection_opts: Electric.Utils.obfuscate_password(database_config)copy

The Electric app will startup along with the rest of your Elixir app.

Beyond the required database connection configuration there are a lot of other optional configuration parameters. See the Electric docs for more information.