Hyperledger Cello is a blockchain provision and operation system, which helps manage blockchain networks in an efficient way.

1. Introduction
2. Quick Start
3. Main Features
4. Documentation
5. Why named cello?
6. Notice
7. Inclusive Language Statement

Introduction

Using Cello, everyone can easily:

• Build up a Blockchain as a Service (BaaS) platform quickly from scratch.
• Provision customizable Blockchains instantly, e.g., a Hyperledger fabric network v1.0.
• Maintain a pool of running blockchain networks on top of baremetals, Virtual Clouds (e.g., virtual machines, vsphere Clouds), Container clusters (e.g., Docker, Swarm, Kubernetes).
• Check the system status, adjust the chain numbers, scale resources... through dashboards.

A typical usage scenario is illustrated as:

Quick Start

Environmental preparation:

1. docker how install
2. docker compose(we switched to Docker Compose V2) how install
3. make all script for cello service management is written in Makefile
4. kubernetes (optional) how install
5. node how install

If environment is prepared, then we can start cello service.

• Set local storage environment variable, e.g. Use current path as storage path

bash $ export CELLO_STORAGE_PATH=$(pwd)/cello

• Start service locally

bash $ make local

This command builds the required local images and starts the dashboard, API engine, PostgreSQL database, and Fabric agent.

• If you need a clean local environment, remove the local data volume and restart all services:

bash $ make local-reset

• After service started up, if use docker-compose method, you can see output:

bash CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 57df1462c7f1 cello/hyperledger-fabric-agent:local "python manage.py r…" 4 seconds ago Up 2 seconds 0.0.0.0:5001->8080/tcp, :::5001->8080/tcp cello-docker-agent 04367ab6bd5e postgres:16.14 "docker-entrypoint.s…" 4 seconds ago Up 2 seconds 0.0.0.0:5432->5432/tcp, :::5432->5432/tcp cello-postgres 29b56a279893 cello/api-engine:latest "/bin/sh -c 'bash /e…" 4 seconds ago Up 2 seconds 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp cello-api-engine a272a06d8280 cello/dashboard:latest "bash -c 'nginx -g '…" 4 seconds ago Up 2 seconds 0.0.0.0:8081->8081/tcp, :::8081->8081/tcp cello-dashboard

• When registering an organization from the dashboard, use the following agent URL:

text http://cello-docker-agent:8080/api/v1/

• Stop cello service.

bash $ make stop

• Clean all containers

bash $ make clean

• Check available make rules

bash $ make help

• Visit Cello dashboard at localhost:8081

• Check troubleshoot section if you get any question.

PostgreSQL 12 → 16 Migration

Important

PostgreSQL major-version data directories cannot be directly reused between PG12 and PG16 due to internal storage format changes. Before performing the upgrade: * Preserve the existing PG12 data directory or Docker volume so rollback remains possible. * Create a separate PG16 volume or storage directory rather than overwriting existing PG12 storage. * Perform a full backup of all databases and PostgreSQL globals/roles using pg_dumpall. * Check PostgreSQL extensions used by the application and verify database driver (psycopg2-binary) compatibility. * Validate the restored database and application functionality before removing old PG12 data.

Development environment

For setups using docker-compose.dev.yaml with the named volume cello-postgres:

1. Back up PG12 databases and globals: bash docker exec -t cello-postgres pg_dumpall -U postgres > cello_pg12_backup.sql

2. Stop the development environment: bash docker compose -f docker-compose.dev.yaml down

3. Preserve the existing PG12 volume for rollback: bash docker volume create cello-postgres-pg12-backup docker run --rm -v cello-postgres:/from -v cello-postgres-pg12-backup:/to alpine sh -c "cp -av /from/. /to/"

4. Recreate the volume and start the updated PG16 database container: bash docker volume rm cello-postgres docker compose -f docker-compose.dev.yaml up -d cello-postgres

5. Restore the database backup into the PG16 container: bash docker exec -i cello-postgres psql -U postgres < cello_pg12_backup.sql

6. Start all development services: bash docker compose -f docker-compose.dev.yaml up -d

Deployment using /opt/cello/pgdata

For deployments using bootup/docker-compose-files/docker-compose.dev.yml, docker-compose.server.dev.yml, or docker-compose-dev.yml with host path ${CELLO_STORAGE_PATH:-/opt/cello}/pgdata:

1. Back up PG12 databases and globals: bash docker exec -t cello-postgres pg_dumpall -U postgres > cello_pg12_backup.sql

2. Stop running services: bash docker compose -f bootup/docker-compose-files/docker-compose.dev.yml down

3. Preserve existing PG12 storage directory: bash sudo mv /opt/cello/pgdata /opt/cello/pgdata_v12_backup sudo mkdir -p /opt/cello/pgdata

4. Start the upgraded PG16 database container: bash docker compose -f bootup/docker-compose-files/docker-compose.dev.yml up -d cello-postgres

5. Restore the database backup: bash docker exec -i cello-postgres psql -U postgres < cello_pg12_backup.sql

6. Start all services: bash docker compose -f bootup/docker-compose-files/docker-compose.dev.yml up -d

Deployment using /opt/cello/postgres

For server deployments using bootup/docker-compose-files/docker-compose.yml with host path /opt/cello/postgres:

1. Back up PG12 databases and globals: bash docker exec -t cello-postgres-server pg_dumpall -U ${POSTGRES_USER:-postgres} > cello_pg12_backup.sql

2. Stop running services: bash docker compose -f bootup/docker-compose-files/docker-compose.yml down

3. Preserve existing PG12 storage directory: bash sudo mv /opt/cello/postgres /opt/cello/postgres_v12_backup sudo mkdir -p /opt/cello/postgres

4. Start the upgraded PG16 database container: bash docker compose -f bootup/docker-compose-files/docker-compose.yml up -d postgres-server

5. Restore the database backup: bash docker exec -i cello-postgres-server psql -U ${POSTGRES_USER:-postgres} < cello_pg12_backup.sql

6. Start all services: bash docker compose -f bootup/docker-compose-files/docker-compose.yml up -d

Validation

1. Verify PostgreSQL version inside the container: bash docker exec -it cello-postgres psql -U postgres -c "SELECT version();"
2. Verify Django API Engine logs for successful migrations and database connectivity: bash docker logs cello-api-engine
3. Run API integration tests: bash make check-api

Rollback

If issues arise during verification: 1. Stop the PG16 environment (docker compose down). 2. Revert the PostgreSQL image reference to postgres:12.0. 3. Restore the preserved PG12 storage directory (/opt/cello/pgdata_v12_backup -> /opt/cello/pgdata or /opt/cello/postgres_v12_backup -> /opt/cello/postgres) or named volume (cello-postgres-pg12-backup). 4. Restart services. 5. Only remove old PG12 storage after the PG16 environment is fully verified.

Main Features

• Manage the lifecycle of blockchains, e.g., create/start/stop/delete/keep health automatically.

• Support customized (e.g., size, consensus) blockchains request, currently we mainly support Hyperledger fabric.

• Support native Docker host, swarm or Kubernetes as the worker nodes. More supports on the way.

• Support heterogeneous architecture, e.g., X86, POWER and Z, from bare-metal servers to virtual machines.

• Extend with monitor, log, health and analytics features by employing additional components.

Documentation, Getting Started and Develop Guideline

For new users, it is highly recommended to read the documentation first.

And feel free to visit the online documentation for more information. You can also run make doc to start a local documentation website (Listen at localhost:8000.

Why named Cello?

Can you find anyone better at playing chains? :)

Incubation Notice

This project is a Hyperledger project in Incubation. It was proposed to the community and documented here, and was approved by Hyperledger TSC at 2017-01-07. Information on what Incubation entails can be found in the Hyperledger Project Lifecycle document.

Inclusive Language Statement

These guiding principles are very important to the maintainers and therefore we respectfully ask all contributors to abide by them as well:

• Consider that users who will read the docs are from different backgrounds and cultures and that they have different preferences.
• Avoid potential offensive terms and, for instance, prefer "allow list and deny list" to "white list and black list".
• We believe that we all have a role to play to improve our world, and even if writing inclusive documentation might not look like a huge improvement, it's a first step in the right direction.
• We suggest to refer to Microsoft bias free writing guidelines and Google inclusive doc writing guide as starting points.

This work is licensed under a Creative Commons Attribution 4.0 International License.