Sequelize CLI
Neither the Sequelize CLI nor its documentation is ready for use in Sequelize 7. If you rely on the CLI, please stay on Sequelize 6 for now.
Considering the main purpose of the CLI is to run migrations, you can also try using umzug, or any other database migration tool instead.
Just like you use version control systems such as Git to manage changes in your source code, you can use migrations to keep track of changes to the database. With migrations, you can transfer your existing database into another state and vice versa: Those state transitions are saved in migration files, which describe how to get to the new state and how to revert the changes to get back to the old state.
You will need the Sequelize Command-Line Interface (CLI). The CLI ships support for migrations and project bootstrapping.
A Migration in Sequelize is a JavaScript file that exports two functions, up
and down
, that dictate how to perform the migration and undo it. You define those functions manually, but you don't call them manually; the CLI will call them automatically. In these functions, you should perform whatever queries you need, with the help of sequelize.query
and whichever other methods Sequelize provides to you. There is no extra magic beyond that.
Installing the CLI
To install the Sequelize CLI:
# using npm
npm install --save-dev sequelize-cli
# using yarn
yarn add sequelize-cli --dev
For details see the CLI GitHub repository.
Project bootstrapping
To create an empty project you will need to execute init
command
# using npm
npx sequelize-cli init
# using yarn
yarn sequelize-cli init
This will create the following folders
config
, contains the config file, which tells CLI how to connect with the databasemodels
, contains all models for your projectmigrations
, contains all migration filesseeders
, contains all seed files
Configuration
Before continuing further we will need to tell the CLI how to connect to the database. To do that let's open the default config file config/config.json
. It looks something like this:
{
"development": {
"username": "root",
"password": null,
"database": "database_development",
"host": "127.0.0.1",
"dialect": "mysql"
},
"test": {
"username": "root",
"password": null,
"database": "database_test",
"host": "127.0.0.1",
"dialect": "mysql"
},
"production": {
"username": "root",
"password": null,
"database": "database_production",
"host": "127.0.0.1",
"dialect": "mysql"
}
}
Note that the Sequelize CLI assumes MySQL by default. If you're using another dialect, you need to change the content of the "dialect"
option.
Now edit this file and set correct database credentials and dialect. The keys of the objects (e.g. "development") are used on model/index.js
for matching process.env.NODE_ENV
(When undefined, "development" is a default value).
Sequelize will use the default connection port for each dialect (for example, for Postgres, it is port 5432). If you need to specify a different port, use the "port"
field (it is not present by default in config/config.js
but you can simply add it).
Note: If your database doesn't exist yet, you can just call db:create
command. With proper access, it will create that database for you.
Creating the first Model (and Migration)
Once you have properly configured the CLI config file you are ready to create your first migration. It's as simple as executing a simple command.
We will use model:generate
command. This command requires two options:
name
: the name of the model;attributes
: the list of model attributes.
Let's create a model named User
.
# using npm
npx sequelize-cli model:generate --name User --attributes firstName:string,lastName:string,email:string
# using yarn
yarn sequelize-cli model:generate --name User --attributes firstName:string,lastName:string,email:string
This will:
- Create a model file
user
inmodels
folder; - Create a migration file with a name like
XXXXXXXXXXXXXX-create-user.js
in themigrations
folder.
Note: Sequelize will only use Model files, it's the table representation. On the other hand, the migration file is a change in that model or more specifically that table, used by CLI. Treat migrations like a commit or a log for some change in the database.
Writing a migration
The following skeleton shows a typical migration file.
module.exports = {
up: (queryInterface, Sequelize) => {
// logic for transforming into the new state
},
down: (queryInterface, Sequelize) => {
// logic for reverting the changes
},
};
We can generate this file using migration:generate
. This will create xxx-migration-example.js
in your migration folder.
# using npm
npx sequelize-cli migration:generate --name migration-example
# using yarn
yarn sequelize-cli migration:generate --name migration-example
The passed queryInterface
object can be used to modify the database. The Sequelize
object stores the available data types such as STRING
or INTEGER
. The function up
or down
should return a Promise
. Let's look at an example:
const { DataTypes } = require('@sequelize/core');
module.exports = {
up: (queryInterface, Sequelize) => {
return queryInterface.createTable('Person', {
name: DataTypes.STRING,
isBetaMember: {
type: DataTypes.BOOLEAN,
defaultValue: false,
allowNull: false,
},
});
},
down: (queryInterface, Sequelize) => {
return queryInterface.dropTable('Person');
},
};
The following is an example of a migration that performs two changes in the database, using an automatically managed transaction to ensure that all instructions are successfully executed or rolled back in case of failure:
const { DataTypes } = require('@sequelize/core');
module.exports = {
up: (queryInterface, Sequelize) => {
return queryInterface.sequelize.transaction(transaction => {
return Promise.all([
queryInterface.addColumn(
'Person',
'petName',
{
type: DataTypes.STRING,
},
{ transaction },
),
queryInterface.addColumn(
'Person',
'favoriteColor',
{
type: DataTypes.STRING,
},
{ transaction },
),
]);
});
},
down: (queryInterface, Sequelize) => {
return queryInterface.sequelize.transaction(transaction => {
return Promise.all([
queryInterface.removeColumn('Person', 'petName', { transaction }),
queryInterface.removeColumn('Person', 'favoriteColor', { transaction }),
]);
});
},
};
The next example is of a migration that has a foreign key. You can use references to specify a foreign key:
const { DataTypes } = require('@sequelize/core');
module.exports = {
up: queryInterface => {
return queryInterface.createTable('Person', {
name: DataTypes.STRING,
isBetaMember: {
type: DataTypes.BOOLEAN,
defaultValue: false,
allowNull: false,
},
userId: {
type: DataTypes.INTEGER,
references: {
model: {
tableName: 'users',
schema: 'schema',
},
key: 'id',
},
allowNull: false,
},
});
},
down: (queryInterface, Sequelize) => {
return queryInterface.dropTable('Person');
},
};
The next example is of a migration that uses async/await where you create a unique index on a new column, with a manually-managed transaction:
const { DataTypes } = require('@sequelize/core');
module.exports = {
async up(queryInterface) {
const transaction = await queryInterface.sequelize.startUnmanagedTransaction();
try {
await queryInterface.addColumn(
'Person',
'petName',
{
type: DataTypes.STRING,
},
{ transaction },
);
await queryInterface.addIndex('Person', 'petName', {
fields: 'petName',
unique: true,
transaction,
});
await transaction.commit();
} catch (err) {
await transaction.rollback();
throw err;
}
},
async down(queryInterface) {
const transaction = await queryInterface.sequelize.startUnmanagedTransaction();
try {
await queryInterface.removeColumn('Person', 'petName', { transaction });
await transaction.commit();
} catch (err) {
await transaction.rollback();
throw err;
}
},
};
The next example is of a migration that creates a unique index composed of multiple fields with a condition, which allows a relation to exist multiple times but only one can satisfy the condition:
const { DataTypes } = require('@sequelize/core');
module.exports = {
up: queryInterface => {
queryInterface
.createTable('Person', {
name: DataTypes.STRING,
bool: {
type: DataTypes.BOOLEAN,
defaultValue: false,
},
})
.then((queryInterface, Sequelize) => {
queryInterface.addIndex('Person', ['name', 'bool'], {
type: 'UNIQUE',
where: { bool: 'true' },
});
});
},
down: queryInterface => {
return queryInterface.dropTable('Person');
},
};
Running Migrations
Until this step, we haven't inserted anything into the database. We have just created the required model and migration files for our first model, User
. Now to actually create that table in the database you need to run db:migrate
command.
# using npm
npx sequelize-cli db:migrate
# using yarn
yarn sequelize-cli db:migrate
This command will execute these steps:
- Will ensure a table called
SequelizeMeta
in the database. This table is used to record which migrations have run on the current database - Start looking for any migration files that haven't run yet. This is possible by checking
SequelizeMeta
table. In this case, it will runXXXXXXXXXXXXXX-create-user.js
migration, which we created in the last step. - Creates a table called
Users
with all columns as specified in its migration file.
Undoing Migrations
Now our table has been created and saved in the database. With migration, you can revert to the old state by just running a command.
You can use db:migrate:undo
, this command will revert the most recent migration.
# using npm
npx sequelize-cli db:migrate:undo
# using yarn
yarn sequelize-cli db:migrate:undo
You can revert to the initial state by undoing all migrations with the db:migrate:undo:all
command. You can also revert to a specific migration by passing its name with the --to
option.
# using npm
npx sequelize-cli db:migrate:undo:all --to XXXXXXXXXXXXXX-create-posts.js
# using yarn
yarn sequelize-cli db:migrate:undo:all --to XXXXXXXXXXXXXX-create-posts.js
Creating the first Seed
Suppose we want to insert some data into a few tables by default. If we follow up on the previous example we can consider creating a demo user for the User
table.
To manage all data migrations you can use seeders. Seed files are some changes in data that can be used to populate database tables with sample or test data.
Let's create a seed file that will add a demo user to our User
table.
# using npm
npx sequelize-cli seed:generate --name demo-user
# using yarn
yarn sequelize-cli seed:generate --name demo-user
This command will create a seed file in seeders
folder. The file name will look something like XXXXXXXXXXXXXX-demo-user.js
. It follows the same up / down
semantics as the migration files.
Now we should edit this file to insert the demo user to User
table.
module.exports = {
up: (queryInterface, Sequelize) => {
return queryInterface.bulkInsert('Users', [
{
firstName: 'John',
lastName: 'Doe',
email: '[email protected]',
createdAt: new Date(),
updatedAt: new Date(),
},
]);
},
down: (queryInterface, Sequelize) => {
return queryInterface.bulkDelete('Users', null, {});
},
};
Running Seeds
In last step you created a seed file; however, it has not been committed to the database. To do that we run a simple command.
# using npm
npx sequelize-cli db:seed:all
# using yarn
yarn sequelize-cli db:seed:all
This will execute that seed file and a demo user will be inserted into the User
table.
Note: Seeder execution history is not stored anywhere, unlike migrations, which use the SequelizeMeta
table. If you wish to change this behavior, please read the Storage
section.
Undoing Seeds
Seeders can be undone if they are using any storage. There are two commands available for that:
If you wish to undo the most recent seed:
# using npm
npx sequelize-cli db:seed:undo
# using yarn
yarn sequelize-cli db:seed:undo
If you wish to undo a specific seed:
# using npm
npx sequelize-cli db:seed:undo --seed name-of-seed-as-in-data
# using yarn
yarn sequelize-cli db:seed:undo --seed name-of-seed-as-in-data
If you wish to undo all seeds:
# using npm
npx sequelize-cli db:seed:undo:all
# using yarn
yarn sequelize-cli db:seed:undo:all
The .sequelizerc
file
This is a special configuration file. It lets you specify the following options that you would usually pass as arguments to CLI:
env
: The environment to run the command inconfig
: The path to the config fileoptions-path
: The path to a JSON file with additional optionsmigrations-path
: The path to the migrations folderseeders-path
: The path to the seeders foldermodels-path
: The path to the models folderurl
: The database connection string to use. Alternative to using --config filesdebug
: When available show various debug information
Some scenarios where you can use it:
- You want to override default path to
migrations
,models
,seeders
orconfig
folder. - You want to rename
config.json
to something else likedatabase.json
And a whole lot more. Let's see how you can use this file for custom configuration.
To begin, let's create the .sequelizerc
file in the root directory of your project, with the following content:
// .sequelizerc
const path = require('path');
module.exports = {
config: path.resolve('config', 'database.json'),
'models-path': path.resolve('db', 'models'),
'seeders-path': path.resolve('db', 'seeders'),
'migrations-path': path.resolve('db', 'migrations'),
};
With this config, you are telling the CLI to:
- Use
config/database.json
file for config settings; - Use
db/models
as models folder; - Use
db/seeders
as seeders folder; - Use
db/migrations
as the migrations folder.
Dynamic configuration
The configuration file is by default a JSON file called config.json
. But sometimes you need a dynamic configuration, for example, to access environment variables or execute some other code to determine the configuration.
Thankfully, the Sequelize CLI can read from both .json
and .js
files. This can be set up with .sequelizerc
file. You just have to provide the path to your .js
file as the config
option of your exported object:
const path = require('path');
module.exports = {
config: path.resolve('config', 'config.js'),
};
Now the Sequelize CLI will load config/config.js
for getting configuration options.
An example of config/config.js
file:
const fs = require('fs');
module.exports = {
development: {
username: 'database_dev',
password: 'database_dev',
database: 'database_dev',
host: '127.0.0.1',
port: 3306,
dialect: 'mysql',
dialectOptions: {
bigNumberStrings: true,
},
},
test: {
username: process.env.CI_DB_USERNAME,
password: process.env.CI_DB_PASSWORD,
database: process.env.CI_DB_NAME,
host: '127.0.0.1',
port: 3306,
dialect: 'mysql',
dialectOptions: {
bigNumberStrings: true,
},
},
production: {
username: process.env.PROD_DB_USERNAME,
password: process.env.PROD_DB_PASSWORD,
database: process.env.PROD_DB_NAME,
host: process.env.PROD_DB_HOSTNAME,
port: process.env.PROD_DB_PORT,
dialect: 'mysql',
dialectOptions: {
bigNumberStrings: true,
ssl: {
ca: fs.readFileSync(__dirname + '/mysql-ca-main.crt'),
},
},
},
};
The example above also shows how to add custom dialect options to the configuration.
Using Babel
To enable more modern constructions in your migrations and seeders, you can simply install babel-register
and require it at the beginning of .sequelizerc
:
# using npm
npm i --save-dev babel-register
# using yarn
yarn add babel-register --dev
// .sequelizerc
require('babel-register');
const path = require('path');
module.exports = {
config: path.resolve('config', 'config.json'),
'models-path': path.resolve('models'),
'seeders-path': path.resolve('seeders'),
'migrations-path': path.resolve('migrations'),
};
Of course, the outcome will depend upon your babel configuration (such as in a .babelrc
file). Learn more at babeljs.io.
Security tip
Use environment variables for config settings. This is because secrets such as passwords should never be part of the source code (and especially not committed to version control).
Storage
There are three types of storage that you can use: sequelize
, json
, and none
.
sequelize
: stores migrations and seeds in a table on the sequelize databasejson
: stores migrations and seeds on a json filenone
: does not store any migration/seed
Migration Storage
By default, the CLI will create a table in your database called SequelizeMeta
containing an entry for each executed migration. To change this behavior, there are three options you can add to the configuration file. Using migrationStorage
, you can choose the type of storage to be used for migrations. If you choose json
, you can specify the path of the file using migrationStoragePath
or the CLI will write to the file sequelize-meta.json
. If you want to keep the information in the database, using sequelize
, but want to use a different table, you can change the table name using migrationStorageTableName
. Also, you can define a different schema for the SequelizeMeta
table by providing the migrationStorageTableSchema
property.
{
"development": {
"username": "root",
"password": null,
"database": "database_development",
"host": "127.0.0.1",
"dialect": "mysql",
// Use a different storage type. Default: sequelize
"migrationStorage": "json",
// Use a different file name. Default: sequelize-meta.json
"migrationStoragePath": "sequelizeMeta.json",
// Use a different table name. Default: SequelizeMeta
"migrationStorageTableName": "sequelize_meta",
// Use a different schema for the SequelizeMeta table
"migrationStorageTableSchema": "custom_schema"
}
}
Note: The none
storage is not recommended as a migration storage. If you decide to use it, be aware of the implications of having no record of what migrations did or didn't run.
Seed Storage
By default, the CLI will not save any seed that is executed. If you choose to change this behavior (!), you can use seederStorage
in the configuration file to change the storage type. If you choose json
, you can specify the path of the file using seederStoragePath
or the CLI will write to the file sequelize-data.json
. If you want to keep the information in the database, using sequelize
, you can specify the table name using seederStorageTableName
, or it will default to SequelizeData
.
{
"development": {
"username": "root",
"password": null,
"database": "database_development",
"host": "127.0.0.1",
"dialect": "mysql",
// Use a different storage. Default: none
"seederStorage": "json",
// Use a different file name. Default: sequelize-data.json
"seederStoragePath": "sequelizeData.json",
// Use a different table name. Default: SequelizeData
"seederStorageTableName": "sequelize_data"
}
}
Configuration Connection String
As an alternative to the --config
option with configuration files defining your database, you can use the --url
option to pass in a connection string. For example:
# using npm
npx sequelize-cli db:migrate --url 'mysql://root:password@mysql_host.com/database_name'
# using yarn
yarn sequelize-cli db:migrate --url 'mysql://root:password@mysql_host.com/database_name'
If utilizing package.json
scripts with npm, make sure to use the extra --
in your command when using flags.
For example:
// package.json
...
"scripts": {
"migrate:up": "npx sequelize-cli db:migrate",
"migrate:undo": "npx sequelize-cli db:migrate:undo"
},
...
Use the command like so: npm run migrage:up -- --url <url>
Programmatic usage
Sequelize has a sister library called umzug for programmatically handling execution and logging of migration tasks.