Skip to content

TypeScript builder for GitLab CI/CD pipelines. Generate, visualize, and manage .gitlab-ci.yml configurations programmatically with a fluent API.

License

Notifications You must be signed in to change notification settings

noxify/gitlab-ci-builder

Repository files navigation

gitlab-ci-builder

A TypeScript utility for programmatically building GitLab CI YAML configurations.

This project provides a fluent ConfigBuilder API to compose GitLab pipelines in code and output a YAML-serializable JavaScript object. It focuses on strong TypeScript types, proper extends resolution, and a simple builder surface.

Features

  • Fluent TypeScript API to declare stages, jobs, templates, variables and include entries
  • Child pipeline support: Define and manage child pipelines programmatically with callback-based API
  • Multi-file output: Generate parent and child pipeline YAML files with writeYamlFiles()
  • Command-line interface: Visualize pipelines directly from the terminal with gitlab-ci-builder visualize
  • Import existing YAML: Convert .gitlab-ci.yml files to TypeScript code using the builder API
  • Export to YAML: Generate properly formatted YAML with customizable key ordering and spacing
  • Robust extends resolution: Proper topological sorting, cycle detection, and merge strategies
  • Visualization tools: Generate Mermaid diagrams, ASCII trees, and stage tables to visualize pipeline structure (including child pipelines)
  • Authentication support: Access private repositories and includes with GitLab tokens
  • Supports reusable template jobs (hidden jobs starting with .) with deep-merge semantics
  • Dynamic TypeScript-based includes: import other files and apply their configuration functions
  • Small and dependency-light implementation

Limitations

This builder focuses on composing and generating GitLab CI configurations programmatically. It is not a replacement for GitLab's CI/CD execution engine. Here's what it cannot do:

  • Execute pipelines: This library generates YAML configurations; it does not run jobs, scripts, or pipelines
  • Validate GitLab-specific runtime behavior: While it validates schema structure, it cannot check runtime requirements like Docker availability, GitLab Runner setup, or environment-specific constraints
  • Access GitLab API for live data: The library works with static configuration files and does not interact with GitLab's API to fetch live pipeline status, variables, or runner information
  • Resolve complex variable interpolations: GitLab CI supports advanced variable expansion and substitution at runtime; this builder only handles static variable definitions
  • Handle all YAML edge cases: While it supports most GitLab CI features, some advanced YAML constructs or GitLab-specific behaviors might not be fully supported
  • Replace GitLab CI/CD: This is a development tool for building configurations, not an alternative CI/CD platform

Use this library when you want to:

  • Generate GitLab CI YAML programmatically with TypeScript
  • Maintain large, complex pipeline configurations with code reuse
  • Visualize and document pipeline structures
  • Convert between YAML and TypeScript representations
  • Validate configuration structure before committing

Do not use this library when you need to:

  • Execute actual CI/CD pipelines (use GitLab CI/CD for that)
  • Interact with GitLab's runtime environment or API
  • Validate runtime-specific requirements

Installation

pnpm add @noxify/gitlab-ci-builder

Quick Start

Basic usage: create a ConfigBuilder, add jobs and produce a plain object that can be serialized to YAML.

import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder()
  .stages("build", "test", "deploy")
  .variable("NODE_ENV", "production")
  .include({ local: "./common.yml" })

// Template job (hidden)
config.template(".base", { image: "node:18" })

config.extends(".base", "unittest", {
  stage: "test",
  script: ["npm run test"],
})

config.job("build", {
  stage: "build",
  script: ["npm ci", "npm run build"],
})

const plain = config.getPlainObject()
console.log(JSON.stringify(plain, null, 2))

Command-Line Interface

The gitlab-ci-builder CLI provides tools for visualizing GitLab CI pipeline structure directly from the terminal.

Installation

The CLI is included with the package:

pnpm add @noxify/gitlab-ci-builder

Or install globally:

pnpm add -g @noxify/gitlab-ci-builder

Visualize Command

Generate visual representations of your pipeline structure:

# Visualize a local file (all formats)
gitlab-ci-builder visualize .gitlab-ci.yml

# Visualize a remote file with authentication
gitlab-ci-builder visualize https://gitlab.com/group/project/-/raw/main/.gitlab-ci.yml -t glpat-xxxx

# Generate only Mermaid diagram
gitlab-ci-builder visualize .gitlab-ci.yml -f mermaid

# Use environment variables for authentication
export GITLAB_TOKEN=glpat-xxxxxxxxxxxx
export GITLAB_HOST=gitlab.company.com
gitlab-ci-builder visualize https://gitlab.company.com/project/.gitlab-ci.yml

# Self-hosted GitLab instance
gitlab-ci-builder visualize pipeline.yml --host gitlab.company.com -t <token>

Options:

  • -f, --format <format> - Output format: mermaid, ascii, table, all (default: all)
  • --show-stages - Show stage information (default: true)
  • --show-remotes - Show remote template sources (default: true)
  • -t, --token <token> - Authentication token for private repositories (or use GITLAB_TOKEN env var)
  • --host <host> - GitLab host for project/template includes (default: gitlab.com, or use GITLAB_HOST env var)
  • -h, --help - Display help information
  • -v, --version - Display version number

Examples:

# ASCII tree only
gitlab-ci-builder visualize .gitlab-ci.yml -f ascii

# Table view without remote indicators
gitlab-ci-builder visualize .gitlab-ci.yml -f table --show-remotes=false

# Private repository with token
gitlab-ci-builder visualize https://gitlab.com/private/repo/-/raw/main/.gitlab-ci.yml \
  -t glpat-xxxxxxxxxxxx

# Self-hosted GitLab with project includes
gitlab-ci-builder visualize pipeline.yml \
  --host gitlab.company.com \
  -t glpat-xxxxxxxxxxxx

Note: The token is used for:

  • Fetching remote YAML files from private repositories
  • Resolving project: includes recursively
  • Resolving remote: includes to private URLs
  • Accessing GitLab CI/CD templates from private instances

Simulate Command

Simulate GitLab CI pipeline execution to see which jobs would run based on variables and rules:

# Simulate a local pipeline
gitlab-ci-builder simulate .gitlab-ci.yml

# Simulate for a specific branch
gitlab-ci-builder simulate .gitlab-ci.yml -b main

# Simulate with custom variables
gitlab-ci-builder simulate .gitlab-ci.yml -v CI_COMMIT_BRANCH=main -v DEPLOY_ENV=production

# Simulate a merge request pipeline
gitlab-ci-builder simulate .gitlab-ci.yml --mr -b feature-123

# Output as JSON for further processing
gitlab-ci-builder simulate .gitlab-ci.yml -f json > simulation.json

# Show skipped jobs and verbose rule evaluation
gitlab-ci-builder simulate .gitlab-ci.yml -b develop --show-skipped --verbose

Options:

  • -v, --variable <key=value...> - Set pipeline variables (can be used multiple times)
  • -b, --branch <branch> - Simulate for specific branch (sets CI_COMMIT_BRANCH)
  • --tag <tag> - Simulate for specific tag (sets CI_COMMIT_TAG)
  • --mr - Simulate merge request pipeline (sets CI_MERGE_REQUEST_ID)
  • --mr-labels <labels...> - Merge request labels (comma-separated)
  • -f, --format <format> - Output format: summary, text, json, yaml, table (default: summary)
  • --show-skipped - Show skipped jobs in output (default: false)
  • --verbose - Verbose output with detailed rule evaluation (default: false)
  • -t, --token <token> - Authentication token for private repositories (or use GITLAB_TOKEN env var)
  • --host <host> - GitLab host for project/template includes (default: gitlab.com, or use GITLAB_HOST env var)
  • -h, --help - Display help information

Predefined Variables:

The simulator automatically sets GitLab CI predefined variables based on the provided options. These can be overridden using the -v flag:

Variable Set by Default Value Description
CI_COMMIT_BRANCH -b, --branch undefined Branch name being built
CI_COMMIT_REF_NAME -b, --branch or --tag undefined Branch or tag name
CI_COMMIT_REF_SLUG -b, --branch or --tag Slugified ref name URL-safe version of ref name
CI_COMMIT_TAG --tag undefined Tag name if building a tag
CI_MERGE_REQUEST_ID --mr "1" Merge request ID
CI_MERGE_REQUEST_IID --mr "1" Project-level MR ID
CI_MERGE_REQUEST_LABELS --mr-labels "" Comma-separated MR labels
CI_PIPELINE_SOURCE --mr "merge_request_event" or "push" What triggered the pipeline
CI_DEFAULT_BRANCH Always set "main" Default branch of the project

Examples:

# Branch simulation - sets CI_COMMIT_BRANCH, CI_COMMIT_REF_NAME, CI_COMMIT_REF_SLUG
gitlab-ci-builder simulate .gitlab-ci.yml -b develop

# Override default branch
gitlab-ci-builder simulate .gitlab-ci.yml -b main -v CI_DEFAULT_BRANCH=master

# Tag simulation - sets CI_COMMIT_TAG, CI_COMMIT_REF_NAME, CI_COMMIT_REF_SLUG
gitlab-ci-builder simulate .gitlab-ci.yml --tag v1.0.0

# MR simulation - sets CI_MERGE_REQUEST_ID, CI_MERGE_REQUEST_IID, CI_PIPELINE_SOURCE
gitlab-ci-builder simulate .gitlab-ci.yml --mr -b feature-branch

# MR with labels - sets CI_MERGE_REQUEST_LABELS
gitlab-ci-builder simulate .gitlab-ci.yml --mr --mr-labels "bug,critical"

# Override predefined variables
gitlab-ci-builder simulate .gitlab-ci.yml -b main \
  -v CI_COMMIT_BRANCH=custom-branch \
  -v CI_PIPELINE_SOURCE=web

Note: Variables set via -v always take precedence over automatically set values. This allows you to test edge cases or override defaults.

Additional Examples:

# Custom variables alongside automatic ones
gitlab-ci-builder simulate .gitlab-ci.yml -b main \
  -v DEPLOY_ENV=staging \
  -v AWS_REGION=eu-central-1

# Test specific rule conditions
gitlab-ci-builder simulate .gitlab-ci.yml \
  -v CI_COMMIT_BRANCH=main \
  -v CI_PIPELINE_SOURCE=schedule

# Table format with skipped jobs
gitlab-ci-builder simulate .gitlab-ci.yml -f table \
  -b develop \
  --show-skipped

# Remote pipeline with authentication
gitlab-ci-builder simulate https://gitlab.com/org/repo/-/raw/main/.gitlab-ci.yml \
  -t glpat-xxxx \
  -b main

Output Formats:

  • summary (default): Clean overview with job counts and stage breakdown
  • text: Detailed text format with full job information
  • table: ASCII table with job status and stage information
  • json: Machine-readable JSON for further processing
  • yaml: YAML format compatible with GitLab CI syntax

Example Output:

$ gitlab-ci-builder simulate .gitlab-ci.yml -b main

📊 Pipeline Simulation Result

════════════════════════════════════════════════════════════
Total Jobs:    5
Will Run:      3
  - Automatic: 2
  - Manual:    1
Will Skip:     2

📋 Stages:
────────────────────────────────────────────────────────────
  build: 1 job(s)
  test: 1 job(s)
  deploy: 1 job(s)

🔧 Jobs:
────────────────────────────────────────────────────────────
  ▶ build-app (build)
  ▶ test-app (test)
  ⚙ deploy-prod (deploy) - Manual

All visualization formats show:

  • Job inheritance chains (extends relationships)
  • Stage assignments
  • Remote job/template indicators (🌐)
  • Template markers ([T])

Error Handling & Remote Includes

Remote Include Failures:

When remote or project includes cannot be resolved, the behavior differs between visualize and simulate:

  • visualize command: Logs a warning to stderr and continues without the failed include

    ⚠️  Could not fetch remote include: https://example.com/missing.yml (404 Not Found)

    The visualization will show jobs from successfully resolved includes. Missing remote templates will appear as broken references.

  • simulate command: Logs a warning and continues simulation with available jobs

    ⚠️  Could not fetch remote include: https://example.com/templates/base.yml (Network error)

    Jobs extending missing remote templates may have incomplete configurations.

  • project: includes: Throw an error and halt execution if authentication fails or path is invalid

    Error: Failed to fetch project include: https://gitlab.com/org/project/-/raw/main/templates/ci.yml

Authentication Tips:

  • Use GITLAB_TOKEN environment variable to avoid exposing tokens in command history
  • For self-hosted GitLab, always set --host or GITLAB_HOST
  • Project includes require PRIVATE-TOKEN header (automatically set with -t)
  • Remote includes use Authorization: Bearer header

Example with error handling:

# Set token via environment variable (recommended)
export GITLAB_TOKEN=glpat-xxxxxxxxxxxx
export GITLAB_HOST=gitlab.company.com

# Visualize with potential remote include failures
gitlab-ci-builder visualize pipeline.yml 2> errors.log

# Check if any includes failed
if grep -q "Could not fetch" errors.log; then
  echo "⚠️  Some remote includes failed to load"
fi

Import & Export

Exporting to YAML

Convert your ConfigBuilder to a properly formatted YAML file:

import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder().stages("build", "test").job("build", {
  stage: "build",
  script: ["npm run build"],
})

// Convert to YAML string
const yamlString = config.toYaml()
console.log(yamlString)

// Or write directly to a file
await config.writeYamlFile(".gitlab-ci.yml")

The YAML output features:

  • Logical key ordering (workflow, include, default, variables, stages, then jobs)
  • Templates listed before regular jobs
  • Blank lines between top-level sections for readability
  • Empty sections automatically omitted

Importing from YAML

Convert existing .gitlab-ci.yml files to TypeScript code:

import { fromYaml, importYamlFile } from "@noxify/gitlab-ci-builder"

// Convert YAML string to TypeScript code
const yamlContent = `
stages:
  - build
  - test

.base:
  image: node:22

build:
  extends: .base
  stage: build
  script:
    - npm run build
`

const tsCode = fromYaml(yamlContent)
console.log(tsCode)
// Output:
// import { ConfigBuilder } from "@noxify/gitlab-ci-builder"
//
// const config = new ConfigBuilder()
//
// config.stages("build", "test")
//
// config.template(".base", {
//   image: "node:22",
// })
//
// config.job("build", {
//   extends: ".base",
//   stage: "build",
//   script: ["npm run build"],
// })
//
// export default config

// Or import from file and optionally write to TypeScript file
await importYamlFile(".gitlab-ci.yml", "gitlab-ci.config.ts")

This enables easy migration from YAML to TypeScript-based configurations.

YAML Anchor Handling & Extends

The import functionality handles both GitLab CI's native extends keyword and YAML anchors/aliases:

Using extends (Recommended)

When your YAML uses GitLab's extends keyword, the import preserves the reference:

.base:
  image: node:22
  tags:
    - docker

build:
  extends: .base # GitLab CI extends
  script:
    - npm run build

Generated output uses extends property:

config.template(".base", {
  image: "node:22",
  tags: ["docker"],
})

config.job("build", {
  extends: ".base", // Preserved!
  script: ["npm run build"],
})

// Or use the extends() helper method:
config.extends(".base", "build", {
  script: ["npm run build"],
})

Both approaches produce equivalent output. The extends() helper is more concise when you want to explicitly show the inheritance relationship.

Using YAML Anchors & Merges

When using YAML merge operators (<<: *anchor), values are resolved and inlined:

  • Anchor definitions (&anchor_name) containing only primitive values (arrays, strings) are filtered out
  • References (*anchor_name) and merges (<<: *anchor_name) are resolved by the YAML parser and inlined
  • Only anchor definitions that are valid job/template objects are included as templates
.tags_test: &tags_test # Filtered out (array-only anchor)
  - test1
  - test2

.base: &base_config # Included (valid template)
  image: node:22
  tags:
    - docker

build:
  <<: *base_config # Values merged inline
  tags: *tags_test # Reference resolved
  script:
    - npm run build

Generated output has resolved values:

config.template(".base", {
  image: "node:22",
  tags: ["docker"],
})

config.job("build", {
  image: "node:22", // Inlined from .base
  tags: ["test1", "test2"], // Resolved from .tags_test
  script: ["npm run build"],
})

Recommendation: Use GitLab's extends keyword instead of YAML merge operators to maintain clearer relationships in the generated TypeScript code.

Dynamic TypeScript Includes

The dynamicInclude method allows you to modularize your GitLab CI configuration by splitting it across multiple TypeScript files. Each included file can export a configuration function that receives the main ConfigBuilder instance.

Basic Usage

import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder()

// Include all config files from a directory
await config.dynamicInclude(process.cwd(), ["configs/**/*.ts"])

console.log(config.getPlainObject())

Creating Included Config Files

Included files can use either a default export (preferred) or a named extendConfig export. The exported function receives the ConfigBuilder instance, mutates it, and returns it for consistency with the fluent API.

Option 1: Default Export (Recommended)

// configs/build-jobs.ts
import type { ConfigBuilder } from "@noxify/gitlab-ci-builder"

export default function (config: ConfigBuilder) {

export default function (config: Config) {
  // Mutate the config instance directly
  config.stages("build")

  config.template(".node-base", {
    image: "node:22",
    before_script: ["npm ci"],
  })

  config.extends(".node-base", "build", {
    stage: "build",
    script: ["npm run build"],
  })

  return config
}

Option 2: Named Export

// configs/test-jobs.ts
import type { ConfigBuilder } from "@noxify/gitlab-ci-builder"

export function extendConfig(config: ConfigBuilder) {
  config.stages("test")

  config.job("unit-test", {
    stage: "test",
    script: ["npm run test:unit"],
  })

  config.job("integration-test", {
    stage: "test",
    script: ["npm run test:integration"],
  })

  return config
}

Complete Example

Main configuration file:

// build-pipeline.ts
import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

async function main() {
  const config = new ConfigBuilder()

  // Set up base configuration
  config.stages("prepare", "build", "test", "deploy")
  config.variable("DOCKER_DRIVER", "overlay2")

  // Include additional configurations from separate files
  await config.dynamicInclude(process.cwd(), [
    "configs/build-jobs.ts",
    "configs/test-jobs.ts",
    "configs/deploy-jobs.ts",
  ])

  // Write the final pipeline configuration
  await config.writeYamlFile(".gitlab-ci.yml")
}

main()

Separate config files:

// configs/deploy-jobs.ts
import type { ConfigBuilder } from "@noxify/gitlab-ci-builder"

export default function (config: ConfigBuilder) {
  config.job("deploy-staging", {
    stage: "deploy",
    script: ["kubectl apply -f k8s/staging/"],
    environment: { name: "staging" },
    only: { refs: ["develop"] },
  })

  config.job("deploy-production", {
    stage: "deploy",
    script: ["kubectl apply -f k8s/production/"],
    environment: { name: "production" },
    only: { refs: ["main"] },
    when: "manual",
  })

  return config
}

Benefits

  • Modularity: Split large pipelines into focused, manageable files
  • Reusability: Share common job configurations across multiple pipelines
  • Team collaboration: Different teams can maintain their own config files
  • Type safety: Full TypeScript support with autocomplete and type checking

Note: If both default and named exports are present, the default export takes precedence.

Child Pipelines

Define child pipelines programmatically using a callback-based API. This eliminates the need to manually manage separate YAML files and automatically generates the trigger jobs.

Basic Example

import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder().stages("build", "test", "deploy").job("build", {
  stage: "build",
  script: ["npm run build"],
})

// Define a child pipeline with callback
config.childPipeline("security-scan", (child) => {
  child.stages("scan", "report")
  child.job("sast", {
    stage: "scan",
    script: ["npm audit", "npm run security-scan"],
  })
  child.job("report", {
    stage: "report",
    script: ["npm run generate-report"],
  })
})

// Write parent and all child pipeline files
const files = await config.writeYamlFiles("./pipelines")
// Returns: { parent: "pipelines/.gitlab-ci.yml", children: ["pipelines/security-scan-pipeline.yml"] }

Advanced Configuration

Customize child pipeline behavior with options:

config.childPipeline(
  "deploy-environments",
  (child) => {
    child.stages("dev", "staging", "prod")
    child.job("deploy-dev", {
      stage: "dev",
      script: ["deploy.sh dev"],
    })
    child.job("deploy-staging", {
      stage: "staging",
      script: ["deploy.sh staging"],
      when: "manual",
    })
    child.job("deploy-prod", {
      stage: "prod",
      script: ["deploy.sh production"],
      when: "manual",
    })
  },
  {
    // Custom output path for child pipeline YAML
    outputPath: "pipelines/deploy.yml",

    // Strategy for parent pipeline to wait for child
    strategy: "depend", // or "mirror"

    // Forward variables to child pipeline
    forward: {
      pipelineVariables: true,
      yamlVariables: ["CI_ENVIRONMENT", "DEPLOY_TOKEN"],
    },

    // Additional trigger job options
    jobOptions: {
      stage: "deploy",
      rules: [{ if: "$CI_COMMIT_BRANCH == $CI_DEFAULT_BRANCH" }],
    },
  },
)

Dynamic Child Pipelines

Generate child pipelines dynamically based on runtime conditions:

interface Application {
  name: string
  enabled: boolean
  scanType: string
}

const applications: Application[] = [
  { name: "web-app", enabled: true, scanType: "sast" },
  { name: "api-service", enabled: true, scanType: "dast" },
  { name: "mobile-app", enabled: false, scanType: "sast" },
]

const config = new ConfigBuilder().stages("scan")

// Generate child pipelines for enabled applications only
applications
  .filter((app) => app.enabled)
  .forEach((app) => {
    config.childPipeline(`scan-${app.name}`, (child) => {
      child.stages("prepare", "scan", "report")
      child.job(`${app.scanType}-scan`, {
        stage: "scan",
        script: [`run-${app.scanType}-scan.sh ${app.name}`],
      })
      child.job("upload-results", {
        stage: "report",
        script: ["upload-results.sh"],
        artifacts: { reports: { [app.scanType]: "results.json" } },
      })
    })
  })

Accessing Child Pipelines

Retrieve child pipeline configurations programmatically:

// Get specific child pipeline
const childConfig = config.getChildPipeline("security-scan")
if (childConfig) {
  console.log(childConfig.jobs) // Access jobs map
  console.log(childConfig.stages) // Access stages array
}

// Access all child pipelines
const allChildren = config.childPipelines
allChildren.forEach(([name, child]) => {
  console.log(`Child: ${name}, Jobs: ${child.builder.jobs.size}`)
})

Visualization Integration

Child pipelines are automatically included in all visualization formats:

// Mermaid diagram shows child pipelines as subgraphs
const mermaid = config.generateMermaidDiagram()

// ASCII tree shows child pipelines with 🔀 indicator
const ascii = config.generateAsciiTree()

// Stage table separates child pipelines with headers
const table = config.generateStageTable()

Visualization

The builder provides powerful visualization tools to help understand and document your pipeline structure. You can generate Mermaid diagrams, ASCII trees, and stage tables that show job relationships, inheritance chains, and stage organization.

Available Visualizations

All visualization functions accept a unified parameter object with:

  • graph: The extends graph containing job metadata
  • resolvedConfig: The resolved pipeline configuration with job definitions
  • options: Visualization options (optional)

Mermaid Diagrams

Generate Mermaid flowchart diagrams showing job relationships and inheritance:

import { ConfigBuilder } from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder()
  .stages("build", "test", "deploy")
  .template(".base", { image: "node:22" })
  .extends(".base", "build", { stage: "build", script: ["npm run build"] })
  .extends(".base", "test", { stage: "test", script: ["npm test"] })

const mermaid = config.generateMermaidDiagram({
  showStages: true,
  showRemote: true,
})

console.log(mermaid)

Output:

---
config:
  layout: elk
---
graph LR
  classDef template fill:#e1f5ff,stroke:#0366d6
  classDef job fill:#fff5e1,stroke:#fb8500
  classDef remote fill:#ffe1f5,stroke:#c026d3

  subgraph Templates
    n1[".build_template"]:::template
    n2[".base"]:::template
    n4[".test_template"]:::template
  end

  subgraph "build"
    n0["build"]:::job
  end

  subgraph "test"
    n3["test"]:::job
  end

  n0 --> n1
  n1 --> n2
  n3 --> n4
  n4 --> n2
Loading

ASCII Trees

Generate hierarchical ASCII tree views of job inheritance using oo-ascii-tree for clean, professional box-drawing characters:

const ascii = config.generateAsciiTree({
  showStages: true,
  showRemote: true,
})

console.log(ascii)

Output:

build (build)
 └─┬ .build_template [T]
   └── .base [T]
test (test)
 └─┬ .test_template [T]
   └── .base [T]

The ASCII tree uses Unicode box-drawing characters for a clean, readable hierarchy that works great in terminal output and documentation.

Stage Tables

Generate formatted tables using climt showing jobs with their full inheritance chains:

const table = config.generateStageTable({
  showRemote: true,
})

console.log(table)

Output:

┌───────┬────────────────────────────────────────────┐
│ STAGE │ JOB                                        │
├───────┼────────────────────────────────────────────┤
│ build │ build-frontend ← .build_template ← .base   │
│ build │ build-backend ← .build_template ← .base    │
│ test  │ test-unit ← .test_template ← .base         │
│ test  │ test-e2e ← .test_template ← .base          │
└───────┴────────────────────────────────────────────┘

The table shows one job per row with its complete extends chain, making it easy to understand the full inheritance hierarchy at a glance.

Visualization Options

All visualization methods accept optional configuration:

interface VisualizationOptions {
  showRemote?: boolean // Show remote jobs/templates with 🌐 indicator
  showStages?: boolean // Show stage information in output
  highlightCycles?: boolean // Highlight circular dependencies (future)
}

Using Visualization Functions Directly

You can also use the visualization functions directly with the extends graph and resolved config:

import {
  ConfigBuilder,
  generateAsciiTree,
  generateMermaidDiagram,
  generateStageTable,
} from "@noxify/gitlab-ci-builder"

const config = new ConfigBuilder()
// ... configure jobs ...

const graph = config.getExtendsGraph()
const resolvedConfig = config.getPlainObject({ skipValidation: true })

// Generate visualizations
const mermaid = generateMermaidDiagram({
  graph,
  resolvedConfig,
  options: { showStages: true },
})

const ascii = generateAsciiTree({
  graph,
  resolvedConfig,
  options: { showRemote: true },
})

const table = generateStageTable({
  graph,
  resolvedConfig,
  options: { showStages: false },
})

Visualizing YAML with Includes

The visualizeYaml function can parse YAML content and generate visualizations, including support for resolving project: and remote: includes with authentication:

import { visualizeYaml } from "@noxify/gitlab-ci-builder"

const yamlContent = `
include:
  - project: 'my-group/my-project'
    file: '/templates/common.yml'
  - remote: 'https://gitlab.company.com/shared/base.yml'

stages: [build, test, deploy]

build:
  stage: build
  script: npm run build
`

// Visualize with authentication for private includes
const result = await visualizeYaml(yamlContent, {
  format: "mermaid",
  showStages: true,
  showRemotes: true,
  gitlabToken: "glpat-xxxxxxxxxxxx", // For private repositories
  gitlabUrl: "https://gitlab.company.com", // For self-hosted instances
})

console.log(result.mermaid)

// Generate all formats at once
const allFormats = await visualizeYaml(yamlContent, {
  format: "all",
  gitlabToken: process.env.GITLAB_TOKEN,
})

console.log(allFormats.mermaid)
console.log(allFormats.ascii)
console.log(allFormats.table)

Authentication Options:

  • gitlabToken - Authentication token for resolving private project: and remote: includes
  • gitlabUrl - GitLab host URL for project: includes (default: https://gitlab.com)

The token is passed recursively through all include levels, so nested includes in private repositories are also resolved correctly.

Remote Job/Template Indicators

When working with remote includes, jobs and templates can be marked with the 🌐 indicator when showRemote: true:

const config = new ConfigBuilder()
  .template(".remote-base", { image: "alpine" }, { remote: true })
  .extends(".remote-base", "local-job", { script: ["echo hello"] })

const ascii = config.generateAsciiTree({ showRemote: true })
// Output shows: .remote-base [T] 🌐

This helps distinguish between locally-defined and remotely-included configurations when debugging complex pipelines.

Job Options & Global Settings

Job Options

The job(), template(), and extends() methods accept an optional JobOptions object for fine-grained control:

interface JobOptions {
  hidden?: boolean // Mark as template (prefix with dot)
  mergeExisting?: boolean // Merge with existing job/template (default: true)
  mergeExtends?: boolean // Merge extends (default: true)
  resolveTemplatesOnly?: boolean // Only merge templates (names starting with .)
  remote?: boolean // Mark job/template as remote (excluded from merging)
}

Example:

const config = new ConfigBuilder()

// Create a hidden template
config.job("base", { image: "node:22" }, { hidden: true })
// Same as: config.template(".base", { image: "node:22" })

// Replace instead of merge
config.job("build", { stage: "build", script: ["npm run build"] })
config.job("build", { script: ["npm run build:prod"] }, { mergeExisting: false })
// Result: { script: ["npm run build:prod"] } (stage removed)

// Keep extends reference (don't resolve parent)
config.template(".base", { script: ["base command"] })
config.job("child", { extends: ".base" }, { mergeExtends: false })
// Output keeps: extends: ".base"

// Only merge templates, ignore jobs without dot
config.template(".base", { script: ["template"] })
config.job("basejob", { script: ["job"] })
config.job(
  "child",
  { extends: [".base", "basejob"], stage: "test" },
  { resolveTemplatesOnly: true },
)
// Output: script: ["template"], extends removed

// Mark job/template as remote (excluded from merging)
config.job("remote-job", { script: ["do something remote"] }, { remote: true })
config.template(".remote-template", { script: ["remote template"] }, { remote: true })
// These will be ignored during merging and not appear in the output

Global Options

Set default behavior for all jobs using globalOptions(). Job-level options override global settings:

const config = new ConfigBuilder()

// Disable extends merging globally
config.globalOptions({ mergeExtends: false })

// Only merge templates globally
config.globalOptions({ resolveTemplatesOnly: true })

config.template(".base", { script: ["base"] })
config.job("basejob", { script: ["job"] })

// This job keeps extends (global setting)
config.job("job1", { extends: ".base" })
// Output: { extends: ".base" }

// This job merges only templates (global setting)
config.job("job2", { extends: [".base", "basejob"], stage: "test" })
// Output: script: ["base"], extends removed

// This job merges all (local override)
config.job(
  "job3",
  { extends: [".base", "basejob"], stage: "test" },
  { resolveTemplatesOnly: false },
)
// Output: script: ["job", "base"], extends removed

Use Cases:

  • Preserve extends in output: Set mergeExtends: false to keep GitLab CI's native extends keyword instead of inlining parent properties.
  • Strict replacement: Set mergeExisting: false globally to prevent accidental job merging and always replace jobs/templates.
  • Conditional template resolution: Set resolveTemplatesOnly: true to only merge templates (names starting with .), ignoring regular jobs during extends resolution.
  • Remote jobs/templates: Set remote: true on individual jobs or templates to exclude them from merging and output. This is only available at the job/template level. Use this for jobs/templates defined in external includes or that should not be processed locally.
    • Shadow-overrides for remote jobs/templates: If a job or template is marked as remote: true, it will be ignored during merging and output. However, you can locally define a job/template with the same name (without remote: true) to override or "shadow" the remote definition. This allows you to selectively replace or extend remote jobs/templates in your local pipeline configuration.

Common Pitfalls & Best Practices

Stage References

Jobs must reference stages that exist in the pipeline. Undefined stages will cause validation errors:

// ❌ Bad: Job references non-existent stage
const config = new ConfigBuilder()
config.job("build", { stage: "build", script: ["npm run build"] })
// Error: Stage "build" not defined

// ✅ Good: Define stages first
const config = new ConfigBuilder()
  .stages("build", "test", "deploy")
  .job("build", { stage: "build", script: ["npm run build"] })

Template Naming

Templates must start with a dot (.). Without it, they're treated as regular jobs:

// ❌ Bad: Template without leading dot
config.job("base", { image: "node:22" }) // This is a regular job!

// ✅ Good: Use template() or add dot manually
config.template(".base", { image: "node:22" })
// or
config.job(".base", { image: "node:22" })

Extends Resolution Order

The builder resolves extends topologically. Circular dependencies are detected and will throw an error:

// ❌ Bad: Circular dependency
config.template(".a", { extends: ".b" })
config.template(".b", { extends: ".a" })
// Error: Circular dependency detected: .a → .b → .a

// ✅ Good: Linear inheritance chain
config.template(".base", { image: "node:22" })
config.template(".with-cache", { extends: ".base", cache: { paths: ["node_modules"] } })
config.job("build", { extends: ".with-cache", script: ["npm run build"] })

Variable Precedence

Variables are merged with child values overriding parent values:

config.template(".base", {
  variables: { NODE_ENV: "test", DEBUG: "false" },
})

config.job("build", {
  extends: ".base",
  variables: { NODE_ENV: "production" }, // Overrides NODE_ENV, keeps DEBUG
})
// Result: { NODE_ENV: "production", DEBUG: "false" }

Script Array Concatenation

Unlike most properties, scripts are concatenated (not replaced) during merge:

config.template(".base", {
  script: ["npm ci"],
})

config.job("build", {
  extends: ".base",
  script: ["npm run build"],
})
// Result: script: ["npm ci", "npm run build"] ← Both scripts!

To replace instead of concatenate, use mergeExisting: false:

config.job(
  "build",
  {
    extends: ".base",
    script: ["npm run build"],
  },
  { mergeExisting: false },
)
// Result: script: ["npm run build"] ← Only new script

YAML Anchors vs Extends

When importing YAML with anchors, they're resolved and inlined. Use GitLab's extends for clearer TypeScript code:

# ❌ Anchors are resolved during import
.base: &base
  image: node:22

build:
  <<: *base # Values get inlined
  script: [build]
# ✅ Extends are preserved
.base:
  image: node:22

build:
  extends: .base # Reference preserved in TypeScript
  script: [build]

Remote Include Behavior

Jobs/templates from remote includes can be marked as remote: true to exclude them from output:

// Mark remote template as remote (won't appear in output)
config.template(".remote-base", { image: "alpine" }, { remote: true })

// Local job can still extend it
config.job("local-job", {
  extends: ".remote-base",
  script: ["echo 'hello'"],
})
// Output only includes "local-job" with merged properties

Child Pipeline Paths

Child pipeline outputPath must be relative to the parent pipeline location:

// ❌ Bad: Absolute path
config.childPipeline("scan", (child) => { ... }, {
  outputPath: "/absolute/path/scan.yml" // Won't work with GitLab
})

// ✅ Good: Relative path
config.childPipeline("scan", (child) => { ... }, {
  outputPath: "pipelines/scan.yml" // Relative to parent
})

Performance with Large Pipelines

For pipelines with 100+ jobs, consider:

  • Use performanceMode: true in global options to skip expensive validation
  • Break into child pipelines for parallel execution
  • Use resolveTemplatesOnly: true to reduce merge operations
  • Avoid deep extends chains (>5 levels)
// For large pipelines
const config = new ConfigBuilder()
  .globalOptions({ performanceMode: true })
  .stages("build", "test", "deploy")
// ... add many jobs ...

API Reference

This reference summarizes the primary ConfigBuilder API surface. Method signatures reflect the runtime builder and are derived from the JSDoc on the source ConfigBuilder class.

  • new ConfigBuilder()

    • Create a new builder instance.
  • stages(...stages: string[]): ConfigBuilder

    • Add stages to the global stage list. Ensures uniqueness and preserves order.
  • addStage(stage: string): ConfigBuilder

    • Convenience wrapper for adding a single stage.
  • globalOptions(options: GlobalOptions): ConfigBuilder

    • Set global options that apply to all jobs and templates.
    • Options: { mergeExtends?: boolean, mergeExisting?: boolean, resolveTemplatesOnly?: boolean, remote?: boolean }
      • Options: { mergeExtends?: boolean, mergeExisting?: boolean, resolveTemplatesOnly?: boolean }
    • Job-level options override global settings.
  • workflow(workflow: Workflow): ConfigBuilder

    • Set or deep-merge the top-level workflow configuration (typically rules).
  • defaults(defaults: Defaults): ConfigBuilder

    • Set global default job parameters (deep-merged with existing defaults).
  • variable(key: string, value: string | number | boolean | undefined): ConfigBuilder

    • Set a single global variable.
  • variables(vars: Variables): ConfigBuilder

    • Merge multiple global variables at once.
  • getVariable(job: string, key: string): string | number | boolean | undefined

    • Retrieve a variable by checking job-local variables first, then global variables.
  • getJob(name: string): JobDefinition | undefined

    • Look up a job or template definition by name (templates start with .).
  • template(name: string, definition: JobDefinitionInput, options?: JobOptions): ConfigBuilder

    • Define or deep-merge a hidden template job. The stored template name will have a leading ..
    • Options: { mergeExisting?: boolean, mergeExtends?: boolean, resolveTemplatesOnly?: boolean, hidden?: boolean, remote?: boolean }
  • include(items: Include | Include[]): ConfigBuilder

    • Add include entries. Accepts objects or arrays of include definitions.
  • job(name: string, definition: JobDefinitionInput, options?: JobOptions): ConfigBuilder

    • Create or merge a job. If name starts with . or options.hidden is true, the call delegates to template() and ensures a single leading . on the stored template name.
    • Options: { hidden?: boolean, mergeExisting?: boolean, mergeExtends?: boolean, resolveTemplatesOnly?: boolean, remote?: boolean }
  • macro<T extends MacroArgs>(key: string, callback: (config: ConfigBuilder, args: T) => void): void

    • Register a macro function for programmatic job generation.
  • from<T extends MacroArgs>(key: string, args: T): void

    • Invoke a previously registered macro.
  • extends(fromName: string | string[], name: string, job?: JobDefinitionInput, options?: JobOptions): ConfigBuilder

    • Create a job that will extend one or more templates/jobs (injects an extends property).
    • Options: { hidden?: boolean, mergeExisting?: boolean, mergeExtends?: boolean, resolveTemplatesOnly?: boolean, remote?: boolean }
  • dynamicInclude(cwd: string, globs: string[]): Promise<void>

    • Import TypeScript modules matched by the provided globs and call their exported extendConfig.
  • patch(callback: (plain: GitLabCi) => void): void

    • Register a patcher callback that runs on the plain object before it is returned.
  • validate(): void

    • Validate the configuration and throw an error if validation fails. Logs warnings to console.
  • safeValidate(): SafeValidationResult

    • Validate the configuration without throwing. Returns { valid: boolean, errors: ValidationError[], warnings: ValidationError[] }.
  • getPlainObject(options?: { skipValidation?: boolean }): PipelineOutput

    • Return a YAML-serializable pipeline object with resolved extends and applied patchers.
    • By default, validates before returning. Set skipValidation: true to skip validation (e.g., after calling safeValidate()).
  • toJSON(options?: { skipValidation?: boolean }): PipelineOutput

    • Alias for getPlainObject() (useful for JSON.stringify).
  • getExtendsGraph(): Map<string, ExtendsGraphNode>

    • Return the extends graph containing job metadata and relationships.
  • generateMermaidDiagram(options?: VisualizationOptions): string

    • Generate a Mermaid flowchart diagram showing job relationships and inheritance.
    • Options: { showStages?: boolean, showRemote?: boolean, highlightCycles?: boolean }
  • generateAsciiTree(options?: VisualizationOptions): string

    • Generate an ASCII tree view of job inheritance hierarchy.
    • Options: { showStages?: boolean, showRemote?: boolean, highlightCycles?: boolean }
  • generateStageTable(options?: VisualizationOptions): string

    • Generate a tabular view showing jobs organized by stage.
    • Options: { showStages?: boolean, showRemote?: boolean, highlightCycles?: boolean }
  • toYaml(options?: { skipValidation?: boolean }): string

    • Convert the configuration to a formatted YAML string.
  • writeYamlFile(filePath: string): Promise<void>

    • Write the configuration to a YAML file.

Export Functions

  • toYaml(config: PipelineOutput): string

    • Convert a pipeline configuration to a formatted YAML string. Features logical key ordering, blank lines between sections, and proper formatting for readability.
  • writeYamlFile(filePath: string, config: PipelineOutput): Promise<void>

    • Write a pipeline configuration to a YAML file.

Import Functions

  • fromYaml(yamlContent: string): string

    • Convert a GitLab CI YAML string to TypeScript code using the Config builder API. Parses the YAML and generates corresponding TypeScript statements.
  • importYamlFile(yamlPath: string, outputPath?: string): Promise<string>

    • Read a GitLab CI YAML file and convert it to TypeScript code. If outputPath is provided, the generated code is written to that file. Returns the generated TypeScript code.

Visualization Functions

  • generateMermaidDiagram({ graph, resolvedConfig, options? }): string

    • Generate a Mermaid flowchart diagram from an extends graph and resolved configuration.
    • Parameters: { graph: Map<string, ExtendsGraphNode>, resolvedConfig: ResolvedPipelineConfig, options?: VisualizationOptions }
  • generateAsciiTree({ graph, resolvedConfig, options? }): string

    • Generate an ASCII tree view from an extends graph and resolved configuration.
    • Parameters: { graph: Map<string, ExtendsGraphNode>, resolvedConfig: ResolvedPipelineConfig, options?: VisualizationOptions }
  • generateStageTable({ graph, resolvedConfig, options? }): string

    • Generate a stage table from an extends graph and resolved configuration.
    • Parameters: { graph: Map<string, ExtendsGraphNode>, resolvedConfig: ResolvedPipelineConfig, options?: VisualizationOptions }

Testing

The project includes unit tests run via Vitest. Run the test suite with:

pnpm test

Contributing & License

Contributions welcome — open issues or PRs. This repository is published under the same license included in the project root (LICENSE).

Credits

This project is based on and inspired by the following repositories:

Parts of the API and types were adapted from those projects; this repository intentionally focuses on a minimal, typed builder rather than reproducing all runtime behaviors.

Development Notes

Significant portions of this codebase, including the import/export functionality, test coverage improvements, and documentation enhancements, were developed with the assistance of AI (GitHub Copilot / Claude).

While the core architecture and original implementation come from the credited repositories above, many recent additions and refactorings were created through AI-assisted pair programming.