Skip to content
50 changes: 33 additions & 17 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -150,23 +150,39 @@ After the script has completed you can either leave it in place so it will overr
The default deployment initializes a Jenkins server with a [predefined set of
jobs](home/jobs).

The table below lists the job names, the Jenkins node labels and the associated docker
they are associated with and a short description of the jobs.

| Job name | Name | Description | docker name |
| -----------------------|-----------------| ------------------------------------------|----------------------------|
| Trigger | | Runs all the following jobs in order | |
| BIOFORMATS-push | testintegration | Merges all Bio-Formats PRs | devspace-testintegration-1 |
| BIOFORMATS-build | testintegration | Builds Bio-Formats components | devspace-testintegration-1 |
| BIOFORMATS-image | testintegration | Builds a Docker image of Bio-Formats | devspace-docker-1 |
| OMERO-push | testintegration | Merges all OMERO PRs | devspace-testintegration-1 |
| OMERO-build | testintegration | Builds OMERO artifacts (server, clients) | devspace-testintegration-1 |
| OMERO-server | omero | Deploys an OMERO.server | devspace-omero-1 |
| OMERO-web | web | Deploys an OMERO.web client | devspace-web-1 |
| OMERO-test-integration | testintegration | Runs the OMERO integration tests | devspace-testintegration-1 |
| OMERO-robot | testintegration | Runs the Robot tests | devspace-testintegration-1 |
| nginx | nginx | Reloads the nginx server | devspace-nginx-1 |
| OMERO-docs | testintegration | Builds the OMERO documentation | devspace-testintegration-1 |
The table below lists the job names, the Jenkins node labels (Name) and the name of the docker they are associated with and a short description of the jobs.

| Job name | Name | Description | docker name |
|--------------------------------|-----------------|--------------------------------------------------|-------------------------------|
| Trigger | | Runs all the following jobs in order | |
| BIOFORMATS-push | testintegration | Merges all Bio-Formats PRs | devspace-testintegration-1 |
| BIOFORMATS-build | testintegration | Builds Bio-Formats components | devspace-testintegration-1 |
| BIOFORMATS-image | docker | Builds a Docker image of Bio-Formats | devspace-docker-1 |
| BIOFORMATS-linkcheck | docker | Checks links in the Bio-Formats documentation | devspace-docker-1 |
| OMERO-push | testintegration | Merges all OMERO PRs | devspace-testintegration-1 |
| OMERO-build | testintegration | Builds OMERO artifacts (server, clients) | devspace-testintegration-1 |
| OMERO-build-push | testintegration | Pushes OMERO build artifacts | devspace-testintegration-1 |
| OMERO-build-build | testintegration | Builds OMERO build artifacts | devspace-testintegration-1 |
| OMERO-server | omero | Deploys an OMERO.server | devspace-omero-1 |
| OMERO-web | web | Deploys an OMERO.web client | devspace-web-1 |
| OMERO-test-integration | testintegration | Runs the OMERO integration tests | devspace-testintegration-1 |
| OMERO-docs | testintegration | Builds the OMERO documentation | devspace-testintegration-1 |
| OMERO-gradle-plugins-push | testintegration | Pushes OMERO Gradle plugin changes | devspace-testintegration-1 |
| OMERO-gradle-plugins-build | testintegration | Builds OMERO Gradle plugins | devspace-testintegration-1 |
| OMERO-guides-push | testintegration | Pushes OMERO guides changes | devspace-testintegration-1 |
| OMERO-insight-push | testintegration | Pushes OMERO.insight changes | devspace-testintegration-1 |
| OMERO-insight-build | testintegration | Builds OMERO.insight | devspace-testintegration-1 |
| OMERO-matlab-push | testintegration | Pushes OMERO.matlab changes | devspace-testintegration-1 |
| OMERO-matlab-build | testintegration | Builds OMERO.matlab | devspace-testintegration-1 |
| OMERO-plugins-push | testintegration | Pushes OMERO plugin changes | devspace-testintegration-1 |
| OMERO-python-superbuild-push | testintegration | Pushes OMERO Python superbuild changes | devspace-testintegration-1 |
| OMERO-python-superbuild-build | testintegration | Builds the OMERO Python superbuild | devspace-testintegration-1 |
| OMERO-training | omero | Runs OMERO training | devspace-omero-1 |
| OMERO-zarr-pixel-buffer-push | testintegration | Pushes Zarr pixel buffer changes | devspace-testintegration-1 |
| OMERO-zarr-pixel-buffer-build | testintegration | Builds the Zarr pixel buffer | devspace-testintegration-1 |
| IDRSITE-push | testintegration | Pushes IDR website changes | devspace-testintegration-1 |
| WEBSITE-push | testintegration | Pushes OME website changes | devspace-testintegration-1 |
| nginx | nginx | Reloads the nginx server | devspace-nginx-1 |


This means that by default the following repositories need to be
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/BIOFORMATS-build/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,8 @@
<hudson.tasks.Shell>
<command>python3.11 -mvenv venv
source $WORKSPACE/venv/bin/activate

python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
cd bio-formats-build
pip install -r bio-formats-documentation/requirements.txt
pip install -r ome-model/requirements.txt
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/BIOFORMATS-push/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,8 @@
<hudson.tasks.Shell>
<command>python3.11 -mvenv venv
source $WORKSPACE/venv/bin/activate
pip install -U pip
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install -U scc

PATH=$WORKSPACE/bio-formats-build/scripts:$PATH
Expand Down
9 changes: 7 additions & 2 deletions home/jobs/OMERO-build-push/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,14 @@
<definition class="org.jenkinsci.plugins.workflow.cps.CpsFlowDefinition" plugin="workflow-cps@2.64">
<script>node(&apos;testintegration&apos;) {

library identifier: &apos;recursiveMerge@master&apos;, retriever: modernSCM(
// replaced by PW Oct2026 until my PR is merged
// library identifier: &apos;recursiveMerge@master&apos;, retriever: modernSCM(
// [$class: &apos;GitSCMSource&apos;,
// remote: &apos;https://github.com/ome/jenkins-library-recursivemerge.git&apos;])

library identifier: &apos;recursiveMerge@pip-fix&apos;, retriever: modernSCM(
[$class: &apos;GitSCMSource&apos;,
remote: &apos;https://github.com/ome/jenkins-library-recursivemerge.git&apos;])
remote: &apos;https://github.com/pwalczysko/jenkins-library-recursivemerge.git&apos;])

recursiveCheckout(
repo: &apos;omero-build.git&apos;)
Expand Down
2 changes: 2 additions & 0 deletions home/jobs/OMERO-build/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,8 @@ OMERO_VEN=$WORKSPACE/omero-virtualenv
rm -rf $OMERO_VEN
source $HOME/settings.env
python3.11 -m venv $OMERO_VEN
$OMERO_VEN/bin/python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
$OMERO_VEN/bin/python -m pip install --upgrade certifi

$OMERO_VEN/bin/pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl
$OMERO_VEN/bin/pip install -U &apos;setuptools&#60;66&apos; omero-py
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/OMERO-docs/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,8 @@
<hudson.tasks.Shell>
<command>python3.11 -mvenv venv
source $WORKSPACE/venv/bin/activate
pip install -U pip
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install -U scc
test -e src &amp;&amp; cd src
scc $MERGE_COMMAND -S $STATUS --push $MERGE_PUSH_BRANCH</command>
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/OMERO-push/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,8 @@
<hudson.tasks.Shell>
<command>python3.11 -mvenv venv
source $WORKSPACE/venv/bin/activate
pip install -U pip
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install -U scc
test -e src &amp;&amp; cd src
user=$(git config github.user)
Expand Down
4 changes: 3 additions & 1 deletion home/jobs/OMERO-robot/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,9 @@
python3.11 -m venv $WORKSPACE/.venv3

source $WORKSPACE/.venv3/bin/activate
pip install -U pip setuptools
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
python -m pip install --upgrade setuptools
pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl
pip install omero-py omero-web # Latest in order to stop server.
</command>
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/OMERO-server/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,8 @@ done

source $WORKSPACE/.venv3/bin/activate

pip install -U pip
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl
pip install markdown
pip install reportlab # For figure
Expand Down
12 changes: 12 additions & 0 deletions home/jobs/OMERO-test-integration/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,18 @@ fi
dropdb -f -h $OMERO_DB_HOST -U $OMERO_DB_USER $OMERO_DB_NAME || echo Already exists maybe

rm -rf $WORKSPACE/*
python3.11 -m venv $OMERO_ENV

source $OMERO_ENV/bin/activate
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install -U setuptools
pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl
pip install markdown
pip install mox3 pytest pytest-django pytest-xdist pytest-mock
pip install tables
pip install jinja2
pip install PyYAML

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just curious, why all these additional pip installs?

@pwalczysko pwalczysko Oct 26, 2026 •

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because they were added into the config of the job (not by me) on the idr3-slot2, but they are missing in this repo

</command>
</hudson.tasks.Shell>
<hudson.plugins.copyartifact.CopyArtifact plugin="copyartifact@722.v0662a_9b_e22a_c">
Expand Down
4 changes: 3 additions & 1 deletion home/jobs/OMERO-training/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,9 @@
python3.11 -m venv $WORKSPACE/.venv3

source $WORKSPACE/.venv3/bin/activate
pip install -U pip setuptools
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
python -m pip install --upgrade setuptools
pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl
pip install markdown
# Avoid installing psutil for now
Expand Down
3 changes: 2 additions & 1 deletion home/jobs/OMERO-web/config.xml
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,8 @@ rm -rf $WORKSPACE/*

python3.11 -m venv $OMERO_ENV
source $OMERO_ENV/bin/activate
pip install -U pip
python -m pip install "pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"
python -m pip install --upgrade certifi
pip install https://github.com/glencoesoftware/zeroc-ice-py-linux-x86_64/releases/download/20240202/zeroc_ice-3.6.5-cp311-cp311-manylinux_2_28_x86_64.whl


Expand Down
23 changes: 18 additions & 5 deletions server/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,17 @@ RUN chmod +x /home/settings.env
WORKDIR /tmp/omero-install/linux


RUN dnf install -y python3.11 python3.11-pip
RUN pip3.11 install build
# Install Python and refresh certificate trust before pip installs
RUN dnf install -y ca-certificates python3.11 python3.11-pip && \
dnf upgrade -y ca-certificates && \
update-ca-trust

RUN python3.11 -m pip install \
"pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"

RUN python3.11 -m pip install --upgrade "certifi>=2026.10.23"

RUN python3.11 -m pip install build

# Ice dependencies
RUN dnf install -y 'dnf-command(config-manager)' && \
Expand All @@ -27,12 +36,16 @@ ENV ICE_HOME=/opt/ice-3.6.5
ENV PATH=$ICE_HOME/bin:$PATH

# install postgres tools for pg16 (default is 13)
# Install PostgreSQL 16 tools (default is 13)
RUN dnf install -y https://download.postgresql.org/pub/repos/yum/reporpms/EL-9-x86_64/pgdg-redhat-repo-latest.noarch.rpm
RUN dnf -qy module disable postgresql
RUN sed -i \
's/rhel-\$releasever_major\.\$releasever_minor-/rhel-\$releasever_major-/g' \
/etc/yum.repos.d/pgdg-redhat-all.repo && \
dnf --disablerepo="pgdg*" -qy module disable postgresql

RUN dnf -y install postgresql16 \
&& dnf clean all

RUN update-alternatives --set java java-21-openjdk.x86_64
# For OME-zarr
RUN dnf -y install epel-release
RUN dnf -y update
Expand All @@ -58,7 +71,7 @@ RUN chmod a+x /tmp/run.sh


# Change user id to fix permissions issues
ARG USER_ID=1000
ARG USER_ID=11593
RUN usermod -u $USER_ID omero


Expand Down
25 changes: 18 additions & 7 deletions slave/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,17 @@ RUN chmod +x /home/settings.env
# Required for the docs build
RUN dnf install -y make

# Python job
RUN dnf install -y python3.11 python3.11-pip
RUN pip3.11 install build
# Python job: refresh certificates and update pip before installing packages
RUN dnf install -y ca-certificates python3.11 python3.11-pip && \
dnf upgrade -y ca-certificates && \
update-ca-trust

RUN python3.11 -m pip install \
"pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"

RUN python3.11 -m pip install --upgrade "certifi>=2026.10.23"

RUN python3.11 -m pip install build

# Ice dependencies
RUN dnf install -y 'dnf-command(config-manager)' && \
Expand Down Expand Up @@ -45,8 +53,11 @@ RUN dnf -y install maven ant && dnf clean all

# install postgres tools for pg16 (default is 13)
RUN dnf install -y https://download.postgresql.org/pub/repos/yum/reporpms/EL-9-x86_64/pgdg-redhat-repo-latest.noarch.rpm
RUN dnf -qy module disable postgresql
RUN dnf -y install postgresql16-server postgresql16\
RUN sed -i \
's/rhel-\$releasever_major\.\$releasever_minor-/rhel-\$releasever_major-/g' \
/etc/yum.repos.d/pgdg-redhat-all.repo && \
dnf --disablerepo="pgdg*" -qy module disable postgresql
RUN dnf -y install postgresql16-server postgresql16 \
&& dnf clean all

# gradle
Expand All @@ -63,7 +74,7 @@ RUN dnf -y update
RUN dnf -y install blosc

RUN dnf install -y cronie

RUN update-alternatives --set java java-21-openjdk.x86_64
EXPOSE 14064
EXPOSE 14063

Expand All @@ -72,7 +83,7 @@ RUN chown omero:omero /tmp/run.sh
RUN chmod a+x /tmp/run.sh

# Change user id to fix permissions issues
ARG USER_ID=1000
ARG USER_ID=11593
RUN usermod -u $USER_ID omero

# make sure mounted volumes has correct permissions
Expand Down
17 changes: 14 additions & 3 deletions web/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -16,13 +16,24 @@ ADD ./run.sh /tmp/run.sh
RUN chown omero:omero /tmp/run.sh
RUN chmod a+x /tmp/run.sh

RUN dnf install -y python3.11 openssl python3.11-pip
RUN pip3.11 install build
# Install Python and refresh certificate trust before pip installs
RUN dnf install -y ca-certificates python3.11 openssl python3.11-pip && \
dnf upgrade -y ca-certificates && \
update-ca-trust

RUN python3.11 -m pip install \
"pip @ https://files.pythonhosted.org/packages/3f/06/3e4420302363fbb71be3c7f35ce042f54bfca330e3e66b3a2e3c4cca579f/pip-26.2.2-py3-none-any.whl#sha256=fd7f4dfa8190e014013b9f08f3e973f4e4c26ffd179a204895533a7254813a70"

RUN python3.11 -m pip install --upgrade "certifi>=2026.10.23"

RUN python3.11 -m pip install build

RUN update-alternatives --set java java-21-openjdk.x86_64

RUN dnf clean all

# Change user id to fix permissions issues
ARG USER_ID=1000
ARG USER_ID=11593
RUN usermod -u $USER_ID omero

RUN chown -R omero:omero /home/omero/
Expand Down