How to build dilos-illumos
- 1 Prepare Build Environment
- 1.1 NOTE:
- 1.1.1 Add swap:
- 1.1.2 change the swap size on the fly
- 1.1.3 Obtain non-root user id
- 1.1.4 Create a build user:
- 1.1.5 Install packages:
- 1.2 INFO
- 1.3 Note:
- 1.3.1 Prepare build tools:
- 1.1 NOTE:
- 2 Start Build
- 2.1 INFO
- 3 Update to New Build
Prepare Build Environment
This instruction based on page: "How To Build illumos"
To build dilos-illumos on DilOS you should follow the steps below.
NOTE:
You need to upgrade DilOS. This step is required only once and should be made only in the global zone before preparing the build environment. You need to have 'sudo' permissions for your build user for DEB packages generation process. Please update the /etc/sudoers file with the correct info. Instructions are based on updates and sources tree tag with update from 'dilos-unstable'. Add the repository below to the top of the /etc/apt/sources.list file:
deb http://apt.dilos.org/dilos dilos2-unstable main
and issue the following commands:
sudo apt-get update && sudo os-upgrade
You will be upgraded to new BE. Please reboot after successful upgrade.
It is not recommended to build DilOS in the global zone. It is suggested creating new zone for the building process. As an example refer to the following links for more details about zone and network configuration:
Zone creation: How to setup DPKG zone
Network configuration: How to configure NAT
It is recommended to have at least 2G of RAM and 2G of swap. To update swap size, use the steps below in a global zone, don't forget to reboot to enable swap:
Add swap:
$ sudo zfs set volsize=2g rpool/swap
$ sudo reboot
You can change the swap size on the fly. To do it do:
change the swap size on the fly
$ /usr/sbin/swap -lh
swapfile dev swaplo blocks free
/dev/zvol/dsk/rpool/swap 129,3 4K 2,00G 2,00G
$ sudo swap -d /dev/zvol/dsk/rpool/swap
$ sudo zfs set volsize=4g rpool/swap
$ sudo swap -a /dev/zvol/dsk/rpool/swap
$ /usr/sbin/swap -lh
swapfile dev swaplo blocks free
/dev/zvol/dsk/rpool/swap 129,3 4K 4,00G 4,00G
The build process should be run in the newly created zone from the user with the sudo permissions (not root). So, now while you are in the global zone check the id of yournonrootuser (like you did it for admin user when creating DPKG zone before).
Obtain non-root user id
$ id yournonrootuser
uid=1000(admin) gid=10(staff) groups=10(staff)
All the commands below should be executed in the newly created zone (not global) - login to the zone with root account.
Note : The NOPASSWD option should be added to your build user in the /etc/sudoers file.
Create a build user:
# useradd -u uidfromglobalzone -g staff -d /export/home/yournonrootuser -s /bin/bash yournonrootuser
# passwd yournonrootuser
# echo "yournonrootuser ALL=(ALL:ALL) NOPASSWD: ALL" > /etc/sudoers.d/yournonrootuser
# /system/bin/usermod -P 'Primary Administrator' yournonrootuser
After this you can re-login to the zone under this build user account and continue to do the following steps.
Install packages:
$ sudo apt-get install git ca-certificates
$ sudo update-ca-certificates -d # need it for first time
Prepare dilos-userland-gate clone:
INFO
For clone dilos-illumos you have to create account on BitBucket and send it by BitBucket mail form to account 'dilos' - I'll add you to repo
$ git clone -b dilos2 https://bitbucket.org/dilos/dilos-illumos.git my-dilos-illumos
Install build dependencies:
$ cd my-dilos-illumos
$ tools/bld_pkgs.sh
Download and unpack closed binaries
$ sudo apt-get install wget
$ wget -c \
https://mirrors.omnios.org/illumos-gate/on-closed-bins.i386.tar.bz2 \
https://mirrors.omnios.org/illumos-gate/on-closed-bins-nd.i386.tar.bz2
$ tar xjvpf on-closed-bins.i386.tar.bz2
$ tar xjvpf on-closed-bins-nd.i386.tar.bz2
Prepare illumos.sh
Copy original illumos.sh:
$ cp usr/src/tools/env/illumos.sh .
The settings we are going to focus on for now are the following:
CODEMGR_WS - This should be the root of the directory with the code. If you followed the previous example, it will be
/<your directory>/my-dilos-illumos
.STAFFER - Change this to the name of the non-privileged user you use on the system.
VERSION - Set this to
illumos-gate
or whatever version string you want for the build.CLONE_WS - is the workspace nightly should do a bringover from. You can update it to:
export CLONE_WS='https://bitbucket.org/dilos/dilos-illumos-gate'
. This variable need for 'webrev
' tool.ON_CLOSED_BINS - tools folder. You should set it to the folder name, where your tar files have been unpacked to on the previous step. Here it would be
export ON_CLOSED_BINS="/<your directory>/my-dilos-illumos/closed"
.
For GCC build only you have to add to your illumos.sh:
# on Intel and SPARC we use GCC6 that already defined on build system
export GNUC_ROOT="/usr/gcc/6" # path to GCC binaries installed
export PRIMARY_CC=gcc6,/usr/lib/ccache/gcc-6,gnu
export PRIMARY_CCC=gcc6,/usr/lib/ccache/g++-6,gnu
# disable SMB_PRINTING
export ENABLE_SMB_PRINTING='#'
These variables are needed for the version identification and the DEB packages tools:
export GATE='2.0.2.40-dbg' # it is variable will be updated on loading kernel screen.
export BLD_REVISION=$(git log -1 --pretty=format:%h)
export DEB_VERSION="2.0.2.40-1" # DEB packages version, must be incremented for correct upgrade
export DEB_MAINTAINER="Igor Kozhukhov <ikozhukhov@gmail.com>" # you can use your name here
export DPKG_BUILD_FLAGS="-b -d -uc" # flags for dpkg-buildpackage. You can provide your flags.
Note:
Version in DEB_VERSION must be higher then current installed version of package 'libc-dev'
Check your version of libc using : dpkg -l | grep libc
Example:
If you have installed libc-2.0.2.7 for your build you can use:
DEB_VERSION="2.0.2.7-2"
or
DEB_VERSION="2.0.2.8"
or another higher version
Prepare build tools:
$ ln -s usr/src/tools/scripts/bldenv .
$ ksh93 bldenv -d illumos.sh -c "cd usr/src && dmake setup" # -d - if you use DEBUG build. You have to remove it for non-DEBUG build
# on SPARC:
$ sudo rm -rf /opt/onbld && sudo cp -ax usr/src/tools/proto/root_sparc-nd/opt/onbld /opt/
# Or on Intel:
$ sudo rm -rf /opt/onbld && sudo cp -ax usr/src/tools/proto/root_i386-nd/opt/onbld /opt/
Start Build
INFO
Will be better to start build process on 'screen' terminal. You can install it by command:
$ sudo apt-get install screen
If you modified profile to "Primary administrator" by usermod
, you need to re-login to the build zone (or via ssh)
To run the full build procedure, please issue the commands below:
$ cp usr/src/tools/scripts/nightly .
$ time ./nightly illumos.sh
Note that the command does not give any progress output. You can instead follow the log file at log/nightly.log
, which is updated (slowly) during the build process. In another terminal, run:
$ tail -f log/nightly.log
For the incremental build, the following command can be used (don't forget to increase the DEB_VERSION number):
$ time ./nightly -i illumos.sh
Update to New Build
Update Using apt-get
New build should be installed from the global zone. Add the build path to the apt repo list, for instance it could be something like:
$ cat /etc/apt/sources.list
# Main repository sources
deb [trusted=yes] file:///export/home/admin/my-dilos-illumos/packages/i386/apt unstable main
deb http://apt.dilos.org/dilos dilos-testing main contrib non-free
Issue an apt-get update
command to check get new deb packets information. Check that there are no issues with new repo. Note that it is OK to get the warning message below:
$ sudo apt-get update
...
Reading package lists... Done
W: The repository 'file:/export/home/dim/my-dilos-illumos/packages/i386/apt unstable Release' is not signed.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.
Run upgrade procedure:
$ sudo os-upgrade
...
upgrade done
Updating bootarchive ...
Activating 'dilos_<version>' ...
Now you can reboot to new 'dilos_<version>'.