Info Fast ZFS Storageserver with Oracle Solaris, OmniOS and napp-it

[gea]

OpenIndiana 2020.04 is available

OpenIndiana is a Solaris fork like OmniOS and based on Illumos. Unlike OmniOS there is no stable/ long term stable and no commercial support option or regular security fixes sometimes several per month. OpenIndiana is like a reference installation of Illumos. You get it as a minimal, text (similar to OmniOS) or desktop edition. Every "pkg update" gives the newest state of Illumos similar to the OmniOS bloody.


OpenIndiana is mostly for a ZFS home system with browser and office apps. For a production ZFS storage system, prefer OmniOS optionally with a support contract.

2020.04 Release Notes - OpenIndiana Docs

docs.openindiana.org

 

[gea]

I have added a small howto for backup/copy/sync local files from/to a napp-it ZFS filer from/to a cloudservice (or between cloudservices) like (Amazon) S3, Google or Microsoft.

http://www.napp-it.org/doc/downloads/cloudsync.pdf

update:
I have added configuration infos for https, encrypted files and configuration for Amazon S3/minIO and Google drive

 

[gea]

There is a critical bug in Solaris 10, 11 and Illumos allowing remote access

https://github.com/omniosorg/omnios-build/blob/r151034/doc/ReleaseNotes.md

Please update!

 

[gea]

OmniOS stable 151036 is out

https://github.com/omniosorg/omnios-build/blob/r151036/doc/ReleaseNotes.md

Some improvements:

SMB 3.1.1 (ZFS/kernelbased SMB server)
Improvements on Linux/LX zones
Improvements on Bhyve virtualiser
ZFS can use hardware acceleration for Raid-Z
Improved support for Mellanox ConnectX-4/5/6 , i40e and bge nic devices
gcc10 is now default compiler

 

[gea]

OpenIndiana 2020.10

OpenIndiana, one of the main Illumos distributions beside OmniOS, NexentaStor and SmartOS and more or less the successor of OpenSolaris with a server and desktop edition is here with a new snapshot

new among others: SMB 3.11, support for Bhyve, FreeRDP, Remmina, Mate 1.24 and gcc10

OpenIndiana Hipster 2020.10 is here – openindiana

www.openindiana.org

 

[gea]

The new OSX 11 Big Sur seems to have SMB problems.
This also happens on OmniOS

https://developer.apple.com/forums/search/?q=smb big sur

Discussions at Illumos-dev

https://illumos.topicbox.com/groups...hare-not-usable-with-macos-11-big-sur-clients

 

[thecoolnessrune]

I feel like my SMB shares have problems with Mac every couple of yearly releases, and it's usually something that needs fixed on Apple's side.

 

[gea]

Sadly Apple does not care or fix the problems with non Apple systems or make MacOS and SMB or TimeMachine simply working with any SMB server so you need the modifications from SAMBA or Oracle/Illumos for the ZFS/kernelbased SMB server.

 

[gea]

ZFS encryption performance on OmniOS and Intel Xeon silver vs AMD Epyc 7302

After weeks of waiting I got a new SuperMicro BTO system with the H12SSL-C mainboard and a 16/32 Core 7302 and 128GB RAM, H12SSL-C | Motherboards | Super Micro Computer, Inc.

I made some tests with a disk pool, an NVMe pool and an Optane pool with and without encryption as this is what requires performance. While sync write seems a performance problem with encryption, the other results are promising. As you can load such a system with 24 NVMe system performance may need a jump.

I have also tried a virtualized OmniOS on ESXi 7.0U1 but found NVMe pass-through problems that need some more work.
12G SAS in pass-through mode ex with WD SS530 SAS SSDs are troublefree and nearly as fast as NVMe.

First impression
https://napp-it.org/doc/downloads/epyc_performance.pdf

 

[gea]

There is an update for the Solaris fork OmniOS

Release Notes

illumos based server OS with ZFS, DTrace, Crossbow, SMF, Bhyve, KVM and Linux zone support

omniosce.org

Among others: Fix an SMB probleme with OSX 11 (Big Sur)

 

[gea]

Important OmniOS Security Update r36m, r34am, r30cm - Security / Features/ Bugfixes

Support for secure RPC for the Netlogon protocol between OmniOS systems and Microsoft Active Directory servers is added to all OmniOS versions under support. This is required to fully mitigate CVE-2020-1472, and will shortly be enforced by Windows domain controllers.

If you use Windows Active Directory you should at least evaluate.

Release Notes

illumos based server OS with ZFS, DTrace, Crossbow, SMF, Bhyve, KVM and Linux zone support

omniosce.org

 

[gea]

Emergency security update due a very critical bug in sudo

https://www.helpnetsecurity.com/2021/01/27/cve-2021-3156/

https://blog.qualys.com/vulnerabili...p-based-buffer-overflow-in-sudo-baron-samedit

https://illumos.topicbox.com/groups...ecurity-update-r36m-r34am-r30cm-baron-samedit

Emergency security update due a very critical bug in sudo

https://www.helpnetsecurity.com/2021/01/27/cve-2021-3156/

https://blog.qualys.com/vulnerabili...p-based-buffer-overflow-in-sudo-baron-samedit

https://illumos.topicbox.com/groups...ecurity-update-r36m-r34am-r30cm-baron-samedit

I suggest all to update sudo as soon as possible (update OS if no fix is available). For OmniOS under support (151030-151036) a fix is available now.

To install the update enter the following
# pkg update sudo omnios-userland entire


I suggest all to update sudo as soon as possible (update OS if no fix is available) For OmniOS versions under support (151030-151036) a fix is available now.

 

[gea]

OmniOS 151038, Stable and Long-Term-Supported (LTS) Release, TBC of May 2021

omnios-build/doc/ReleaseNotes.md at master · omniosorg/omnios-build

Build system for OmniOS. Contribute to omniosorg/omnios-build development by creating an account on GitHub.

github.com

There are some important new features available like persistent l2arc, SMB improvements, improvements around Bhyve/LX or improved support for newer hardware ex AMD Zen, Intel X710 or newer chipsets. If you intend a fast switch, you can evaluate the new features in OmniOS 151037 bloody that can be updated in may to 151038.

 

[gea]

If you are using minIO (Amazon S3 compatible Cloud storage service for ZFS filesystems) on OmniOS:
Newest version from today fixes a bug in the browserbased client

more, https://forums.servethehome.com/index.php?threads/amazon-s3-compatible-zfs-cloud-with-minio.27524/

 

[gea]

New default napp-it is v 21.06 for all releases incl. free
Free is ok for commercial use and without a capacity limit but without support or updates to dev/support releases or PRO addons

 

[gea]

There is a new OmniOS service release

OmniOS Community Edition r151038s, r151036as, r151030ds

OmniOS r151038s, r151036as and r151030ds are now available.

omnios.org

It supports Windows 2022/ Windows 11

 

[gea]

New: Logitech Mediaserver

Community add-on for OmniOS from user "Urknall"

https://napp-it.org/extensions/lms.html

 

[Fallen Kell]

At some point, I really need to look at OmniOS. I have just never bothered yet. I have been using ZFS since it was first released by Sun and love it. That said, my currently home implementation is via FreeNAS (not that I really need the web gui and actually find it limiting, being a certified Solaris system administrator, w/ 20+ years of experience as a unix/linux sys admin, I have no fear of the command line...).

 

[gea]

You can use a minimalistic OmniOS. This is Just enough OS for a ZFS storage filer with NFS, SMB, blockstorage FC/iSCSI and objectstorage S3 via minIO . This is ultra compact, ultra stable and with regular security- and bugfixes.

If you want web management, just add napp-it that works transparent together with CLI management.

 

[gea]

OmniOS LTS and stable security updates to fix a bug in OpenSSH among some other fixes and improvements

https://github.com/omniosorg/omnios-build/blob/r151038/doc/ReleaseNotes.md
https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-41617

btw
OmniOS is ultra fast with fixes. The OpenSSH bug was two days old until fixed in OmniOS

 

[gea]

OmniOS 151040 stable is out!

new features see

omnios-build/doc/ReleaseNotes.md at r151040 · omniosorg/omnios-build

Build system for OmniOS. Contribute to omniosorg/omnios-build development by creating an account on GitHub.

github.com

 

[gea]

After a new installation of OmniOS 151040, you need the following links for napp-it (or a rerun of the wget installer)

ln -s /lib/libssl.so /usr/lib/libssl.so.1.0.0
ln -s /lib/libcrypto.so /usr/lib/libcrypto.so.1.0.0

 

[gea]

Announcing the First Oracle Solaris 11.4 CBE

https://blogs.oracle.com/solaris/post/announcing-the-first-oracle-solaris-114-cbe

"I'm very happy to announce that today we are releasing a new version of Oracle Solaris 11.4 for free/open source developers and non-production personal use.

Today marks the first delivery of our "Common Build Environment" (CBE)
releases for the Oracle Solaris 11.4.


To enable us to make new features and fixes available quicker and to more systems Oracle Solaris now uses a continuous delivery model of SRU/micro releases rather than much larger minor releases every few years.


The GA release of a major or minor was historically the release intended for non-production use for developement of free/open source software, testing, proof of concept deployments. With the switch to a continuous delivery model many new features that have been added to Oracle Solaris 11.4 are not available in a release with a non-production use license.


The SRUs also contain updates to the free and open source software that is included with Oracle Solaris. The source code repository with build instructions and patches for the open source software is available on our solaris-userland GitHub repository. Some of the Oracle Solaris patches enable free/open source software to take advantage of functionality delivered after the 11.4.0 release.


You can upgrade an existing Oracle Solaris 11.4.0 system to the CBE release today and get access to the new features released in SRU/micros since 11.4.0.

1. How do I get the Oracle Solaris 11.4 CBE releases?
   If you already have a system with Oracle Solaris 11.4.0 GA release installed (it has the pkg.oracle.com/solaris/release IPS publisher configured) then a simple pkg update is sufficient. Alternatively, if you have a local IPS repository, you can copy the CBE, and update from there.
   
   Intial installation ISO images on the Oracle Solaris 11.4 downloads page are planned to be made available soon.
   
   Documentation for Oracle Solaris 11.4 is available from docs.oracle.com and also on our oraclesolaris-contrib GitHub repository."
   

 

[gea]

Napp-it up from 21.06 supports the new Solaris 11 CBE

 

[gea]

napp-it is switching from mini_httpd to Apache 2.4

Up to now the webserver below napp-it is mini_httpd. This is an ultra tiny 50kB single binary webserver. With current operating systems https is no longer working due newer OpenSSL demands. As there is only little work on mini_httpd we decided to move to Apache 24 as this is part of the OmniOS extra repository with regular bug and security fixes.

A first beta with Apache 24 for OmniOS and the new Solaris 11 CBE is current napp-it 22.dev. After an update Apache should work for http on port 81 and https on port 82. On problems restart Apache manually via "/etc/init.d/napp-it start"

The default Apache config files are under /var/web-gui/data/tools/httpd/apache24/. If you want your own config (update save), use /var/web-gui/_my/tools/apache/httpd.conf as config file.

gea