Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
norden.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Moin! Dies ist die Mastodon-Instanz für Nordlichter, Schnacker und alles dazwischen. Folge dem Leuchtturm.

Administered by:

Server stats:

3.4K
active users

norden.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#zfs

8 posts7 participants1 post today
Public
Dan Langille

This is a typical FreshPorts daily database backup being rsync'd from AWS to the #homelab :

It just so happens the the output of pg_dump for the #PostgreSQL database more-or-less keeps the data in the same order each time. So the actual daily transfer SEEMS to be only the new data.

On disk, I rely upon #ZFS compression to do the disk savings for me. That compression also speeds up disk throughput - the CPU can uncompressed faster than the disk can provide the data.

In today's case, the amount copied down seems to be 360MB.

This speed-up by rsync, which recognizes what has and has not been transferred, is also why do not dump in compressed mode.

dumping freshports.org
receiving incremental file list
postgresql/
postgresql/freshports.org.dump
3,621,784,708 100% 77.73MB/s 0:00:44 (xfr#1, to-chk=1/4)
postgresql/globals.sql
3,963 100% 58.64kB/s 0:00:00 (xfr#2, to-chk=0/4)

Number of files: 4 (reg: 2, dir: 2)
Number of created files: 0
Number of deleted files: 0
Number of regular files transferred: 2
Total file size: 3,621,788,671 bytes
Total transferred file size: 3,621,788,671 bytes
Literal data: 355,867,046 bytes
Matched data: 3,265,921,625 bytes
File list size: 142
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 481,559
Total bytes received: 356,171,297

sent 481,559 bytes received 356,171,297 bytes 6,925,298.17 bytes/sec
total size is 3,621,788,671 speedup is 10.15

Public
Doerk

OpenZFS is great and it comes with awesome features. But for newbies or even users who don’t use all the features every day, it can be sometimes a little bit overwhelming.

The FreeBSD foundation has generously created an OpenZFS cheat cheat covering all the basic stuff that is important in daily use.

Great work and worth sharing!

#FreeBSD #openzfs #zfs #cheatsheet

freebsdfoundation.org/blog/ope

FreeBSD Foundation | A non-profit organization dedicated to supporting and building the FreeBSD Project · OpenZFS Cheat Sheet | FreeBSD FoundationOpenZFS provides a lot of enterprise storage features in FreeBSD and other systems. Developed and actively maintained by a worldwide open source community, OpenZFS receives new features, updates, and bug fixes regularly. Companies and users alike rely on OpenZFS for its rock-solid stability, data integrity, feature-set, and cost effectiveness. OpenZFS maintains its own documentation as
Public *
computing competence

Bericht KW16:

- Mo: Inbetriebname mit #Heilein eines #Unifi #Netzwerk mit 72 Access Points und 13 Switches
- Di: Fortsetzung, Finalisierung, Firewall Regeln, Netzwerksegmentierung
- Mi: Fortsetzung, #Dokumentation muss sein, Diverses
- Do: Neuer DSL Anschluss, #OPNsense Updates. #SAP VMs per ZFS Snapshots auf andere #Server Hardware verschoben. Erstes #Teammeeting
- Fr: Feiertag

Highlight: Was haben wir eigentlich ohne #ZFS gemacht? Auch Industrie kann schick sein.

Frohe Ostern!

Industrielagerfläche
Replied in thread
Public *
ax6761

@vermaden @justine
Addendum: prefix "pkg upgrade" with "make-snapshots" to be able to rollback the file systems(s) without fuss ...

make-snapshots \
&& pkg upgrade && make-snapshots \
&& pkg autoremove && make-snapshots \
&& pkg clean && make-snapshots

... I had made the change before the issue of {missing,disappearing}-packages-on-upgrade that various other peoples are experiencing currently.

#FreeBSD#ZFSEverywhere_possible#ZFS
Replied in thread
Public
Jason Tubnor 🇦🇺
@ianthetechie @feld I can confirm that #Python on #FreeBSD behaves as one would expect. It consumes all RAM (with #ZFS releasing ARC as expected) and then dips into swap. As soon as Python releases memory after the ingestion routine, the swap is purged to near zero and the RAM then becomes available (and used) by the system. Far more predictable and reliable.

If you have big, vertical workloads, FreeBSD is where it is at.
Public
echo ✨

fuckkkk ZFS why you do this. guess i know what i'm spending tonight doing.

any #zfs experts out there able to help me recover my pool? i apparently broke things quite significantly lol

Public
Juno

Today, out of nowhere, my shell started to misbehave. My prompt suddenly reverted to default. Some unexpected "command not found" errors started popping up. Something was off.

I went to check my shell configuration. The directory was not there. I then went look into ~/.config. Half of the directories inside were simply gone.

I immediately flipped into what the fuck is happening mode.

This system is an Alpine root-on-ZFS. I have a script called by cron every 20 minutes that snapshots everything.

First I went into the snapshot directory and started copying some things. I soon noticed it was just too much missing. How to map out what was gone in the first place? Even so, copying would only go so far because I was duplicating things.

I looked to my left at the resource monitor. I had less than 1 GB left of free space. That was not going to work.

I flip some pages, looking for an incantation...

% zfs rollback zroot/home@20m

A long second hanged in the air. Then all the resource monitor's bars flipped at once to green: 53% free space.

"Blessed be the ZFS Daemons and the Authors who conjured Them."

The system was still confused, so I rebooted. It let its conscience drift - as it is used to -, uncertainty still heavy in the air. Then it resurfaced... every line of output unconcerned.

Back up, no trace was left of the seconds leading up to the warp. The only suspicion came from a cryptography guardian, who noticed something was wrong about the timestamps. "Please re-enter the passcodes", it asked. Every other blob was either unconcerned or unimpressed with the glitch.

Like any time travel, the only trace left was in my memory. No history anywhere has me looking for that spell. I booted 20 minutes into the past and that's from when I am writing to you.

#ZFS
ExploreLive feeds
About