Apple's colorful mainstream flagship, starting at $749.
APFS Bug in macOS High Sierra Can Cause Data Loss When Writing to Disk Images
Apple's APFS file system included in macOS High Sierra suffers from a disk image vulnerability that in certain circumstances can lead to data loss, according to the creator of Carbon Copy Cloner.
In a blog post last Thursday, software developer Mike Bombich explained that he had uncovered the data writing flaw in the Apple File System, or APFS, through his regular work with "sparse" disk images.
For those who aren't familiar with the term, a sparse disk image is basically a file that macOS mounts on the desktop and treats as if it was a physically attached drive with a classic disk volume structure. The flexibility of sparse disk images means they are commonly used in the course of performing backup and disk cloning operations, hence Bombich's extensive experience with them.
Bombich's video demonstrating the APFS bug
Every installation of High Sierra on Macs with all-flash storage converts the existing file system to APFS, which is optimized for modern storage systems like solid-state drives. However, as Bombich notes, ordinary APFS volumes like SSD startup disks are not affected by the problem described above, so the vast majority of users won't be affected by it – the flaw is most applicable when making backups to network volumes. Bombich says Carbon Copy Cloner will not support AFPS-formatted sparse disk images until Apple resolves the issue.
The APFS flaw follows the discovery of another bug in Apple's operating systems that received extensive coverage last week. That bug is induced by sending a specific character in the Indian language Telugu, which causes certain apps on iPhones, iPads, and Macs to freeze up and become unresponsive. The Telugu character bug has already been fixed in Apple's upcoming iOS 11.3 and macOS 10.13.4 software updates.
In a blog post last Thursday, software developer Mike Bombich explained that he had uncovered the data writing flaw in the Apple File System, or APFS, through his regular work with "sparse" disk images.
For those who aren't familiar with the term, a sparse disk image is basically a file that macOS mounts on the desktop and treats as if it was a physically attached drive with a classic disk volume structure. The flexibility of sparse disk images means they are commonly used in the course of performing backup and disk cloning operations, hence Bombich's extensive experience with them.
Earlier this week I noticed that an APFS-formatted sparsebundle disk image volume showed ample free space, despite that the underlying disk was completely full. Curious, I copied a video file to the disk image volume to see what would happen. The whole file copied without error! I opened the file, verified that the video played back start to finish, checksummed the file – as far as I could tell, the file was intact and whole on the disk image. When I unmounted and remounted the disk image, however, the video was corrupted. If you've ever lost data, you know the kick-in-the-gut feeling that would have ensued. Thankfully, I was just running some tests and the file that disappeared was just test data.Two related problems are identified by Bombich, above. The first is that the free space on the APFS-formatted sparse disk image doesn't update as it should when the free space on the underlying physical host disk is reduced. The second problem is the lack of error reports when write requests fail to dynamically grow the disk image, resulting in data being "written" into a void. Bombich tracks both bugs back to macOS's background "diskimages-helper" application service, which he has since reported to Apple.
Every installation of High Sierra on Macs with all-flash storage converts the existing file system to APFS, which is optimized for modern storage systems like solid-state drives. However, as Bombich notes, ordinary APFS volumes like SSD startup disks are not affected by the problem described above, so the vast majority of users won't be affected by it – the flaw is most applicable when making backups to network volumes. Bombich says Carbon Copy Cloner will not support AFPS-formatted sparse disk images until Apple resolves the issue.
The APFS flaw follows the discovery of another bug in Apple's operating systems that received extensive coverage last week. That bug is induced by sending a specific character in the Indian language Telugu, which causes certain apps on iPhones, iPads, and Macs to freeze up and become unresponsive. The Telugu character bug has already been fixed in Apple's upcoming iOS 11.3 and macOS 10.13.4 software updates.
Tag: APFS
[ 269 comments ]
Top Rated Comments
(View all)
9 months ago
Glad I reverted to Sierra when I deemed High Sierra a S-show after a couple of weeks. There seems to be no end to Apple's incompetence with this OS.
9 months ago
Another day, another bug. How very Apple-esque. #ifstevejobswasalive #firetimcook
9 months ago
Ah this isn't important. Who cares about data.
People want..........new emoji! ;)
People want..........new emoji! ;)
9 months ago
quote: The bug has already been fixed in Apple's upcoming iOS 11.3 and macOS 10.13.4 software updates.
9 months ago
High Sierra has been a complete disaster for me. My computer locks up for 5-10 seconds every few hours. Probably some memory leaks or something. Either way this is really pathetic, even windows works better than this.
9 months ago
“Bombich”... you can’t make this stuff up.
Making fun of surnames. Feels like primary school already.
9 months ago
quote: The bug has already been fixed in Apple's upcoming iOS 11.3 and macOS 10.13.4 software updates.
That's a completely different bug.
Glad I reverted to Sierra when I deemed High Sierra a S-show after a couple of weeks. There seems to be no end to Apple's incompetence with this OS.
You probably weren't affected by this bug. Do you create your own sparse disk images or use CCC?
Wow, this makes me wonder. Did Apple and APFS destroy my only 2 year old Seagate drive with mostly disk images on it?
Were they sparse? Did you convert their contents to APFS? And then put in more data than there was room for?
I wonder if this is related to high sierra suddenly invalidating my time machine backups to my NAS,
No. Time Machine doesn't use APFS.
Likely not - Time Machine is not APFS, norvis it a disk image
Time Machine on a network volume is indeed a sparse disk image. It doesn't use APFS, however.
Filesystem bugs shouldn't happen - at least destructive ones like this. I wonder if they should have slowed the process down with APFS and let it age a little more so these bugs can be identified before they affect us.
They arguably have — it's why, for instance, APFS still isn't recommended on Fusion Drive.
Doesn't excuse this bug, but it does appear that they realized there's a lot of special cases that APFS doesn't yet handle well. (Rather, more specifically, the toolchain such as diskimages-helper hasn't yet been adapted for APFS.)
It's a normal bug, stop the drama.
It's a severe data loss bug. It doesn't affect most users, but it's quite serious nonetheless.
9 months ago
I wonder if this is related to high sierra suddenly invalidating my time machine backups to my NAS, and demanding to do a new full. (Loosing two years worth of history). Then doing it again 2 weeks later.
[ Read All Comments ]
Apple today announced expanded features for App Store bundles, introducing support for both Mac apps and free apps with subscriptions for the first time.
Mac app developers are now able to...
Earlier this year, Signify (formerly Philips) debuted a new range of outdoor Hue lighting products that are designed to bring the iPhone-controlled multi-colored lights that you're used to using...
Apple's 2018 15-inch MacBook Pro with Touch Bar (2.2 GHz, 16GB RAM, 256GB HD) is receiving a discount at a few online retailers this week, marked down to $2,199.99 from $2,399.99 on...
In March, Lyft began testing a monthly subscription plan for select high-frequency users, and today the company announced that a version of this plan will now be available to everyone in the United...
Apple has announced the reopening of its Shibuya retail store in Tokyo on Friday, October 26 – the same day as the launch of iPhone XR – following renovation that began almost a year ago.
The...
All of Apple's Macs come with Preview, the powerful file viewer that's built into macOS. Preview is the default app that opens up whenever you double-click an image or a PDF, and features...
Libratone today announced that AirPlay 2 is available for its ZIPP and ZIPP MINI speakers through a firmware update that can be downloaded from the Libratone app.
Libratone first announced...
Apple today announced on its WebKit blog that it is ending support for TLS 1.0 and 1.1 starting in March 2020. TLS, or Transport Layer Security, is a security protocol used to protect web traffic.
...
