integrating mac os x with linux as a vm to support raspberry pi development

Update 1 January 2019

This is probably one of the lamest posts I’ve ever written. I leave it here as example of how far into the weeds I tend to get. If you want to use macOS (as it’s now known) to support Raspberry Pi development, and in particular to program Linux images onto micro SDHC cards, then download balena Etcher from https://www.balena.io/etcher/ and install it. Etcher is extremely easy to use, walking you through the three steps necessary to create a bootable image on a card. Don’t do what I did below; that’s just an absolute waste of time.

Original Post

You’re viewing CentOS 7 running in VirtualBox 5.0.16, with a micro SDHC card mounted and in turn viewing the Arch Linux ARM ext4 native Linux filesystem I created for my RP3. When I originally created the RP3 micro SDHC card I used my Ubuntu 15.10 notebook as the workbench. But I’ve been wanting to do similar work using my MBP as the primary tool bench, with an eye towards retiring the native Ubuntu notebook with the MBP due to the Ubuntu notebook’s age, rather than attempting to replace the Ubuntu notebook as I’ve written I originally wanted to do. The biggest hurdle to using the MBP was just reading the native ext4 file system on the MBP, as Max OS X has no native provisions to read Linux file systems. This post is about getting to that point. As time goes along I’ll be doing more than just reading the microSDHC, but reading (and then writing) is the foundational requirement, else this is all a waste of time and resources.

Before I go much farther let me properly attribute this from another post, “Mount SD card in VirtualBox from Mac OS X Host,” written by Brady Holt on 21 July 2014. Please note this was done nearly two years ago. This is an update to his post using contemporary software and with my observations.

Software and hardware I’ll be using:

  • OS X El Capitan, version 10.11.3 running on a MacBook Pro (Retina, 15-inch, Mid 2015)
  • VirtualBox 5.0.16 with Oracle_VM_VirtualBox_Extension_Pack-5.0.16
  • CentOS 7 with all updates as of the date of this post with VBoxGuestAdditions_5.0.16 running as a VM

I’m going to create a Linux VM with VirtualBox and use that to mount and at least read the micro SDHC card with the Arch Linux ARM ext4 file system. I had originally looked for a Mac OS X utility to do this, but eventually gave up as the utilities that claimed they could do that had allegedly stopped working with the release of El Capitan because of System Integrity Protection, or rootless, mode. Far be it from me to disable in El Capitan what is supposed to add additional security to OS X. I’m somewhat surprised that I could get this to work, but I suppose that if, at some point in the future, Apple releases a Mac OS X update that breaks what I’ve built here that I’ll be back to using a separate Linux machine.

The first step is to install VirtualBox and then to install CentOS 7 within a VirtualBox VM. I won’t cover that here, as there are plenty of existing how-tos for that. Just make sure that the Virtual Box Extension Pack is installed and that you’ve downloaded and installed the VBoxGuesAdditions and have built it within the VM. That gets everything prepared both on the OS X host side as well as within the VM.

The next step is to get the overall system prepared to mount the RP3 micro SDHC card within the CentOS 7 VM.

  1. Plug in the microSDHC card into the MBP using the microSDHC adapter. I’m using a Samsung 32GB Evo Plus device. Note that it’s named “NO NAME” on the desktop. This is the MSDOS 100MB boot partition on the microSDHC card.
  2. Go to Launchpad and search for diskutil. Launch diskutil. Select “NO NAME.”

  1. Click the Info button at the top right. Note the device associated with “NO NAME.” It’s the third line down from the top, called “BSD device node.” In my case it’s disk2s1. The device associated with this partition is /dev/disk2. We’ll use this later.

  1. At the top of the utility click the ‘Unmount’ button with your mouse. The button text will then change to ‘Mount.’ Please note you don’t want to eject the device, just unmount.

  1. Now we need to create a VirtualBox VMDK file to point to this device. That’s how we’ll get it to mount inside the Linux VM. Open a terminal and type sudo VBoxManage internalcommands createrawvmdk -filename sd-card.vmdk -rawdisk /dev/disk2 at the prompt. The file will be created where ever you run it, so my advice is to change directory to a location where you want this (or preface the file name with a full path) to create the file. Just remember where you left it.
  2. Change permissions on the microSDHC device and the VMDK file to 777. At the prompt type chmod 777 sd-card.vmdk /dev/disk2. This opens up permissions for the file and card to be used later by the VM
  3. Add sd-card.vmdk to the VM’s storage devices. In VirtualBox, under the CentOS VM, select the Storage dialog, and in the Storage Tree under Controller: SATA click the add device button. You will be prompted to either create a new device or add an existing device. Choose to add existing and add sd-card.vmdk.
  4. Check diskutil one more time and make sure that the microSDHC card is still unmounted. OS X has automount and can silently remount the drive. If it does then you will fail to start the Linux VM.
  5. Once the VM is started bring up Nautilus and note two new ejectable entries for the card, a 103MB entry and a 32GB entry. Click on the 32GB volume. You’ll be prompted by Nautilus to enter root’s password for that VM to view that volume. Once that’s done Nautilus opens into the 32GB volume. You can drag and drop files into and out of the midroSDHC’s 32GB volume. I do this to add content as well as pull log files while developing.

One caveat. If you shut down the VM and then want to bring it back up, you’ll need to unmount the microSDHC card like before and execute chmod 777 /dev/disk# again, or the VM will fail to start due to lack of permissions on the raw device.

all in with apple – part 1

Taken with an iPhone 6s Plus

For the past year (since November 2014) I’ve been surreptitiously moving from a reliance on Windows, Linux and Android based devices to devices using Mac OS X and iOS. It started with the purchase of an iPad Air 2 in November 2014, the one to the left with the picture of Lucy on the lock screen, and continued until this November and the purchase of the 15″ Retina Macbook Pro on the right. My Olympus E-M10 is in the mix for a sense of scale. And because I like that little camera.

My shift started with my growing dissatisfaction with Android, especially how Samsung was handling Android on my Galaxy S4. Especially with regards to security updates. I have two other Android devices, a pair of 2013 Nexus 7 tablets. I’ve watched those tablets upgrade over the air from version 4.4.2 to 5 and recently to Android 6. It took a long time from Google’s announcement to OTA upgrade, far longer than Apple takes with iOS after an Apple announcement. And Samsung? It did eventually upgrade to 5, then 5.0.1, and finally 5.0.2. Complete with Samsung’s skin and apps. A mess which I was willing to put up with when I first purchased the S4, but after two years of constant exposure, it finally wore me down.

I didn’t realize at first just how dissatisfied I was becoming with Android. And yet, in hindsight, it was inevitable. That dissatisfaction was first expressed with the purchase of the iPad Air 2. At the time I was trying to decide between the iPad and a Samsung Galaxy S2 10″ tablet. The Samsung was about $150 cheaper, but was only available in 64GB maximum internal storage. After two days of vacillating I purchased the iPad with the idea of learning how to do sophisticated image post-processing while on travel. I’d purchased the Olympus E-M10 in September of that year because of a key feature, WiFi interconnectivity with any mobile device running Olympus’ OI.Share app. You could get that app for both Android and iOS. When I got the E-M10 I naturally installed the Android version on my Galaxy S4. And I was very impressed.

The problem was I only had 16GB on the S4, even though I had a 64GB micro SD card installed in the phone. OI.Share couldn’t be coerced into storing the E-M10’s images in the micro SD card, and as a consequence the limited internal 16GB began to fill. After a time I moved some of the images up to Google Drive, and some of them to Flickr, and the majority of them off to my Windows PC. It was awkward but doable, but it added additional steps to my workflow of using camera and phone together for photographic work. And I am not a fan of automatic upload to Google Drive or any other location in the “cloud.”

So in November I purchased the iPad with 128 GB of storage, a Logitech Bluetooth keyboard and cover, installed a few apps, and took the whole combination to Japan for Yama Sakura 67 in December 2014. I’d also taken my Samsung 17″ running Windows 8.1, but I’d left my primary photo storage drive, a 1.5 TB WD My Passport Ultra. I didn’t want it lost or broken. With the external drive at home I didn’t want to use Lightroom. I decided to work everything on the iPad.

The iPad worked pretty well for the most part. I discovered a lot about using the iPad for creative work, and learned to “trust” JPEGs again. That’s because there are no RAW converters for Olympus RAW files on iOS (nor on Android for that matter). In spite of some quirks, the combination was good enough that I depended on it again in April of this year on another Japan business trip, and I’m going to use it once more this December in Japan. The iPad Air 2 and the E-M10 make a portable, potent combination. With WiFi connectivity I can push my finished work up to Flickr, Instagram, and WordPress (especially blogging). And with the purchase of an iPhone 6s Plus, I can use either iDevice to pull images off the E-M10 and use pretty much the same post processing workflow. I still need the iPad with its keyboard for writing.

I was happy enough that by March I purchased a refurbished late 2012 Mac Mini Server model. That allowed me to begin to tie backups from my iPad and my wife’s mid-2012 MBP together. And it was from the Mac Mini that I grew comfortable with OS X. And that helped to ease the decision to purchase an iPhone 6s Plus to replace my Galaxy S4 in early November. That, and Apple’s Upgrade Program. With the Upgrade Program, combined with Apple’s software upgrade policy across their iOS devices, I can now maintain an up-to-date iDevice, the phone. Every year now I’ll get a new ‘S’ device. Right now my opinion of the iPhone with Apple’s custom ARM chips is that anything else is a waste of money. The iPhone is that good.

All of which led me to the purchase of the MBP. I purchased that for the express purpose of replacing, over time, my Samsung 17″ Chronos 7 notebook running Windows 10 as well as my much older Samsung running Ubuntu 15.04. The MBP is combining what I consider the best attributes of both.

The desktop should remind Ubuntu users of Ubuntu’s Unity desktop, with the dock to the left. I chose this combination because I learned, on my Mac Mini Server, that I could have the equivalent of Windows and Linux under one environment. The key Windows feature I want and need is Office. The pieces of Office I need are Word, Excel and PowerPoint. And they work pretty much across either Windows or OS X. There is no office for Linux and there may never be. Trying to work with complex Office documents with LibreOffice, the best of the free office suites on Linux, is a recipe for slow madness. I know, I tried.

And if I need a “pure” Linux? I’ve discovered I can get that by running one or more Linux distributions on OS X via VirtualBox.

Languages such as Oracle’s latest Java, Google’s Go, Python, and Rust are dead simple to drop into the OS X environment. The biggest and the best, Swift, is available through Xcode. And I can share, via a common folder on the OS X file system, files between the Linux VM and native tools on OS X.

Time permitting I’ll do a more detailed comparison between the individual Apple devices and everybody else. But for now I have to say I’m pretty well satisfied. It’s certainly not perfect, but it’s better than most else I’ve been dealing with over the past two-plus years. In spite of what the current critics may say, Apple’s hardware and software is more than good enough, and in many cases, better than the current state of the competition for my use. Your milage, as they always say, will vary.

For me, however, I’m all in with Apple.