tests: Skip some ARM/AARCH64-unstable tests #401

Job	Run time
Build OSX executable (macos-latest)	55s
Build and test FreeBSD executable	4m 35s
Build and test Alpine executable	3m 35s
Build and test Linux executable (amd64)	4m 3s
Build and test Linux executable (armv7)	16m 48s
Build and test Linux executable (aarch64)	13m 36s
Build and test Linux executable (ppc64le)	16m 39s
Build and test Linux executable (riscv64)	15m 43s
Build and test Linux executable (i386)	3m 41s
Build and push to Docker Hub	0s
	1h 19m 35s

Provide feedback