It fails with master of poky and I created the following ticket to
track it https://bugzilla.yoctoproject.org/show_bug.cgi?id=11907.
I don't think we have ever used the ptest to run tests on the device
so let's just disable it and compile more quickly.