1 Cayman Islands Dollar = 60.5778 Philippine Peso

1 Swiss Franc = 52.0041 Philippine Peso

1 CFA Franc BCEAO = 0.0835 Philippine Peso

1 Vietnamese Dong = 0.0022 Philippine Peso

1 Macedonian Denar = 0.8886 Philippine Peso

1 Zambian Kwacha = 0.0097 Philippine Peso

1 South Korean Won = 0.0414 Philippine Peso

1 Jordanian Dinar = 71.1694 Philippine Peso

1 Lebanese Pound = 0.0334 Philippine Peso

1 Bahraini Dinar = 133.5214 Philippine Peso

1 Chilean Peso = 0.0611 Philippine Peso

1 Maldivian Rufiyaa = 3.257 Philippine Peso

1 Malaysian Ringgit = 11.6508 Philippine Peso

1 Nicaraguan Cordoba Oro = 1.4677 Philippine Peso

1 Netherlands Antillean Guilder = 28.1278 Philippine Peso

1 Estonian Kroon = 3.5404 Philippine Peso

1 Danish Krone = 7.3384 Philippine Peso

1 Fiji Dollar = 22.4119 Philippine Peso

1 New Zealand Dollar = 30.9937 Philippine Peso

1 Croatian Kuna = 7.2774 Philippine Peso

1 Peruvian Nuevo Sol = 14.8557 Philippine Peso

1 Dominican Peso = 0.9174 Philippine Peso

1 Papua New Guinean Kina = 14.7199 Philippine Peso

1 Brunei Dollar = 35.7294 Philippine Peso

Curious about what’s going on behind the scenes with verification? Bernard Murphy, Jim Hogan, and our own Paul Cunningham are on the case with the “Innovation in Verification” blog stream over at semiwiki.com. Every month, this trio reviews a newly-published paper in academia that pertains to verification and discusses its implications. Be sure to stop by—it’s a great place to see what might be coming down the pipeline someday.

This month, they discuss the implications of metamorphic testing. The purpose of metamorphic testing is to define a verification approach where is there is no “golden reference.” This situation comes up a lot now as designs grow in complexity, and it begs the question: “how does one know the design is verified if there is no standard to compare to?”. Metamorphic testing addresses the problem of not having a “gold standard” to compare to by comparing the results of related tests instead. The paper reviewed by this team used metamorphic testing to study methods of managing JavaScript tags.

Paul saw this as a valuable new class of coverage. Metamorphic testing represents a way to create better distribution analyses through understanding the relationships among tests. This can reveal critical-but-complex issues that traditional verification methods may overlook. He saw this as an emerging class of coverage that new verification tools could be built around. Paul asserted that a future metamorphic-testing-based tool’s main contribution to the field of verification would be to better analyze noisy performance results where the noise is multi-modal. It could be useful in detecting race conditions and similar hard-to-debug anomalies. Paul also sees metamorphic testing as ripe for ML techniques. Overall—Paul sees a bright future for metamorphic testing in verification.

Jim is reminded of Solido and Spice—these metamorphic testing capabilities are “more than just a feature”—they might be a product. Maybe even a whole new class of verification tools, as Paul said.

Bernard says that this topic is “too rich to address in one blog”, so be sure to head over to the post to see more of what the future has in store for verification.

26 bytes small Linux/x86 reboot polymorphic shellcode.