A feasibility study by Embecosm into the commercial viability of superoptimization supported by Innovate UK, the British Government's innovation agency. It has developed a proof of concept superoptimizer that considers all features of a modern processor.
This Wiki describes a feasibility study looking at the commercial viability of superoptimization. In the course of this project, we have developed a proof of concept superoptimizer, as the basis of a future more complete implementation that can be integrated with existing compilers and used in production environments.
The initial research project ran from 1st June to 30th September 2014 and was undertaken by Embecosm.
The goals of the project can be summarised as:
- Identify code that can be superoptimized (for speed, size or energy) focusing on finding awkward constructs
- Design a peephole optimization pass (or similar) to integrate a superoptimizer into GCC and/or LLVM
- Hand-calculate benefit from superoptimization, comparing the different techniques
- Document the generalized process to demonstrate repeatability
- Create an initial business plan for commercial deployment of superoptimization
Superoptimization is an idea which produces perfectly optimal code, in place of the code we currently have generated by compilers. This is typically done via a bruteforce search of every possible instruction sequence, checking whether it performs the desired actions and accepting the sequence if it is the optimal one.
The problem is clearly very difficult, exploding in size as the length of the instruction sequence increases. However, superoptimization gaining traction as a method of optimizing programs. In this feasibility study we hope to find which techniques are extensible enough to bring out of the academic community to be using in a commercial setting. This means that the superoptimizer needs to be able to handle all the corner cases that may arise in production code. If it turns out that superoptimization is not currently feasibly, by the end of the project we will have a research roadmap describing what will need to be done next.
Superoptimization was first conceived by Henry Massalin, where a bruteforce search was conducted through the arithmetic instructions of the Motorola 68000. The example given in the original paper is given below.
The function on the left is compiled, giving the piece of code on the right, with multiple branches and comparisons. This could perhaps be reduced by an expert assembly programmer, but was generally accepted as close to optimal. When the superoptimizer was run on this program, a much shorter version was found - 4 instructions long and with no branching.
On the left is the instruction sequence found by the superoptimizer (Motorola 68000), with the definitions of the instructions on the far right. In the middle are three cases, computed step by step to illustrate how the code sequence works. How to instructions compute their result is not obvious exploiting the carry flag ('x') in combination with arithmetic instructions.
The project runs from 1 June to 30 September 2014. The lead investigator is James Pallister and the project manager Jeremy Bennett. The project plan describes five work packages and includes a risk analysis. These are living documents, which evolve with the project. In addition notes have been recorded from key meetings throughout the project.
This research is supported by the Innovate UK (Technology Strategy Board).
Any enquiries should be directed in the first instance to email@example.com.