A/B TESTING OF INSTALLED GRAPHICAL USER INTERFACES

In a computer a graphical user interface (GUI) portion of an application program is instantiated as a core module and variable modules. One of a set of distinct versions of a variable module is selected and for interoperating with the core module, where the versions differ by respective implementations of a user-visible feature. Usage of the GUI involving the user-visible feature is monitored, recorded and reported, including collection of performance information for operations potentially affected by the use of the selected version rather than another version of the variable module. The performance information is transmitted to an evaluation system that collects performance information from a sample population of systems using all the distinct versions of the variable module, and applies statistical analysis to the performance information to yield statistical performance measures for the different implementations, usable to decide whether wider-scale official deployment of a new implementation is desirable.