[qmtest] The state of GUI

[Stefan Seefeld]

Vladimir Prus wrote:

> You mean "this test results are for configuration 1"? That would make sense. 
> However
> - last time I checked, expectations loading was hardcoded logic to test either 
> for xml file or for pickled data. Maybe this changed, but if not, this is not 
> particularly flexible. What if I have my own way to describe expectations.

I think the idea is that expectations (at least in the context of regression tests)
are the result of an initial (or former) test run, and thus QMTest uses its own
result files as expectation input.

> - If xml/pickle format is OK for now, there should be some way to edit it with 
> a GUI. Loading results for each configuration, editing them and saving would 
> be very inconvenient. Say I want to mark a test as failing for gcc-2.95, 2.96 
> and 2.95-stlport.

I can see that, yes.

> This suggests we probably need a format for expectation file that can contain 
> several sets of results. So, QMTest will load the file and ask for results 
> for a specific tested configuration. 

I'm not sure whether the best solution is indeed a new file format. May be it
would be simpler to expand on the idea of a report as a view on results from
multiple configurations and then provide some convenience interface (GUI ?)
to set annotations to multiple result files at once ? (you still need to
provide a list of all those configurations to which you do want the change
to propagate...)

Regards,
		Stefan