|
|
Paul Bright-Thomas
Online QA, June 28th 99
- Trying to form a functional model of Prompt Reco QA tools
-
QA PR monitoring will consist of two parts:
- QaPrMon, which makes statistical tests of Dhp-format PR
histograms, specified as comparison records;
- QaBrowser, which displays the inputs and results of
comparisons.
where 1) will run automatically after each new chunk of data is
processed, and 2) runs in response to some user action.
- Components of QaPrMon mostly available through DhpXxx packages --- remaining questions concern interfacing and control.
- QaBrowser prototyped --- needs some additional functionality to suit it to user model.
- Foresee two user modes for QaBrowser:
specific,
in response to known problem with a given comparison;
general, browsing a set of histograms
produced over a given time period (and perhaps perform further
comparisons)
- Two versions of the model are suggested:
QaBrowser launched by ErrorBrowser, or
QarRowser parallel to ErrorBrowser.
- Comments on these models are very welcome.
< Start |
Next >
- Prompt Reco nodes complete processing of a block of data,
forming Dhp monitoring histograms for the subsystems;
Requestor collects and merges these histograms.
- Requestor returns merged Dhp histograms to special
node, writes histograms to database.
- QaPrMon wakes up every, say, 15 minutes and determines
if there are new PR monitoring histograms to be analysed, according
to a .cri comparison record specification file.
- If so, it obtains live and reference histograms
via servers, and performs specified analysis.
- Error outcomes sent to the
Error Logger, which displays errors to shifters via Error
Browser
- From a given error, shifter can call up display of
histograms and supplementary information, provided by
QaBrowser (histograms provided again by servers).
< Previous |
Start |
Next >
Some obvious questions about this model are:
- Which database are we talking about for storage of PR histograms?
- Could the requestor write directly to database?
- Is the "sleeping QaPrMon" a good idea, or should it be
triggered by the writing of histogram objects to DB?
- In either case, how does QaPrMon know which histo objects to
ask for and how to specify them to servers?
- Where is QaPrMon going to run? One of the nodes of the farm?
- Does QaPrMon need to write its results anywhere other than
Error Logger? (e.g. for histories, fit parameters ...)
- Do live and reference histogram servers run all the time,
or are they initiated by QaPrMon?
- How does the ErrorBrowser get enough information to launch
QaBrowser with a specified comparison?
< Previous |
Start |
Next >
Alternative linking of two functions (cut out the middle man):
- QaPrMon sends only error messages to
ErrorLogger/ErrorBrowser.
- More detailed comparison info (incl histo handle) sent to
QaBrowser in parallel.
- QaBrowser reproduces ErrorBrowser display of QA PR
errors (so implementing filtering.
- QaBrowser associates each error with histogram input
to the comparison, and can demand from servers and display.
- Making QaBrowser independent of ErrorBrowser helpful in
meeting requirement of general mode for histo browsing.
< Previous |
Start |
Next >
QaPrMon:
- Subsystems have asked for parametrized fitting as Dhp
function; fits will be managed by QaPrMon.
- Would like statistical tests sensitive
to individual parameters, so that error response different for
shift in mean or change in width.
- Useful to keep fit parameters in DB for history, new
references etc.
- .cri configuration file will become a database object.
- Need "offline" means for writing new references to DB.
QaBrowser:
- QaBrowser provides search facility to locate a given error
in log.
- QaBrowser needs mechanism for user to specify histograms over time
period, and means to merge them for display (end-of-shift check).
- May also want QaBrowser to initiate a comparison on merged
histograms.
- Would be nice to provide link to web-based diagnostic
information ... how can QaBrowser bring up a page in e.g. Netscape?
- Other simple functions include Print, display histogram
statistics, bin contents etc.
- QaBrowser may obtain some of this functionality from JAS.
< Previous |
Start |
Next >
Information prepared by Paul Bright-Thomas
Last modified Mon Jun 28 09:00:00 PDT 1999
|
|