SLAC PEP-II
BABAR
SLAC<->RAL
Babar logo
HEPIC E,S & H Databases PDG HEP preprints
Organization Detector Computing Physics Documentation
Personnel Glossary Sitemap Search Hypernews
Unwrap page!
Comp. Search
Who's who?
Meetings
FAQ Homepage
Archive
Environment
Administration
New User Info.
Web Info/Tools
Monitoring
Training
Tools & Utils
Programming
C++ Standard
SRT, AFS, CVS
QA and QC
Remedy
Histogramming
Operations
PromptReco
Simulation Production
Online SW
Dataflow
Detector Control
Evt Processing
Run Control
Calibration
Databases
Offline
Workbook
Coding Standards
Simulation
Reconstruction
Prompt Reco.
BaBar Grid
Data Distribution
Beta & BetaTools
Kanga & Root
Analysis Tools
RooFit Toolkit
Data Management
Data Quality
Event display
Event Browser
Code releases
Databases
Check this page for HTML 4.01 Transitional compliance with the
W3C Validator
(More checks...)

Paul Bright-Thomas
Online QA, June 28th 99

Modelling QA PR Tools

  • Trying to form a functional model of Prompt Reco QA tools
  • QA PR monitoring will consist of two parts:
    1. QaPrMon, which makes statistical tests of Dhp-format PR histograms, specified as comparison records;
    2. QaBrowser, which displays the inputs and results of comparisons.
    where 1) will run automatically after each new chunk of data is processed, and 2) runs in response to some user action.
  • Components of QaPrMon mostly available through DhpXxx packages --- remaining questions concern interfacing and control.
  • QaBrowser prototyped --- needs some additional functionality to suit it to user model.
  • Foresee two user modes for QaBrowser:
    specific, in response to known problem with a given comparison;
    general, browsing a set of histograms produced over a given time period (and perhaps perform further comparisons)
  • Two versions of the model are suggested:
    QaBrowser launched by ErrorBrowser, or
    QarRowser parallel to ErrorBrowser.
  • Comments on these models are very welcome.
< Start | Next >

Version 1: QaBrowser driven by ErrorBrowser

  1. Prompt Reco nodes complete processing of a block of data, forming Dhp monitoring histograms for the subsystems; Requestor collects and merges these histograms.
  2. Requestor returns merged Dhp histograms to special node, writes histograms to database.
  3. QaPrMon wakes up every, say, 15 minutes and determines if there are new PR monitoring histograms to be analysed, according to a .cri comparison record specification file.
  4. If so, it obtains live and reference histograms via servers, and performs specified analysis.
  5. Error outcomes sent to the Error Logger, which displays errors to shifters via Error Browser
  6. From a given error, shifter can call up display of histograms and supplementary information, provided by QaBrowser (histograms provided again by servers).
< Previous | Start | Next >

Questions

Some obvious questions about this model are:

  • Which database are we talking about for storage of PR histograms?
  • Could the requestor write directly to database?
  • Is the "sleeping QaPrMon" a good idea, or should it be triggered by the writing of histogram objects to DB?
  • In either case, how does QaPrMon know which histo objects to ask for and how to specify them to servers?
  • Where is QaPrMon going to run? One of the nodes of the farm?
  • Does QaPrMon need to write its results anywhere other than Error Logger? (e.g. for histories, fit parameters ...)
  • Do live and reference histogram servers run all the time, or are they initiated by QaPrMon?
  • How does the ErrorBrowser get enough information to launch QaBrowser with a specified comparison?









< Previous | Start | Next >

Version 2: QaBrowser in parallel to ErrorBrowser


Alternative linking of two functions (cut out the middle man):
  • QaPrMon sends only error messages to ErrorLogger/ErrorBrowser.
  • More detailed comparison info (incl histo handle) sent to QaBrowser in parallel.
  • QaBrowser reproduces ErrorBrowser display of QA PR errors (so implementing filtering.
  • QaBrowser associates each error with histogram input to the comparison, and can demand from servers and display.
  • Making QaBrowser independent of ErrorBrowser helpful in meeting requirement of general mode for histo browsing.
< Previous | Start | Next >

Further functionality/implementation details

QaPrMon:

  • Subsystems have asked for parametrized fitting as Dhp function; fits will be managed by QaPrMon.
  • Would like statistical tests sensitive to individual parameters, so that error response different for shift in mean or change in width.
  • Useful to keep fit parameters in DB for history, new references etc.
  • .cri configuration file will become a database object.
  • Need "offline" means for writing new references to DB.

QaBrowser:

  • QaBrowser provides search facility to locate a given error in log.
  • QaBrowser needs mechanism for user to specify histograms over time period, and means to merge them for display (end-of-shift check).
  • May also want QaBrowser to initiate a comparison on merged histograms.
  • Would be nice to provide link to web-based diagnostic information ... how can QaBrowser bring up a page in e.g. Netscape?
  • Other simple functions include Print, display histogram statistics, bin contents etc.
  • QaBrowser may obtain some of this functionality from JAS.
< Previous | Start | Next >

Information prepared by Paul Bright-Thomas
Last modified Mon Jun 28 09:00:00 PDT 1999