controlMonitor API client
The controlMonitor API client (cmonClient) is a graphical user interface that supports
monitoring and control of LDAS system via requests made to the
control and Monitor API (cntlmonAPI) server in the LDAS system; request are of the types:
- monitor functions - retrieve information on LDAS ( e.g. load, API status, log filtering,
listing active jobs and jobs in the mpi job queue, beowulf node usage etc.)
- control functions - make changes to the LDAS system if the user is
authorized to do so ( e.g. start or stop LDAS APIs or the entire system,
tape control, login to beowulf nodes, change API resources etc.).
- Connection to cntlmonAPI server
- Site information maintanence
- Operation of special widgets
- Graph operations
Navigation through Pages
Specific functions of the client are accessed by hitting the Tab
button on the top of each Page.
Functions are described here in the order of left to right as they appear
in cmonClient. It is highly recommended to bring up cmonClient for reference while
going through this help session.
- LDAS Control
- LDAS API control - add, shutdown, restart individual APIs
- LDAS System control - start or stop LDAS
- LDAS Resource control - modify API resources
- LDAS Utilities control
- restart log, database monitors, compare databases etc.
- LDAS User Administration - maintain user accounts
- Block DSO - block DSOs
- LDAS Core File Management - examine, delete core files
- Status
- API status - API run status e.g. memory, cpu, data objects
- NTP Server Diagnostics - monitor API network time synchronization
- API state summary - summary of running and queued jobs
- System Load
- LDAS Non beowulf servers - display unix ps information for non-beowulf servers
- LDAS beowulf nodes - display unix ps information for beowulf and nodes
- APIs
- API System Resources -
- plot of API memory, cpu usage vs time
- Time Metrics
- plot of time spent by jobs in API vs time
- Job Information and control
- Job Statistics - plot of jobs passed/failed vs time
- Database Statistics - plot of insertions/queries vs time
- Queue Statistics - plot of #jobs in queue vs time
- Active Job Control - view job details, abort jobs
- Job Output Directory - view output files in job directories
- Usage Details - breakdown of jobs counts by command and user
- LDAS Log Filter - filter LDAS logs by jobId or by time
- MPI Jobs
- MPI Jobs control - view MPI job details, abort MPI jobs
- Load Summary - plot of load summary on beowulf nodes
- Node Usage Statistics - plot of number of nodes used vs time
- Beowulf System
- Node Balance and Login - add or delete beowulf nodes, login to nodes
- MPI Users Queue - display the MPI users queue
- Verify Beowulf Users (wrapperAPI processes) - display list of wrapper jobs
- Verify all Beowulf Users and nodes are ready for ldas jobs - PASS/FAIL test on all nodes and beowulf users
- Monitor Node Usage by groups - display unix ps information for group of nodes
- LDAS Test - run sample LDAS user commands to validate system
- View Database - plots of database numerical column data vs time inserted
- Cache View - graph of frame times in diskcacheAPI
- Directories - display directory tree for diskcacheAPI mount points
Design
- Client and Server Model
- Client States